2024-08-17T02:12:44.271 INFO:root:teuthology version: 1.2.0 2024-08-17T02:12:44.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:12:44.393 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858245 branch: wip-mchangir-mgr-volumes-print-thread-name-quincy description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} email: mchangir@redhat.com first_in_suite: false job_id: '7858245' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - filesystem is online with fewer MDS than max_mds - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e owner: scheduled_mchangir@teuthology priority: 25 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 5995 sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e sleep_before_teardown: 0 suite: fs suite_branch: wip-mchangir-mgr-volumes-print-thread-name-quincy suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e targets: smithi153.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi174.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestVolumes - tasks.cephfs.test_volumes.TestSubvolumeGroups - tasks.cephfs.test_volumes.TestSubvolumes teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 67db276914d29505c9707d04f3a3b8fb9d8aee4b timestamp: 2024-08-17_01:02:08 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-17T02:12:44.393 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa; will attempt to use it 2024-08-17T02:12:44.394 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks 2024-08-17T02:12:44.394 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-17T02:12:44.396 INFO:teuthology.task.internal:Checking packages... 2024-08-17T02:12:44.417 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '2577e8139c6b8786f9d6d6ea21b8da9244b9260e' 2024-08-17T02:12:44.417 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-17T02:12:44.417 INFO:teuthology.packaging:ref: None 2024-08-17T02:12:44.417 INFO:teuthology.packaging:tag: None 2024-08-17T02:12:44.418 INFO:teuthology.packaging:branch: wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:12:44.418 INFO:teuthology.packaging:sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:12:44.418 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:12:44.572 INFO:teuthology.task.internal:Found packages for ceph version 17.2.7-1375-g2577e813-1focal 2024-08-17T02:12:44.573 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-17T02:12:44.580 INFO:teuthology.task.internal:no buildpackages task found 2024-08-17T02:12:44.580 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-17T02:12:44.595 INFO:teuthology.task.internal:Saving configuration 2024-08-17T02:12:44.610 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-17T02:12:44.617 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-17T02:12:44.643 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858245', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:03:45.947539', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-08-17T02:12:44.665 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858245', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:03:45.949986', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-08-17T02:12:44.665 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-17T02:12:44.671 INFO:teuthology.task.internal:roles: ubuntu@smithi153.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-08-17T02:12:44.671 INFO:teuthology.task.internal:roles: ubuntu@smithi174.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-08-17T02:12:44.671 INFO:teuthology.run_tasks:Running task console_log... 2024-08-17T02:12:44.730 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f65821cfac0>, signals=[15]) 2024-08-17T02:12:44.731 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-17T02:12:44.737 INFO:teuthology.task.internal:Opening connections... 2024-08-17T02:12:44.737 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi153.front.sepia.ceph.com 2024-08-17T02:12:44.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:12:44.828 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi174.front.sepia.ceph.com 2024-08-17T02:12:44.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:12:44.914 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-17T02:12:44.921 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2024-08-17T02:12:44.927 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2024-08-17T02:12:44.927 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2024-08-17T02:12:44.973 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Ubuntu" 2024-08-17T02:12:44.974 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-08-17T02:12:44.974 INFO:teuthology.orchestra.run.smithi153.stdout:ID=ubuntu 2024-08-17T02:12:44.974 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE=debian 2024-08-17T02:12:44.974 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-08-17T02:12:44.974 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="20.04" 2024-08-17T02:12:44.974 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.ubuntu.com/" 2024-08-17T02:12:44.974 INFO:teuthology.orchestra.run.smithi153.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-08-17T02:12:44.974 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-08-17T02:12:44.974 INFO:teuthology.orchestra.run.smithi153.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-08-17T02:12:44.974 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_CODENAME=focal 2024-08-17T02:12:44.974 INFO:teuthology.orchestra.run.smithi153.stdout:UBUNTU_CODENAME=focal 2024-08-17T02:12:44.975 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2024-08-17T02:12:44.998 DEBUG:teuthology.orchestra.run.smithi174:> uname -m 2024-08-17T02:12:45.004 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2024-08-17T02:12:45.005 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2024-08-17T02:12:45.054 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="Ubuntu" 2024-08-17T02:12:45.054 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-08-17T02:12:45.055 INFO:teuthology.orchestra.run.smithi174.stdout:ID=ubuntu 2024-08-17T02:12:45.055 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE=debian 2024-08-17T02:12:45.055 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-08-17T02:12:45.055 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="20.04" 2024-08-17T02:12:45.055 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://www.ubuntu.com/" 2024-08-17T02:12:45.055 INFO:teuthology.orchestra.run.smithi174.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-08-17T02:12:45.055 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-08-17T02:12:45.055 INFO:teuthology.orchestra.run.smithi174.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-08-17T02:12:45.055 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_CODENAME=focal 2024-08-17T02:12:45.055 INFO:teuthology.orchestra.run.smithi174.stdout:UBUNTU_CODENAME=focal 2024-08-17T02:12:45.056 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2024-08-17T02:12:45.073 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-17T02:12:45.082 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-17T02:12:45.088 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-17T02:12:45.088 DEBUG:teuthology.orchestra.run.smithi153:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:12:45.090 DEBUG:teuthology.orchestra.run.smithi174:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:12:45.096 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-17T02:12:45.101 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-17T02:12:45.102 DEBUG:teuthology.orchestra.run.smithi153:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:12:45.104 DEBUG:teuthology.orchestra.run.smithi174:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:12:45.148 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-17T02:12:45.199 INFO:teuthology.run_tasks:Running task kernel... 2024-08-17T02:12:45.213 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-08-17T02:12:45.213 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-08-17T02:12:45.213 DEBUG:teuthology.orchestra.run.smithi153:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:12:45.214 DEBUG:teuthology.orchestra.run.smithi174:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:12:45.218 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:12:45.219 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2024-08-17T02:12:45.220 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:12:45.220 DEBUG:teuthology.orchestra.run.smithi174:> uname -r 2024-08-17T02:12:45.226 INFO:teuthology.orchestra.run.smithi153.stdout:5.4.0-124-generic 2024-08-17T02:12:45.226 INFO:teuthology.task.kernel:Running kernel on smithi153: 5.4.0-124-generic 2024-08-17T02:12:45.226 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get clean 2024-08-17T02:12:45.270 INFO:teuthology.orchestra.run.smithi174.stdout:5.4.0-124-generic 2024-08-17T02:12:45.271 INFO:teuthology.task.kernel:Running kernel on smithi174: 5.4.0-124-generic 2024-08-17T02:12:45.271 DEBUG:teuthology.orchestra.run.smithi174:> sudo apt-get clean 2024-08-17T02:12:45.366 DEBUG:teuthology.orchestra.run.smithi174:> sudo apt-get update 2024-08-17T02:12:45.371 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get update 2024-08-17T02:12:45.628 INFO:teuthology.orchestra.run.smithi153.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [128 kB] 2024-08-17T02:12:45.650 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-17T02:12:45.650 INFO:teuthology.orchestra.run.smithi174.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [128 kB] 2024-08-17T02:12:45.706 INFO:teuthology.orchestra.run.smithi174.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [128 kB] 2024-08-17T02:12:45.729 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-17T02:12:45.811 INFO:teuthology.orchestra.run.smithi153.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [128 kB] 2024-08-17T02:12:45.918 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [797 kB] 2024-08-17T02:12:46.011 INFO:teuthology.orchestra.run.smithi153.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [3,126 kB] 2024-08-17T02:12:46.052 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [464 kB] 2024-08-17T02:12:46.056 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [14.2 kB] 2024-08-17T02:12:46.056 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [3,034 kB] 2024-08-17T02:12:46.059 INFO:teuthology.orchestra.run.smithi174.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [128 kB] 2024-08-17T02:12:46.101 INFO:teuthology.orchestra.run.smithi153.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [38.1 kB] 2024-08-17T02:12:46.102 INFO:teuthology.orchestra.run.smithi153.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [425 kB] 2024-08-17T02:12:46.106 INFO:teuthology.orchestra.run.smithi153.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [544 B] 2024-08-17T02:12:46.106 INFO:teuthology.orchestra.run.smithi153.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [674 kB] 2024-08-17T02:12:46.114 INFO:teuthology.orchestra.run.smithi153.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [999 kB] 2024-08-17T02:12:46.121 INFO:teuthology.orchestra.run.smithi153.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [212 kB] 2024-08-17T02:12:46.123 INFO:teuthology.orchestra.run.smithi153.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [21.0 kB] 2024-08-17T02:12:46.123 INFO:teuthology.orchestra.run.smithi153.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2024-08-17T02:12:46.123 INFO:teuthology.orchestra.run.smithi153.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.8 kB] 2024-08-17T02:12:46.135 INFO:teuthology.orchestra.run.smithi174.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [797 kB] 2024-08-17T02:12:46.180 INFO:teuthology.orchestra.run.smithi153.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,968 B] 2024-08-17T02:12:46.180 INFO:teuthology.orchestra.run.smithi153.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2024-08-17T02:12:46.182 INFO:teuthology.orchestra.run.smithi153.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-backports InRelease [128 kB] 2024-08-17T02:12:46.273 INFO:teuthology.orchestra.run.smithi174.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,496 kB] 2024-08-17T02:12:46.322 INFO:teuthology.orchestra.run.smithi153.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [1,017 kB] 2024-08-17T02:12:46.481 INFO:teuthology.orchestra.run.smithi174.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [3,126 kB] 2024-08-17T02:12:46.565 INFO:teuthology.orchestra.run.smithi153.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,496 kB] 2024-08-17T02:12:46.672 INFO:teuthology.orchestra.run.smithi174.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [464 kB] 2024-08-17T02:12:46.687 INFO:teuthology.orchestra.run.smithi174.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [14.2 kB] 2024-08-17T02:12:46.687 INFO:teuthology.orchestra.run.smithi174.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [3,034 kB] 2024-08-17T02:12:46.732 INFO:teuthology.orchestra.run.smithi153.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [543 kB] 2024-08-17T02:12:46.739 INFO:teuthology.orchestra.run.smithi174.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [1,017 kB] 2024-08-17T02:12:46.745 INFO:teuthology.orchestra.run.smithi153.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.7 kB] 2024-08-17T02:12:46.745 INFO:teuthology.orchestra.run.smithi153.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [3,152 kB] 2024-08-17T02:12:46.757 INFO:teuthology.orchestra.run.smithi174.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [543 kB] 2024-08-17T02:12:46.766 INFO:teuthology.orchestra.run.smithi174.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.7 kB] 2024-08-17T02:12:46.766 INFO:teuthology.orchestra.run.smithi174.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [39.4 kB] 2024-08-17T02:12:46.767 INFO:teuthology.orchestra.run.smithi174.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [3,152 kB] 2024-08-17T02:12:46.774 INFO:teuthology.orchestra.run.smithi174.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [38.1 kB] 2024-08-17T02:12:46.779 INFO:teuthology.orchestra.run.smithi174.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [425 kB] 2024-08-17T02:12:46.792 INFO:teuthology.orchestra.run.smithi174.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [544 B] 2024-08-17T02:12:46.792 INFO:teuthology.orchestra.run.smithi174.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [999 kB] 2024-08-17T02:12:46.815 INFO:teuthology.orchestra.run.smithi174.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [674 kB] 2024-08-17T02:12:46.835 INFO:teuthology.orchestra.run.smithi153.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [39.4 kB] 2024-08-17T02:12:46.836 INFO:teuthology.orchestra.run.smithi153.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [442 kB] 2024-08-17T02:12:46.837 INFO:teuthology.orchestra.run.smithi174.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [212 kB] 2024-08-17T02:12:46.844 INFO:teuthology.orchestra.run.smithi174.stdout:Get:22 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [21.0 kB] 2024-08-17T02:12:46.844 INFO:teuthology.orchestra.run.smithi174.stdout:Get:23 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.8 kB] 2024-08-17T02:12:46.845 INFO:teuthology.orchestra.run.smithi174.stdout:Get:24 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2024-08-17T02:12:46.845 INFO:teuthology.orchestra.run.smithi153.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [540 B] 2024-08-17T02:12:46.852 INFO:teuthology.orchestra.run.smithi153.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,219 kB] 2024-08-17T02:12:46.856 INFO:teuthology.orchestra.run.smithi174.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [442 kB] 2024-08-17T02:12:46.863 INFO:teuthology.orchestra.run.smithi174.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [540 B] 2024-08-17T02:12:46.864 INFO:teuthology.orchestra.run.smithi174.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,219 kB] 2024-08-17T02:12:46.887 INFO:teuthology.orchestra.run.smithi153.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [801 kB] 2024-08-17T02:12:46.908 INFO:teuthology.orchestra.run.smithi153.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [294 kB] 2024-08-17T02:12:46.916 INFO:teuthology.orchestra.run.smithi153.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [27.8 kB] 2024-08-17T02:12:46.917 INFO:teuthology.orchestra.run.smithi174.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,968 B] 2024-08-17T02:12:46.917 INFO:teuthology.orchestra.run.smithi153.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2024-08-17T02:12:46.917 INFO:teuthology.orchestra.run.smithi153.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [27.1 kB] 2024-08-17T02:12:46.918 INFO:teuthology.orchestra.run.smithi174.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2024-08-17T02:12:46.918 INFO:teuthology.orchestra.run.smithi174.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [801 kB] 2024-08-17T02:12:46.931 INFO:teuthology.orchestra.run.smithi174.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [294 kB] 2024-08-17T02:12:46.935 INFO:teuthology.orchestra.run.smithi174.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [27.8 kB] 2024-08-17T02:12:46.935 INFO:teuthology.orchestra.run.smithi174.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2024-08-17T02:12:46.936 INFO:teuthology.orchestra.run.smithi174.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [27.1 kB] 2024-08-17T02:12:46.938 INFO:teuthology.orchestra.run.smithi174.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,936 B] 2024-08-17T02:12:46.982 INFO:teuthology.orchestra.run.smithi153.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,936 B] 2024-08-17T02:12:46.982 INFO:teuthology.orchestra.run.smithi153.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2024-08-17T02:12:46.982 INFO:teuthology.orchestra.run.smithi153.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-08-17T02:12:46.983 INFO:teuthology.orchestra.run.smithi153.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-08-17T02:12:46.984 INFO:teuthology.orchestra.run.smithi153.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-08-17T02:12:47.003 INFO:teuthology.orchestra.run.smithi174.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2024-08-17T02:12:47.004 INFO:teuthology.orchestra.run.smithi174.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-08-17T02:12:47.004 INFO:teuthology.orchestra.run.smithi174.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-08-17T02:12:47.005 INFO:teuthology.orchestra.run.smithi174.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-08-17T02:12:47.063 INFO:teuthology.orchestra.run.smithi153.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-08-17T02:12:47.063 INFO:teuthology.orchestra.run.smithi153.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-08-17T02:12:47.064 INFO:teuthology.orchestra.run.smithi153.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-08-17T02:12:47.085 INFO:teuthology.orchestra.run.smithi174.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-08-17T02:12:47.085 INFO:teuthology.orchestra.run.smithi174.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-08-17T02:12:47.086 INFO:teuthology.orchestra.run.smithi174.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-08-17T02:12:50.362 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 21.4 MB in 3s (7,289 kB/s) 2024-08-17T02:12:50.857 INFO:teuthology.orchestra.run.smithi174.stdout:Fetched 21.4 MB in 4s (6,064 kB/s) 2024-08-17T02:12:51.927 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-08-17T02:12:51.953 DEBUG:teuthology.orchestra.run.smithi153:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-17T02:12:52.031 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-08-17T02:12:52.247 INFO:teuthology.orchestra.run.smithi153.stdout:Building dependency tree... 2024-08-17T02:12:52.247 INFO:teuthology.orchestra.run.smithi153.stdout:Reading state information... 2024-08-17T02:12:52.358 INFO:teuthology.orchestra.run.smithi174.stdout:Reading package lists... 2024-08-17T02:12:52.386 DEBUG:teuthology.orchestra.run.smithi174:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-17T02:12:52.455 INFO:teuthology.orchestra.run.smithi153.stdout:The following additional packages will be installed: 2024-08-17T02:12:52.455 INFO:teuthology.orchestra.run.smithi153.stdout: linux-generic linux-headers-5.4.0-192 linux-headers-5.4.0-192-generic 2024-08-17T02:12:52.455 INFO:teuthology.orchestra.run.smithi153.stdout: linux-headers-generic linux-image-5.4.0-192-generic 2024-08-17T02:12:52.455 INFO:teuthology.orchestra.run.smithi153.stdout: linux-modules-5.4.0-192-generic linux-modules-extra-5.4.0-192-generic 2024-08-17T02:12:52.457 INFO:teuthology.orchestra.run.smithi153.stdout:Suggested packages: 2024-08-17T02:12:52.457 INFO:teuthology.orchestra.run.smithi153.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-08-17T02:12:52.457 INFO:teuthology.orchestra.run.smithi153.stdout:Recommended packages: 2024-08-17T02:12:52.457 INFO:teuthology.orchestra.run.smithi153.stdout: thermald 2024-08-17T02:12:52.461 INFO:teuthology.orchestra.run.smithi174.stdout:Reading package lists... 2024-08-17T02:12:52.509 INFO:teuthology.orchestra.run.smithi153.stdout:The following NEW packages will be installed: 2024-08-17T02:12:52.509 INFO:teuthology.orchestra.run.smithi153.stdout: linux-headers-5.4.0-192 linux-headers-5.4.0-192-generic 2024-08-17T02:12:52.509 INFO:teuthology.orchestra.run.smithi153.stdout: linux-image-5.4.0-192-generic linux-modules-5.4.0-192-generic 2024-08-17T02:12:52.509 INFO:teuthology.orchestra.run.smithi153.stdout: linux-modules-extra-5.4.0-192-generic 2024-08-17T02:12:52.511 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages will be upgraded: 2024-08-17T02:12:52.511 INFO:teuthology.orchestra.run.smithi153.stdout: linux-generic linux-headers-generic linux-image-generic 2024-08-17T02:12:52.565 INFO:teuthology.orchestra.run.smithi153.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-08-17T02:12:52.566 INFO:teuthology.orchestra.run.smithi153.stdout:Need to get 77.2 MB of archives. 2024-08-17T02:12:52.566 INFO:teuthology.orchestra.run.smithi153.stdout:After this operation, 381 MB of additional disk space will be used. 2024-08-17T02:12:52.566 INFO:teuthology.orchestra.run.smithi153.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-192-generic amd64 5.4.0-192.212 [15.0 MB] 2024-08-17T02:12:52.685 INFO:teuthology.orchestra.run.smithi174.stdout:Building dependency tree... 2024-08-17T02:12:52.686 INFO:teuthology.orchestra.run.smithi174.stdout:Reading state information... 2024-08-17T02:12:52.887 INFO:teuthology.orchestra.run.smithi174.stdout:The following additional packages will be installed: 2024-08-17T02:12:52.887 INFO:teuthology.orchestra.run.smithi174.stdout: linux-generic linux-headers-5.4.0-192 linux-headers-5.4.0-192-generic 2024-08-17T02:12:52.888 INFO:teuthology.orchestra.run.smithi174.stdout: linux-headers-generic linux-image-5.4.0-192-generic 2024-08-17T02:12:52.888 INFO:teuthology.orchestra.run.smithi174.stdout: linux-modules-5.4.0-192-generic linux-modules-extra-5.4.0-192-generic 2024-08-17T02:12:52.889 INFO:teuthology.orchestra.run.smithi174.stdout:Suggested packages: 2024-08-17T02:12:52.889 INFO:teuthology.orchestra.run.smithi174.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-08-17T02:12:52.889 INFO:teuthology.orchestra.run.smithi174.stdout:Recommended packages: 2024-08-17T02:12:52.889 INFO:teuthology.orchestra.run.smithi174.stdout: thermald 2024-08-17T02:12:52.891 INFO:teuthology.orchestra.run.smithi153.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-192-generic amd64 5.4.0-192.212 [10.5 MB] 2024-08-17T02:12:52.956 INFO:teuthology.orchestra.run.smithi174.stdout:The following NEW packages will be installed: 2024-08-17T02:12:52.956 INFO:teuthology.orchestra.run.smithi174.stdout: linux-headers-5.4.0-192 linux-headers-5.4.0-192-generic 2024-08-17T02:12:52.956 INFO:teuthology.orchestra.run.smithi174.stdout: linux-image-5.4.0-192-generic linux-modules-5.4.0-192-generic 2024-08-17T02:12:52.957 INFO:teuthology.orchestra.run.smithi174.stdout: linux-modules-extra-5.4.0-192-generic 2024-08-17T02:12:52.958 INFO:teuthology.orchestra.run.smithi174.stdout:The following packages will be upgraded: 2024-08-17T02:12:52.959 INFO:teuthology.orchestra.run.smithi174.stdout: linux-generic linux-headers-generic linux-image-generic 2024-08-17T02:12:52.985 INFO:teuthology.orchestra.run.smithi153.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-192-generic amd64 5.4.0-192.212 [39.2 MB] 2024-08-17T02:12:53.014 INFO:teuthology.orchestra.run.smithi174.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-08-17T02:12:53.014 INFO:teuthology.orchestra.run.smithi174.stdout:Need to get 77.2 MB of archives. 2024-08-17T02:12:53.014 INFO:teuthology.orchestra.run.smithi174.stdout:After this operation, 381 MB of additional disk space will be used. 2024-08-17T02:12:53.014 INFO:teuthology.orchestra.run.smithi174.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-192-generic amd64 5.4.0-192.212 [15.0 MB] 2024-08-17T02:12:53.347 INFO:teuthology.orchestra.run.smithi174.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-192-generic amd64 5.4.0-192.212 [10.5 MB] 2024-08-17T02:12:53.439 INFO:teuthology.orchestra.run.smithi174.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-192-generic amd64 5.4.0-192.212 [39.2 MB] 2024-08-17T02:12:53.473 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.192.190 [1,900 B] 2024-08-17T02:12:53.473 INFO:teuthology.orchestra.run.smithi153.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.192.190 [2,588 B] 2024-08-17T02:12:53.473 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-192 all 5.4.0-192.212 [11.0 MB] 2024-08-17T02:12:53.570 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-192-generic amd64 5.4.0-192.212 [1,398 kB] 2024-08-17T02:12:53.581 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.192.190 [2,456 B] 2024-08-17T02:12:53.905 INFO:teuthology.orchestra.run.smithi174.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.192.190 [1,900 B] 2024-08-17T02:12:53.906 INFO:teuthology.orchestra.run.smithi174.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.192.190 [2,588 B] 2024-08-17T02:12:53.906 INFO:teuthology.orchestra.run.smithi174.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-192 all 5.4.0-192.212 [11.0 MB] 2024-08-17T02:12:53.999 INFO:teuthology.orchestra.run.smithi174.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-192-generic amd64 5.4.0-192.212 [1,398 kB] 2024-08-17T02:12:54.009 INFO:teuthology.orchestra.run.smithi174.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.192.190 [2,456 B] 2024-08-17T02:12:54.269 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 77.2 MB in 1s (72.6 MB/s) 2024-08-17T02:12:54.454 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-modules-5.4.0-192-generic. 2024-08-17T02:12:54.682 INFO:teuthology.orchestra.run.smithi174.stdout:Fetched 77.2 MB in 1s (74.0 MB/s) 2024-08-17T02:12:54.846 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package linux-modules-5.4.0-192-generic. 2024-08-17T02:12:56.166 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-08-17T02:12:56.171 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../0-linux-modules-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:12:56.251 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-modules-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:12:56.502 INFO:teuthology.orchestra.run.smithi174.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-08-17T02:12:56.507 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../0-linux-modules-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:12:56.593 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking linux-modules-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:12:58.252 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-image-5.4.0-192-generic. 2024-08-17T02:12:58.265 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../1-linux-image-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:12:58.361 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:12:58.493 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package linux-image-5.4.0-192-generic. 2024-08-17T02:12:58.506 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../1-linux-image-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:12:58.606 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:12:59.438 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-192-generic. 2024-08-17T02:12:59.452 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:12:59.496 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-modules-extra-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:12:59.670 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-192-generic. 2024-08-17T02:12:59.686 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:12:59.728 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking linux-modules-extra-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:13:04.116 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../3-linux-generic_5.4.0.192.190_amd64.deb ... 2024-08-17T02:13:04.243 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-17T02:13:04.569 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.192.190_amd64.deb ... 2024-08-17T02:13:04.697 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-image-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-17T02:13:04.830 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../3-linux-generic_5.4.0.192.190_amd64.deb ... 2024-08-17T02:13:04.958 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking linux-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-17T02:13:05.050 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-headers-5.4.0-192. 2024-08-17T02:13:05.063 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../5-linux-headers-5.4.0-192_5.4.0-192.212_all.deb ... 2024-08-17T02:13:05.100 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-headers-5.4.0-192 (5.4.0-192.212) ... 2024-08-17T02:13:05.291 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.192.190_amd64.deb ... 2024-08-17T02:13:05.419 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking linux-image-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-17T02:13:05.763 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package linux-headers-5.4.0-192. 2024-08-17T02:13:05.780 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../5-linux-headers-5.4.0-192_5.4.0-192.212_all.deb ... 2024-08-17T02:13:05.821 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking linux-headers-5.4.0-192 (5.4.0-192.212) ... 2024-08-17T02:13:10.321 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-headers-5.4.0-192-generic. 2024-08-17T02:13:10.344 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../6-linux-headers-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:13:10.387 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-headers-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:13:11.052 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package linux-headers-5.4.0-192-generic. 2024-08-17T02:13:11.072 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../6-linux-headers-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:13:11.110 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking linux-headers-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:13:13.757 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.192.190_amd64.deb ... 2024-08-17T02:13:13.884 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking linux-headers-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-17T02:13:14.180 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.192.190_amd64.deb ... 2024-08-17T02:13:14.216 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up linux-headers-5.4.0-192 (5.4.0-192.212) ... 2024-08-17T02:13:14.302 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-headers-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-17T02:13:14.356 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up linux-modules-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:13:14.671 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-headers-5.4.0-192 (5.4.0-192.212) ... 2024-08-17T02:13:14.790 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-modules-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:13:15.549 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:13:15.984 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:13:16.704 INFO:teuthology.orchestra.run.smithi174.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-192-generic 2024-08-17T02:13:16.705 INFO:teuthology.orchestra.run.smithi174.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-192-generic 2024-08-17T02:13:16.825 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up linux-headers-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:13:16.935 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up linux-modules-extra-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:13:17.117 INFO:teuthology.orchestra.run.smithi153.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-192-generic 2024-08-17T02:13:17.117 INFO:teuthology.orchestra.run.smithi153.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-192-generic 2024-08-17T02:13:17.244 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-headers-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:13:17.370 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-modules-extra-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:13:18.136 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up linux-image-generic (5.4.0.192.190) ... 2024-08-17T02:13:18.271 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up linux-headers-generic (5.4.0.192.190) ... 2024-08-17T02:13:18.422 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up linux-generic (5.4.0.192.190) ... 2024-08-17T02:13:18.548 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:13:18.555 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-image-generic (5.4.0.192.190) ... 2024-08-17T02:13:18.613 INFO:teuthology.orchestra.run.smithi174.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-08-17T02:13:18.613 INFO:teuthology.orchestra.run.smithi174.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-192-generic 2024-08-17T02:13:18.681 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-headers-generic (5.4.0.192.190) ... 2024-08-17T02:13:18.982 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-generic (5.4.0.192.190) ... 2024-08-17T02:13:20.017 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:13:20.083 INFO:teuthology.orchestra.run.smithi153.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-08-17T02:13:20.084 INFO:teuthology.orchestra.run.smithi153.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-192-generic 2024-08-17T02:13:40.935 INFO:teuthology.orchestra.run.smithi174.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-08-17T02:13:40.935 INFO:teuthology.orchestra.run.smithi174.stdout:Sourcing file `/etc/default/grub' 2024-08-17T02:13:40.945 INFO:teuthology.orchestra.run.smithi174.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-17T02:13:40.960 INFO:teuthology.orchestra.run.smithi174.stdout:Generating grub configuration file ... 2024-08-17T02:13:41.290 INFO:teuthology.orchestra.run.smithi174.stdout:Found linux image: /boot/vmlinuz-5.4.0-192-generic 2024-08-17T02:13:41.323 INFO:teuthology.orchestra.run.smithi174.stdout:Found initrd image: /boot/initrd.img-5.4.0-192-generic 2024-08-17T02:13:41.713 INFO:teuthology.orchestra.run.smithi174.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-08-17T02:13:41.724 INFO:teuthology.orchestra.run.smithi174.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-08-17T02:13:42.405 INFO:teuthology.orchestra.run.smithi153.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-08-17T02:13:42.405 INFO:teuthology.orchestra.run.smithi153.stdout:Sourcing file `/etc/default/grub' 2024-08-17T02:13:42.420 INFO:teuthology.orchestra.run.smithi153.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-17T02:13:42.443 INFO:teuthology.orchestra.run.smithi153.stdout:Generating grub configuration file ... 2024-08-17T02:13:42.740 INFO:teuthology.orchestra.run.smithi153.stdout:Found linux image: /boot/vmlinuz-5.4.0-192-generic 2024-08-17T02:13:42.760 INFO:teuthology.orchestra.run.smithi153.stdout:Found initrd image: /boot/initrd.img-5.4.0-192-generic 2024-08-17T02:13:43.139 INFO:teuthology.orchestra.run.smithi153.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-08-17T02:13:43.151 INFO:teuthology.orchestra.run.smithi153.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-08-17T02:13:43.780 INFO:teuthology.orchestra.run.smithi174.stdout:done 2024-08-17T02:13:44.245 DEBUG:teuthology.orchestra.run.smithi174:> dpkg -s linux-image-generic 2024-08-17T02:13:44.287 INFO:teuthology.orchestra.run.smithi174.stdout:Package: linux-image-generic 2024-08-17T02:13:44.287 INFO:teuthology.orchestra.run.smithi174.stdout:Status: install ok installed 2024-08-17T02:13:44.287 INFO:teuthology.orchestra.run.smithi174.stdout:Priority: optional 2024-08-17T02:13:44.287 INFO:teuthology.orchestra.run.smithi174.stdout:Section: kernel 2024-08-17T02:13:44.287 INFO:teuthology.orchestra.run.smithi174.stdout:Installed-Size: 20 2024-08-17T02:13:44.287 INFO:teuthology.orchestra.run.smithi174.stdout:Maintainer: Ubuntu Kernel Team 2024-08-17T02:13:44.287 INFO:teuthology.orchestra.run.smithi174.stdout:Architecture: amd64 2024-08-17T02:13:44.287 INFO:teuthology.orchestra.run.smithi174.stdout:Source: linux-meta 2024-08-17T02:13:44.288 INFO:teuthology.orchestra.run.smithi174.stdout:Version: 5.4.0.192.190 2024-08-17T02:13:44.288 INFO:teuthology.orchestra.run.smithi174.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-08-17T02:13:44.288 INFO:teuthology.orchestra.run.smithi174.stdout:Depends: linux-image-5.4.0-192-generic, linux-modules-extra-5.4.0-192-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-17T02:13:44.288 INFO:teuthology.orchestra.run.smithi174.stdout:Recommends: thermald 2024-08-17T02:13:44.288 INFO:teuthology.orchestra.run.smithi174.stdout:Description: Generic Linux kernel image 2024-08-17T02:13:44.288 INFO:teuthology.orchestra.run.smithi174.stdout: This package will always depend on the latest generic kernel image 2024-08-17T02:13:44.288 INFO:teuthology.orchestra.run.smithi174.stdout: available. 2024-08-17T02:13:44.289 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-192-generic 2024-08-17T02:13:44.289 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-08-17T02:13:44.289 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-08-17T02:13:44.289 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-08-17T02:13:44.289 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi174.front.sepia.ceph.com, path=None, version=distro) 2024-08-17T02:13:44.289 DEBUG:teuthology.orchestra.run.smithi174:> sudo apt-get clean 2024-08-17T02:13:44.365 DEBUG:teuthology.orchestra.run.smithi174:> sudo apt-get update 2024-08-17T02:13:44.498 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-17T02:13:44.504 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-08-17T02:13:44.521 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-08-17T02:13:44.615 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-08-17T02:13:45.115 INFO:teuthology.orchestra.run.smithi153.stdout:done 2024-08-17T02:13:45.540 DEBUG:teuthology.orchestra.run.smithi153:> dpkg -s linux-image-generic 2024-08-17T02:13:45.583 INFO:teuthology.orchestra.run.smithi153.stdout:Package: linux-image-generic 2024-08-17T02:13:45.583 INFO:teuthology.orchestra.run.smithi153.stdout:Status: install ok installed 2024-08-17T02:13:45.584 INFO:teuthology.orchestra.run.smithi153.stdout:Priority: optional 2024-08-17T02:13:45.584 INFO:teuthology.orchestra.run.smithi153.stdout:Section: kernel 2024-08-17T02:13:45.584 INFO:teuthology.orchestra.run.smithi153.stdout:Installed-Size: 20 2024-08-17T02:13:45.584 INFO:teuthology.orchestra.run.smithi153.stdout:Maintainer: Ubuntu Kernel Team 2024-08-17T02:13:45.584 INFO:teuthology.orchestra.run.smithi153.stdout:Architecture: amd64 2024-08-17T02:13:45.585 INFO:teuthology.orchestra.run.smithi153.stdout:Source: linux-meta 2024-08-17T02:13:45.585 INFO:teuthology.orchestra.run.smithi153.stdout:Version: 5.4.0.192.190 2024-08-17T02:13:45.585 INFO:teuthology.orchestra.run.smithi153.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-08-17T02:13:45.585 INFO:teuthology.orchestra.run.smithi153.stdout:Depends: linux-image-5.4.0-192-generic, linux-modules-extra-5.4.0-192-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-17T02:13:45.585 INFO:teuthology.orchestra.run.smithi153.stdout:Recommends: thermald 2024-08-17T02:13:45.585 INFO:teuthology.orchestra.run.smithi153.stdout:Description: Generic Linux kernel image 2024-08-17T02:13:45.585 INFO:teuthology.orchestra.run.smithi153.stdout: This package will always depend on the latest generic kernel image 2024-08-17T02:13:45.585 INFO:teuthology.orchestra.run.smithi153.stdout: available. 2024-08-17T02:13:45.585 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-192-generic 2024-08-17T02:13:45.586 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-08-17T02:13:45.586 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-08-17T02:13:45.586 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-08-17T02:13:45.586 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi153.front.sepia.ceph.com, path=None, version=distro) 2024-08-17T02:13:45.586 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get clean 2024-08-17T02:13:45.663 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get update 2024-08-17T02:13:45.925 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-17T02:13:45.925 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-08-17T02:13:45.995 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-08-17T02:13:46.084 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-08-17T02:13:46.334 INFO:teuthology.orchestra.run.smithi174.stdout:Reading package lists... 2024-08-17T02:13:46.360 DEBUG:teuthology.orchestra.run.smithi174:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-17T02:13:46.434 INFO:teuthology.orchestra.run.smithi174.stdout:Reading package lists... 2024-08-17T02:13:46.646 INFO:teuthology.orchestra.run.smithi174.stdout:Building dependency tree... 2024-08-17T02:13:46.647 INFO:teuthology.orchestra.run.smithi174.stdout:Reading state information... 2024-08-17T02:13:46.873 INFO:teuthology.orchestra.run.smithi174.stdout:linux-image-generic is already the newest version (5.4.0.192.190). 2024-08-17T02:13:46.873 INFO:teuthology.orchestra.run.smithi174.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-08-17T02:13:46.875 DEBUG:teuthology.orchestra.run.smithi174:> dpkg -s linux-image-generic 2024-08-17T02:13:46.896 INFO:teuthology.orchestra.run.smithi174.stdout:Package: linux-image-generic 2024-08-17T02:13:46.896 INFO:teuthology.orchestra.run.smithi174.stdout:Status: install ok installed 2024-08-17T02:13:46.896 INFO:teuthology.orchestra.run.smithi174.stdout:Priority: optional 2024-08-17T02:13:46.896 INFO:teuthology.orchestra.run.smithi174.stdout:Section: kernel 2024-08-17T02:13:46.897 INFO:teuthology.orchestra.run.smithi174.stdout:Installed-Size: 20 2024-08-17T02:13:46.897 INFO:teuthology.orchestra.run.smithi174.stdout:Maintainer: Ubuntu Kernel Team 2024-08-17T02:13:46.897 INFO:teuthology.orchestra.run.smithi174.stdout:Architecture: amd64 2024-08-17T02:13:46.897 INFO:teuthology.orchestra.run.smithi174.stdout:Source: linux-meta 2024-08-17T02:13:46.897 INFO:teuthology.orchestra.run.smithi174.stdout:Version: 5.4.0.192.190 2024-08-17T02:13:46.897 INFO:teuthology.orchestra.run.smithi174.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-08-17T02:13:46.897 INFO:teuthology.orchestra.run.smithi174.stdout:Depends: linux-image-5.4.0-192-generic, linux-modules-extra-5.4.0-192-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-17T02:13:46.897 INFO:teuthology.orchestra.run.smithi174.stdout:Recommends: thermald 2024-08-17T02:13:46.897 INFO:teuthology.orchestra.run.smithi174.stdout:Description: Generic Linux kernel image 2024-08-17T02:13:46.897 INFO:teuthology.orchestra.run.smithi174.stdout: This package will always depend on the latest generic kernel image 2024-08-17T02:13:46.897 INFO:teuthology.orchestra.run.smithi174.stdout: available. 2024-08-17T02:13:46.897 DEBUG:teuthology.orchestra.run.smithi174:> mktemp 2024-08-17T02:13:46.902 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.Vscm9tme7L 2024-08-17T02:13:46.902 DEBUG:teuthology.orchestra.run.smithi174:> sudo cp /boot/grub/grub.cfg /tmp/tmp.Vscm9tme7L 2024-08-17T02:13:46.913 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.Vscm9tme7L 2024-08-17T02:13:46.993 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.Vscm9tme7L is 9KB 2024-08-17T02:13:47.009 DEBUG:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.Vscm9tme7L 2024-08-17T02:13:47.016 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-08-17T02:13:47.072 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-08-17T02:13:47.072 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-08-17T02:13:47.072 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-08-17T02:13:47.099 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-192-generic 2024-08-17T02:13:47.099 DEBUG:teuthology.orchestra.run.smithi174:> sudo update-grub 2024-08-17T02:13:47.770 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-08-17T02:13:47.795 DEBUG:teuthology.orchestra.run.smithi153:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-17T02:13:47.864 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-08-17T02:13:48.081 INFO:teuthology.orchestra.run.smithi153.stdout:Building dependency tree... 2024-08-17T02:13:48.082 INFO:teuthology.orchestra.run.smithi153.stdout:Reading state information... 2024-08-17T02:13:48.315 INFO:teuthology.orchestra.run.smithi153.stdout:linux-image-generic is already the newest version (5.4.0.192.190). 2024-08-17T02:13:48.315 INFO:teuthology.orchestra.run.smithi153.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-08-17T02:13:48.317 DEBUG:teuthology.orchestra.run.smithi153:> dpkg -s linux-image-generic 2024-08-17T02:13:48.339 INFO:teuthology.orchestra.run.smithi153.stdout:Package: linux-image-generic 2024-08-17T02:13:48.339 INFO:teuthology.orchestra.run.smithi153.stdout:Status: install ok installed 2024-08-17T02:13:48.339 INFO:teuthology.orchestra.run.smithi153.stdout:Priority: optional 2024-08-17T02:13:48.340 INFO:teuthology.orchestra.run.smithi153.stdout:Section: kernel 2024-08-17T02:13:48.340 INFO:teuthology.orchestra.run.smithi153.stdout:Installed-Size: 20 2024-08-17T02:13:48.340 INFO:teuthology.orchestra.run.smithi153.stdout:Maintainer: Ubuntu Kernel Team 2024-08-17T02:13:48.340 INFO:teuthology.orchestra.run.smithi153.stdout:Architecture: amd64 2024-08-17T02:13:48.340 INFO:teuthology.orchestra.run.smithi153.stdout:Source: linux-meta 2024-08-17T02:13:48.340 INFO:teuthology.orchestra.run.smithi153.stdout:Version: 5.4.0.192.190 2024-08-17T02:13:48.340 INFO:teuthology.orchestra.run.smithi153.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-08-17T02:13:48.340 INFO:teuthology.orchestra.run.smithi153.stdout:Depends: linux-image-5.4.0-192-generic, linux-modules-extra-5.4.0-192-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-17T02:13:48.340 INFO:teuthology.orchestra.run.smithi153.stdout:Recommends: thermald 2024-08-17T02:13:48.340 INFO:teuthology.orchestra.run.smithi153.stdout:Description: Generic Linux kernel image 2024-08-17T02:13:48.341 INFO:teuthology.orchestra.run.smithi153.stdout: This package will always depend on the latest generic kernel image 2024-08-17T02:13:48.341 INFO:teuthology.orchestra.run.smithi153.stdout: available. 2024-08-17T02:13:48.341 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2024-08-17T02:13:48.346 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.Liv5iAOASw 2024-08-17T02:13:48.346 DEBUG:teuthology.orchestra.run.smithi153:> sudo cp /boot/grub/grub.cfg /tmp/tmp.Liv5iAOASw 2024-08-17T02:13:48.360 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.Liv5iAOASw 2024-08-17T02:13:48.438 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.Liv5iAOASw is 9KB 2024-08-17T02:13:48.448 INFO:teuthology.orchestra.run.smithi174.stderr:Sourcing file `/etc/default/grub' 2024-08-17T02:13:48.453 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.Liv5iAOASw 2024-08-17T02:13:48.459 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-08-17T02:13:48.460 INFO:teuthology.orchestra.run.smithi174.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-17T02:13:48.476 INFO:teuthology.orchestra.run.smithi174.stderr:Generating grub configuration file ... 2024-08-17T02:13:48.515 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-08-17T02:13:48.515 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-08-17T02:13:48.515 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-08-17T02:13:48.552 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-192-generic 2024-08-17T02:13:48.552 DEBUG:teuthology.orchestra.run.smithi153:> sudo update-grub 2024-08-17T02:13:48.719 INFO:teuthology.orchestra.run.smithi174.stderr:Found linux image: /boot/vmlinuz-5.4.0-192-generic 2024-08-17T02:13:48.730 INFO:teuthology.orchestra.run.smithi174.stderr:Found initrd image: /boot/initrd.img-5.4.0-192-generic 2024-08-17T02:13:49.113 INFO:teuthology.orchestra.run.smithi174.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-08-17T02:13:49.125 INFO:teuthology.orchestra.run.smithi174.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-08-17T02:13:49.851 INFO:teuthology.orchestra.run.smithi153.stderr:Sourcing file `/etc/default/grub' 2024-08-17T02:13:49.860 INFO:teuthology.orchestra.run.smithi153.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-17T02:13:49.871 INFO:teuthology.orchestra.run.smithi153.stderr:Generating grub configuration file ... 2024-08-17T02:13:50.105 INFO:teuthology.orchestra.run.smithi153.stderr:Found linux image: /boot/vmlinuz-5.4.0-192-generic 2024-08-17T02:13:50.115 INFO:teuthology.orchestra.run.smithi153.stderr:Found initrd image: /boot/initrd.img-5.4.0-192-generic 2024-08-17T02:13:50.136 INFO:teuthology.orchestra.run.smithi174.stderr:done 2024-08-17T02:13:50.138 DEBUG:teuthology.orchestra.run.smithi174:> sudo shutdown -r now 2024-08-17T02:13:50.449 INFO:teuthology.orchestra.run.smithi153.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-08-17T02:13:50.460 INFO:teuthology.orchestra.run.smithi153.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-08-17T02:13:51.450 INFO:teuthology.orchestra.run.smithi153.stderr:done 2024-08-17T02:13:51.452 DEBUG:teuthology.orchestra.run.smithi153:> sudo shutdown -r now 2024-08-17T02:14:20.166 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-08-17T02:14:20.167 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-08-17T02:14:20.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:14:21.456 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-08-17T02:14:21.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-08-17T02:14:21.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:14:38.559 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.174 2024-08-17T02:14:39.842 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-08-17T02:14:47.566 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-08-17T02:14:47.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:14:48.844 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-08-17T02:14:48.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:14:50.626 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.174 2024-08-17T02:14:51.902 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-08-17T02:15:02.634 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-08-17T02:15:02.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:15:03.904 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-08-17T02:15:03.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:15:34.500 DEBUG:teuthology.orchestra.run.smithi174:> true 2024-08-17T02:15:35.763 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-08-17T02:15:35.763 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-192-generic"... 2024-08-17T02:15:35.763 DEBUG:teuthology.orchestra.run.smithi174:> uname -r 2024-08-17T02:15:35.770 INFO:teuthology.orchestra.run.smithi174.stdout:5.4.0-192-generic 2024-08-17T02:15:35.770 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-192-generic vs 5.4.0-192-generic 2024-08-17T02:15:35.770 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:15:35.770 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-08-17T02:15:36.772 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-08-17T02:15:36.772 DEBUG:teuthology.orchestra.run.smithi174:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-17T02:15:36.878 INFO:teuthology.orchestra.run.smithi174.stdout:ttyS1 2024-08-17T02:15:36.908 DEBUG:teuthology.parallel:result is None 2024-08-17T02:16:03.907 DEBUG:teuthology.orchestra.remote:timed out 2024-08-17T02:16:18.909 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-08-17T02:16:18.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:16:19.160 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-08-17T02:16:19.725 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-08-17T02:16:19.725 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-192-generic"... 2024-08-17T02:16:19.725 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2024-08-17T02:16:19.732 INFO:teuthology.orchestra.run.smithi153.stdout:5.4.0-192-generic 2024-08-17T02:16:19.732 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-192-generic vs 5.4.0-192-generic 2024-08-17T02:16:19.732 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:16:19.732 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-08-17T02:16:20.733 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-08-17T02:16:20.734 DEBUG:teuthology.orchestra.run.smithi153:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-17T02:16:20.821 INFO:teuthology.orchestra.run.smithi153.stdout:ttyS1 2024-08-17T02:16:20.849 DEBUG:teuthology.parallel:result is None 2024-08-17T02:16:20.849 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-17T02:16:20.856 INFO:teuthology.task.internal:Creating test directory... 2024-08-17T02:16:20.857 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:16:20.860 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:16:20.868 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-17T02:16:20.878 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-17T02:16:20.885 INFO:teuthology.task.internal:Creating archive directory... 2024-08-17T02:16:20.885 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:16:20.907 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:16:20.931 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-17T02:16:20.938 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-17T02:16:20.938 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:16:20.941 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:16:20.956 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:16:20.967 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:16:20.991 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:16:21.001 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:16:21.003 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-17T02:16:21.010 INFO:teuthology.task.internal:Configuring sudo... 2024-08-17T02:16:21.010 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:16:21.013 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:16:21.027 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-17T02:16:21.039 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-17T02:16:21.039 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:16:21.042 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:16:21.072 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:16:21.096 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:16:21.103 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-08-17T02:16:21.103 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:16:21.143 DEBUG:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:16:21.151 DEBUG:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:16:21.200 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-08-17T02:16:21.201 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:16:21.231 DEBUG:teuthology.orchestra.run.smithi153:> sudo service rsyslog restart 2024-08-17T02:16:21.234 DEBUG:teuthology.orchestra.run.smithi174:> sudo service rsyslog restart 2024-08-17T02:16:21.287 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-17T02:16:21.295 INFO:teuthology.task.internal:Starting timer... 2024-08-17T02:16:21.295 INFO:teuthology.run_tasks:Running task pcp... 2024-08-17T02:16:21.309 INFO:teuthology.run_tasks:Running task selinux... 2024-08-17T02:16:21.319 DEBUG:teuthology.task.selinux:Excluding smithi153: OS 'ubuntu' does not support SELinux 2024-08-17T02:16:21.319 DEBUG:teuthology.task.selinux:Excluding smithi174: OS 'ubuntu' does not support SELinux 2024-08-17T02:16:21.320 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-17T02:16:21.320 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-08-17T02:16:21.320 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-17T02:16:21.320 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-17T02:16:21.328 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-17T02:16:21.344 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-17T02:16:21.364 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi153.front.sepia.ceph.com,smithi174.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-17T02:22:01.080 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi153.front.sepia.ceph.com'), Remote(name='ubuntu@smithi174.front.sepia.ceph.com')] 2024-08-17T02:22:01.082 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-08-17T02:22:01.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:22:01.173 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-08-17T02:22:01.299 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-08-17T02:22:01.299 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-08-17T02:22:01.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:22:01.398 DEBUG:teuthology.orchestra.run.smithi174:> true 2024-08-17T02:22:01.524 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-08-17T02:22:01.524 INFO:teuthology.run_tasks:Running task clock... 2024-08-17T02:22:01.536 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-17T02:22:01.537 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:22:01.538 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:22:01.540 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:22:01.540 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:22:01.571 INFO:teuthology.orchestra.run.smithi153.stdout:17 Aug 02:22:01 ntpd[13648]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-08-17T02:22:01.571 INFO:teuthology.orchestra.run.smithi153.stdout:17 Aug 02:22:01 ntpd[13648]: Command line: ntpd -gq 2024-08-17T02:22:01.572 INFO:teuthology.orchestra.run.smithi153.stdout:17 Aug 02:22:01 ntpd[13648]: proto: precision = 0.151 usec (-23) 2024-08-17T02:22:01.573 INFO:teuthology.orchestra.run.smithi153.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-17T02:22:01.573 INFO:teuthology.orchestra.run.smithi153.stdout:17 Aug 02:22:01 ntpd[13648]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-17T02:22:01.573 INFO:teuthology.orchestra.run.smithi153.stdout:17 Aug 02:22:01 ntpd[13648]: restrict ::: KOD does nothing without LIMITED. 2024-08-17T02:22:01.574 INFO:teuthology.orchestra.run.smithi153.stderr:restrict ::: KOD does nothing without LIMITED. 2024-08-17T02:22:01.574 INFO:teuthology.orchestra.run.smithi153.stdout:17 Aug 02:22:01 ntpd[13648]: Listen and drop on 0 v6wildcard [::]:123 2024-08-17T02:22:01.575 INFO:teuthology.orchestra.run.smithi153.stdout:17 Aug 02:22:01 ntpd[13648]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-08-17T02:22:01.575 INFO:teuthology.orchestra.run.smithi153.stdout:17 Aug 02:22:01 ntpd[13648]: Listen normally on 2 lo 127.0.0.1:123 2024-08-17T02:22:01.575 INFO:teuthology.orchestra.run.smithi153.stdout:17 Aug 02:22:01 ntpd[13648]: Listen normally on 3 enp3s0f1 172.21.15.153:123 2024-08-17T02:22:01.575 INFO:teuthology.orchestra.run.smithi153.stdout:17 Aug 02:22:01 ntpd[13648]: Listen normally on 4 lo [::1]:123 2024-08-17T02:22:01.575 INFO:teuthology.orchestra.run.smithi153.stdout:17 Aug 02:22:01 ntpd[13648]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6deb%5]:123 2024-08-17T02:22:01.575 INFO:teuthology.orchestra.run.smithi153.stdout:17 Aug 02:22:01 ntpd[13648]: Listening on routing socket on fd #22 for interface updates 2024-08-17T02:22:01.575 INFO:teuthology.orchestra.run.smithi174.stdout:17 Aug 02:22:01 ntpd[13652]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-08-17T02:22:01.576 INFO:teuthology.orchestra.run.smithi174.stdout:17 Aug 02:22:01 ntpd[13652]: Command line: ntpd -gq 2024-08-17T02:22:01.576 INFO:teuthology.orchestra.run.smithi174.stdout:17 Aug 02:22:01 ntpd[13652]: proto: precision = 0.078 usec (-24) 2024-08-17T02:22:01.576 INFO:teuthology.orchestra.run.smithi174.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-17T02:22:01.576 INFO:teuthology.orchestra.run.smithi174.stdout:17 Aug 02:22:01 ntpd[13652]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-17T02:22:01.576 INFO:teuthology.orchestra.run.smithi174.stderr:restrict ::: KOD does nothing without LIMITED. 2024-08-17T02:22:01.577 INFO:teuthology.orchestra.run.smithi174.stdout:17 Aug 02:22:01 ntpd[13652]: restrict ::: KOD does nothing without LIMITED. 2024-08-17T02:22:01.578 INFO:teuthology.orchestra.run.smithi174.stdout:17 Aug 02:22:01 ntpd[13652]: Listen and drop on 0 v6wildcard [::]:123 2024-08-17T02:22:01.578 INFO:teuthology.orchestra.run.smithi174.stdout:17 Aug 02:22:01 ntpd[13652]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-08-17T02:22:01.578 INFO:teuthology.orchestra.run.smithi174.stdout:17 Aug 02:22:01 ntpd[13652]: Listen normally on 2 lo 127.0.0.1:123 2024-08-17T02:22:01.578 INFO:teuthology.orchestra.run.smithi174.stdout:17 Aug 02:22:01 ntpd[13652]: Listen normally on 3 enp3s0f1 172.21.15.174:123 2024-08-17T02:22:01.578 INFO:teuthology.orchestra.run.smithi174.stdout:17 Aug 02:22:01 ntpd[13652]: Listen normally on 4 lo [::1]:123 2024-08-17T02:22:01.578 INFO:teuthology.orchestra.run.smithi174.stdout:17 Aug 02:22:01 ntpd[13652]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:771b%5]:123 2024-08-17T02:22:01.578 INFO:teuthology.orchestra.run.smithi174.stdout:17 Aug 02:22:01 ntpd[13652]: Listening on routing socket on fd #22 for interface updates 2024-08-17T02:22:02.575 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:02 ntpd[13652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:02.576 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:02 ntpd[13652]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:02.576 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:02 ntpd[13652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:02.576 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:02 ntpd[13652]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:02.576 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:02 ntpd[13652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:02.576 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:02 ntpd[13652]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:02.576 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:02 ntpd[13652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:02.576 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:02 ntpd[13652]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:02.576 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:02 ntpd[13652]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:02.576 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:02 ntpd[13652]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:02.576 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:02 ntpd[13652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:02.576 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:02 ntpd[13652]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:02.576 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:02 ntpd[13652]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:02.577 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:02 ntpd[13652]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:03.573 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:03 ntpd[13648]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:03.573 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:03 ntpd[13648]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:03.573 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:03 ntpd[13648]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:03.573 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:03 ntpd[13648]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:03.573 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:03 ntpd[13648]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:03.573 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:03 ntpd[13648]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:03.575 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:03 ntpd[13652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:03.575 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:03 ntpd[13652]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:03.575 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:03 ntpd[13652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:03.575 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:03 ntpd[13652]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:03.575 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:03 ntpd[13652]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:03.575 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:03 ntpd[13652]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:04.575 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:04 ntpd[13652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:04.576 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:04 ntpd[13652]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:04.576 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:04 ntpd[13652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:04.576 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:04 ntpd[13652]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:04.576 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:04 ntpd[13652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:04.576 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:04 ntpd[13652]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:04.576 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:04 ntpd[13652]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:04.576 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:04 ntpd[13652]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:04.576 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:04 ntpd[13652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:04.576 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:04 ntpd[13652]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:04.576 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:04 ntpd[13652]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:04.576 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:04 ntpd[13652]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:05.573 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:05 ntpd[13648]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:05.573 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:05 ntpd[13648]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:05.573 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:05 ntpd[13648]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:05.573 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:05 ntpd[13648]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:05.573 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:05 ntpd[13648]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:05.573 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:05 ntpd[13648]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:05.574 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:05 ntpd[13648]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:05.574 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:05 ntpd[13648]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:05.574 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:05 ntpd[13648]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:05.574 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:05 ntpd[13648]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:05.574 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:05 ntpd[13648]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:05.574 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:05 ntpd[13648]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:05.575 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:05 ntpd[13652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:05.575 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:05 ntpd[13652]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:05.575 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:05 ntpd[13652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:05.575 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:05 ntpd[13652]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:05.575 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:05 ntpd[13652]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:05.575 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:05 ntpd[13652]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:06.573 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:06 ntpd[13648]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:06.573 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:06 ntpd[13648]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:06.573 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:06 ntpd[13648]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:06.573 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:06 ntpd[13648]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:06.573 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:06 ntpd[13648]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:06.573 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:06 ntpd[13648]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:06.574 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:06 ntpd[13648]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:06.574 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:06 ntpd[13648]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:06.575 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:06 ntpd[13652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:06.575 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:06 ntpd[13652]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:06.575 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:06 ntpd[13652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:06.576 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:06 ntpd[13652]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:06.576 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:06 ntpd[13652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:06.576 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:06 ntpd[13652]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:06.576 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:06 ntpd[13652]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:06.576 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:06 ntpd[13652]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:06.576 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:06 ntpd[13652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:06.576 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:06 ntpd[13652]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:06.576 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:06 ntpd[13652]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:06.576 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:06 ntpd[13652]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:07.573 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:07 ntpd[13648]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:07.573 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:07 ntpd[13648]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:07.573 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:07 ntpd[13648]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:07.574 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:07 ntpd[13648]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:07.574 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:07 ntpd[13648]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:07.574 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:07 ntpd[13648]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:07.574 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:07 ntpd[13648]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:07.574 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:07 ntpd[13648]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:07.574 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:07 ntpd[13648]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:07.574 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:07 ntpd[13648]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:07.574 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:07 ntpd[13648]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:07.574 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:07 ntpd[13648]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:07.575 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:07 ntpd[13652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:07.575 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:07 ntpd[13652]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:07.575 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:07 ntpd[13652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:07.575 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:07 ntpd[13652]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:07.576 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:07 ntpd[13652]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:07.576 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:07 ntpd[13652]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:08.572 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:08 ntpd[13648]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:08.573 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:08 ntpd[13648]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:08.573 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:08 ntpd[13648]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:08.573 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:08 ntpd[13648]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:08.573 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:08 ntpd[13648]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:08.573 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:08 ntpd[13648]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:08.575 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:08 ntpd[13652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:08.575 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:08 ntpd[13652]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:08.575 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:08 ntpd[13652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:08.575 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:08 ntpd[13652]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:08.575 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:08 ntpd[13652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:08.575 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:08 ntpd[13652]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:08.575 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:08 ntpd[13652]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:08.575 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:08 ntpd[13652]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:08.576 INFO:teuthology.orchestra.run.smithi174.stdout:17 Aug 02:22:08 ntpd[13652]: ntpd: time slew +0.002308 s 2024-08-17T02:22:08.576 INFO:teuthology.orchestra.run.smithi174.stdout:ntpd: time slew +0.002308s 2024-08-17T02:22:08.576 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:08 ntpd[13652]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-08-17T02:22:08.576 INFO:teuthology.orchestra.run.smithi174.stderr:17 Aug 02:22:08 ntpd[13652]: can't open /var/log/ntpstats/loopstats.20240817: Permission denied 2024-08-17T02:22:08.647 INFO:teuthology.orchestra.run.smithi174.stdout: remote refid st t when poll reach delay offset jitter 2024-08-17T02:22:08.647 INFO:teuthology.orchestra.run.smithi174.stdout:============================================================================== 2024-08-17T02:22:08.647 INFO:teuthology.orchestra.run.smithi174.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:22:08.648 INFO:teuthology.orchestra.run.smithi174.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:22:08.648 INFO:teuthology.orchestra.run.smithi174.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:22:08.648 INFO:teuthology.orchestra.run.smithi174.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:22:09.573 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:09 ntpd[13648]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:09.573 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:09 ntpd[13648]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:09.574 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:09 ntpd[13648]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:09.574 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:09 ntpd[13648]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:09.574 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:09 ntpd[13648]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:09.574 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:09 ntpd[13648]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:09.574 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:09 ntpd[13648]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:09.574 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:09 ntpd[13648]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:09.574 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:09 ntpd[13648]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:09.574 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:09 ntpd[13648]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:09.574 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:09 ntpd[13648]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:09.574 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:09 ntpd[13648]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:09.575 INFO:teuthology.orchestra.run.smithi153.stdout:17 Aug 02:22:09 ntpd[13648]: ntpd: time slew +0.001289 s 2024-08-17T02:22:09.575 INFO:teuthology.orchestra.run.smithi153.stdout:ntpd: time slew +0.001289s 2024-08-17T02:22:09.575 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:09 ntpd[13648]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-08-17T02:22:09.575 INFO:teuthology.orchestra.run.smithi153.stderr:17 Aug 02:22:09 ntpd[13648]: can't open /var/log/ntpstats/loopstats.20240817: Permission denied 2024-08-17T02:22:09.632 INFO:teuthology.orchestra.run.smithi153.stdout: remote refid st t when poll reach delay offset jitter 2024-08-17T02:22:09.632 INFO:teuthology.orchestra.run.smithi153.stdout:============================================================================== 2024-08-17T02:22:09.633 INFO:teuthology.orchestra.run.smithi153.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:22:09.633 INFO:teuthology.orchestra.run.smithi153.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:22:09.633 INFO:teuthology.orchestra.run.smithi153.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:22:09.633 INFO:teuthology.orchestra.run.smithi153.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:22:09.634 INFO:teuthology.run_tasks:Running task install... 2024-08-17T02:22:09.642 DEBUG:teuthology.task.install:project ceph 2024-08-17T02:22:09.642 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}} 2024-08-17T02:22:09.642 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'} 2024-08-17T02:22:09.642 INFO:teuthology.task.install:Using flavor: default 2024-08-17T02:22:09.650 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-17T02:22:09.651 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-08-17T02:22:09.651 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-key list | grep Ceph 2024-08-17T02:22:09.652 DEBUG:teuthology.orchestra.run.smithi174:> sudo apt-key list | grep Ceph 2024-08-17T02:22:09.749 INFO:teuthology.orchestra.run.smithi174.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-08-17T02:22:09.772 INFO:teuthology.orchestra.run.smithi153.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-08-17T02:22:09.814 INFO:teuthology.orchestra.run.smithi174.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-08-17T02:22:09.814 INFO:teuthology.orchestra.run.smithi174.stdout:uid [ unknown] Ceph.com (release key) 2024-08-17T02:22:09.815 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-08-17T02:22:09.815 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-08-17T02:22:09.816 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:22:09.832 INFO:teuthology.orchestra.run.smithi153.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-08-17T02:22:09.832 INFO:teuthology.orchestra.run.smithi153.stdout:uid [ unknown] Ceph.com (release key) 2024-08-17T02:22:09.833 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-08-17T02:22:09.834 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-08-17T02:22:09.834 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:22:09.965 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default/ 2024-08-17T02:22:09.965 INFO:teuthology.task.install.deb:Package version is 17.2.7-1375-g2577e813-1focal 2024-08-17T02:22:09.980 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default/ 2024-08-17T02:22:09.980 INFO:teuthology.task.install.deb:Package version is 17.2.7-1375-g2577e813-1focal 2024-08-17T02:22:10.303 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-08-17T02:22:10.303 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-08-17T02:22:10.317 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-08-17T02:22:10.317 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-08-17T02:22:10.322 DEBUG:teuthology.orchestra.run.smithi174:> sudo apt-get update 2024-08-17T02:22:10.369 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get update 2024-08-17T02:22:10.590 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-17T02:22:10.590 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-08-17T02:22:10.642 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-17T02:22:10.642 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-08-17T02:22:10.660 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-08-17T02:22:10.673 INFO:teuthology.orchestra.run.smithi174.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal InRelease 2024-08-17T02:22:10.711 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-08-17T02:22:10.728 INFO:teuthology.orchestra.run.smithi153.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal InRelease 2024-08-17T02:22:10.737 INFO:teuthology.orchestra.run.smithi174.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-08-17T02:22:10.747 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-08-17T02:22:10.790 INFO:teuthology.orchestra.run.smithi153.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-08-17T02:22:10.793 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-08-17T02:22:10.811 INFO:teuthology.orchestra.run.smithi174.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal Release.gpg 2024-08-17T02:22:10.855 INFO:teuthology.orchestra.run.smithi153.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal Release.gpg 2024-08-17T02:22:10.873 INFO:teuthology.orchestra.run.smithi174.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main i386 Packages [3,382 B] 2024-08-17T02:22:10.918 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main i386 Packages [3,382 B] 2024-08-17T02:22:10.955 INFO:teuthology.orchestra.run.smithi174.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2024-08-17T02:22:10.999 INFO:teuthology.orchestra.run.smithi153.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2024-08-17T02:22:11.254 INFO:teuthology.orchestra.run.smithi174.stdout:Fetched 28.5 kB in 1s (36.8 kB/s) 2024-08-17T02:22:11.304 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 28.5 kB in 1s (36.8 kB/s) 2024-08-17T02:22:12.398 INFO:teuthology.orchestra.run.smithi174.stdout:Reading package lists... 2024-08-17T02:22:12.422 DEBUG:teuthology.orchestra.run.smithi174:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.7-1375-g2577e813-1focal cephadm=17.2.7-1375-g2577e813-1focal ceph-mds=17.2.7-1375-g2577e813-1focal ceph-mgr=17.2.7-1375-g2577e813-1focal ceph-common=17.2.7-1375-g2577e813-1focal ceph-fuse=17.2.7-1375-g2577e813-1focal ceph-test=17.2.7-1375-g2577e813-1focal ceph-volume=17.2.7-1375-g2577e813-1focal radosgw=17.2.7-1375-g2577e813-1focal python3-rados=17.2.7-1375-g2577e813-1focal python3-rgw=17.2.7-1375-g2577e813-1focal python3-cephfs=17.2.7-1375-g2577e813-1focal python3-rbd=17.2.7-1375-g2577e813-1focal libcephfs2=17.2.7-1375-g2577e813-1focal libcephfs-dev=17.2.7-1375-g2577e813-1focal librados2=17.2.7-1375-g2577e813-1focal librbd1=17.2.7-1375-g2577e813-1focal rbd-fuse=17.2.7-1375-g2577e813-1focal python3-cephfs=17.2.7-1375-g2577e813-1focal cephfs-shell=17.2.7-1375-g2577e813-1focal cephfs-top=17.2.7-1375-g2577e813-1focal cephfs-mirror=17.2.7-1375-g2577e813-1focal 2024-08-17T02:22:12.456 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-08-17T02:22:12.482 DEBUG:teuthology.orchestra.run.smithi153:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.7-1375-g2577e813-1focal cephadm=17.2.7-1375-g2577e813-1focal ceph-mds=17.2.7-1375-g2577e813-1focal ceph-mgr=17.2.7-1375-g2577e813-1focal ceph-common=17.2.7-1375-g2577e813-1focal ceph-fuse=17.2.7-1375-g2577e813-1focal ceph-test=17.2.7-1375-g2577e813-1focal ceph-volume=17.2.7-1375-g2577e813-1focal radosgw=17.2.7-1375-g2577e813-1focal python3-rados=17.2.7-1375-g2577e813-1focal python3-rgw=17.2.7-1375-g2577e813-1focal python3-cephfs=17.2.7-1375-g2577e813-1focal python3-rbd=17.2.7-1375-g2577e813-1focal libcephfs2=17.2.7-1375-g2577e813-1focal libcephfs-dev=17.2.7-1375-g2577e813-1focal librados2=17.2.7-1375-g2577e813-1focal librbd1=17.2.7-1375-g2577e813-1focal rbd-fuse=17.2.7-1375-g2577e813-1focal python3-cephfs=17.2.7-1375-g2577e813-1focal cephfs-shell=17.2.7-1375-g2577e813-1focal cephfs-top=17.2.7-1375-g2577e813-1focal cephfs-mirror=17.2.7-1375-g2577e813-1focal 2024-08-17T02:22:12.493 INFO:teuthology.orchestra.run.smithi174.stdout:Reading package lists... 2024-08-17T02:22:12.551 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-08-17T02:22:12.683 INFO:teuthology.orchestra.run.smithi174.stdout:Building dependency tree... 2024-08-17T02:22:12.684 INFO:teuthology.orchestra.run.smithi174.stdout:Reading state information... 2024-08-17T02:22:12.744 INFO:teuthology.orchestra.run.smithi153.stdout:Building dependency tree... 2024-08-17T02:22:12.744 INFO:teuthology.orchestra.run.smithi153.stdout:Reading state information... 2024-08-17T02:22:12.872 INFO:teuthology.orchestra.run.smithi174.stdout:The following packages were automatically installed and are no longer required: 2024-08-17T02:22:12.874 INFO:teuthology.orchestra.run.smithi174.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-08-17T02:22:12.874 INFO:teuthology.orchestra.run.smithi174.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-17T02:22:12.874 INFO:teuthology.orchestra.run.smithi174.stdout:The following additional packages will be installed: 2024-08-17T02:22:12.874 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-08-17T02:22:12.874 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-08-17T02:22:12.874 INFO:teuthology.orchestra.run.smithi174.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-08-17T02:22:12.874 INFO:teuthology.orchestra.run.smithi174.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-08-17T02:22:12.874 INFO:teuthology.orchestra.run.smithi174.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-08-17T02:22:12.876 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-08-17T02:22:12.876 INFO:teuthology.orchestra.run.smithi174.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2024-08-17T02:22:12.876 INFO:teuthology.orchestra.run.smithi174.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2024-08-17T02:22:12.876 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2024-08-17T02:22:12.876 INFO:teuthology.orchestra.run.smithi174.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2024-08-17T02:22:12.876 INFO:teuthology.orchestra.run.smithi174.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-08-17T02:22:12.877 INFO:teuthology.orchestra.run.smithi174.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-08-17T02:22:12.877 INFO:teuthology.orchestra.run.smithi174.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-08-17T02:22:12.877 INFO:teuthology.orchestra.run.smithi174.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-08-17T02:22:12.877 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-08-17T02:22:12.877 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-08-17T02:22:12.877 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2024-08-17T02:22:12.877 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2024-08-17T02:22:12.877 INFO:teuthology.orchestra.run.smithi174.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-08-17T02:22:12.877 INFO:teuthology.orchestra.run.smithi174.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-08-17T02:22:12.877 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-08-17T02:22:12.877 INFO:teuthology.orchestra.run.smithi174.stdout: qttranslations5-l10n socat xmlstarlet 2024-08-17T02:22:12.877 INFO:teuthology.orchestra.run.smithi174.stdout:Suggested packages: 2024-08-17T02:22:12.877 INFO:teuthology.orchestra.run.smithi174.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-08-17T02:22:12.877 INFO:teuthology.orchestra.run.smithi174.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-08-17T02:22:12.878 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-08-17T02:22:12.878 INFO:teuthology.orchestra.run.smithi174.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-08-17T02:22:12.878 INFO:teuthology.orchestra.run.smithi174.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-08-17T02:22:12.878 INFO:teuthology.orchestra.run.smithi174.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-08-17T02:22:12.878 INFO:teuthology.orchestra.run.smithi174.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-08-17T02:22:12.878 INFO:teuthology.orchestra.run.smithi174.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-08-17T02:22:12.878 INFO:teuthology.orchestra.run.smithi174.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-08-17T02:22:12.878 INFO:teuthology.orchestra.run.smithi174.stdout:Recommended packages: 2024-08-17T02:22:12.878 INFO:teuthology.orchestra.run.smithi174.stdout: btrfs-tools 2024-08-17T02:22:12.935 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages were automatically installed and are no longer required: 2024-08-17T02:22:12.936 INFO:teuthology.orchestra.run.smithi153.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-08-17T02:22:12.936 INFO:teuthology.orchestra.run.smithi153.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-17T02:22:12.936 INFO:teuthology.orchestra.run.smithi153.stdout:The following additional packages will be installed: 2024-08-17T02:22:12.936 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-08-17T02:22:12.936 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-08-17T02:22:12.936 INFO:teuthology.orchestra.run.smithi153.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-08-17T02:22:12.936 INFO:teuthology.orchestra.run.smithi153.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-08-17T02:22:12.936 INFO:teuthology.orchestra.run.smithi153.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-08-17T02:22:12.937 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-08-17T02:22:12.937 INFO:teuthology.orchestra.run.smithi153.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2024-08-17T02:22:12.937 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2024-08-17T02:22:12.937 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2024-08-17T02:22:12.937 INFO:teuthology.orchestra.run.smithi153.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2024-08-17T02:22:12.937 INFO:teuthology.orchestra.run.smithi153.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-08-17T02:22:12.938 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-08-17T02:22:12.938 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-08-17T02:22:12.938 INFO:teuthology.orchestra.run.smithi153.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-08-17T02:22:12.938 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-08-17T02:22:12.938 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-08-17T02:22:12.938 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2024-08-17T02:22:12.938 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2024-08-17T02:22:12.938 INFO:teuthology.orchestra.run.smithi153.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-08-17T02:22:12.938 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-08-17T02:22:12.938 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-08-17T02:22:12.938 INFO:teuthology.orchestra.run.smithi153.stdout: qttranslations5-l10n socat xmlstarlet 2024-08-17T02:22:12.939 INFO:teuthology.orchestra.run.smithi153.stdout:Suggested packages: 2024-08-17T02:22:12.939 INFO:teuthology.orchestra.run.smithi153.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-08-17T02:22:12.939 INFO:teuthology.orchestra.run.smithi153.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-08-17T02:22:12.939 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-08-17T02:22:12.939 INFO:teuthology.orchestra.run.smithi153.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-08-17T02:22:12.939 INFO:teuthology.orchestra.run.smithi153.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-08-17T02:22:12.939 INFO:teuthology.orchestra.run.smithi153.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-08-17T02:22:12.939 INFO:teuthology.orchestra.run.smithi153.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-08-17T02:22:12.939 INFO:teuthology.orchestra.run.smithi153.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-08-17T02:22:12.939 INFO:teuthology.orchestra.run.smithi153.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-08-17T02:22:12.939 INFO:teuthology.orchestra.run.smithi153.stdout:Recommended packages: 2024-08-17T02:22:12.940 INFO:teuthology.orchestra.run.smithi153.stdout: btrfs-tools 2024-08-17T02:22:12.999 INFO:teuthology.orchestra.run.smithi174.stdout:The following NEW packages will be installed: 2024-08-17T02:22:12.999 INFO:teuthology.orchestra.run.smithi174.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-08-17T02:22:12.999 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-08-17T02:22:12.999 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-08-17T02:22:12.999 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2024-08-17T02:22:12.999 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2024-08-17T02:22:13.000 INFO:teuthology.orchestra.run.smithi174.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2024-08-17T02:22:13.000 INFO:teuthology.orchestra.run.smithi174.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2024-08-17T02:22:13.001 INFO:teuthology.orchestra.run.smithi174.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2024-08-17T02:22:13.001 INFO:teuthology.orchestra.run.smithi174.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2024-08-17T02:22:13.001 INFO:teuthology.orchestra.run.smithi174.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2024-08-17T02:22:13.001 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2024-08-17T02:22:13.001 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2024-08-17T02:22:13.002 INFO:teuthology.orchestra.run.smithi174.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2024-08-17T02:22:13.002 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2024-08-17T02:22:13.002 INFO:teuthology.orchestra.run.smithi174.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-08-17T02:22:13.002 INFO:teuthology.orchestra.run.smithi174.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-08-17T02:22:13.002 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-08-17T02:22:13.002 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-08-17T02:22:13.002 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2024-08-17T02:22:13.002 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-08-17T02:22:13.002 INFO:teuthology.orchestra.run.smithi174.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-08-17T02:22:13.002 INFO:teuthology.orchestra.run.smithi174.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-08-17T02:22:13.002 INFO:teuthology.orchestra.run.smithi174.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-08-17T02:22:13.002 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-08-17T02:22:13.003 INFO:teuthology.orchestra.run.smithi174.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2024-08-17T02:22:13.003 INFO:teuthology.orchestra.run.smithi174.stdout:The following packages will be upgraded: 2024-08-17T02:22:13.003 INFO:teuthology.orchestra.run.smithi174.stdout: librados2 librbd1 2024-08-17T02:22:13.064 INFO:teuthology.orchestra.run.smithi153.stdout:The following NEW packages will be installed: 2024-08-17T02:22:13.064 INFO:teuthology.orchestra.run.smithi153.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-08-17T02:22:13.065 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-08-17T02:22:13.065 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-08-17T02:22:13.065 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2024-08-17T02:22:13.065 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2024-08-17T02:22:13.065 INFO:teuthology.orchestra.run.smithi153.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2024-08-17T02:22:13.065 INFO:teuthology.orchestra.run.smithi153.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2024-08-17T02:22:13.066 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2024-08-17T02:22:13.066 INFO:teuthology.orchestra.run.smithi153.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2024-08-17T02:22:13.066 INFO:teuthology.orchestra.run.smithi153.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2024-08-17T02:22:13.066 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2024-08-17T02:22:13.066 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2024-08-17T02:22:13.067 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2024-08-17T02:22:13.067 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2024-08-17T02:22:13.067 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-08-17T02:22:13.067 INFO:teuthology.orchestra.run.smithi153.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-08-17T02:22:13.067 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-08-17T02:22:13.067 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-08-17T02:22:13.067 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2024-08-17T02:22:13.067 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-08-17T02:22:13.067 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-08-17T02:22:13.067 INFO:teuthology.orchestra.run.smithi153.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-08-17T02:22:13.067 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-08-17T02:22:13.067 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-08-17T02:22:13.067 INFO:teuthology.orchestra.run.smithi153.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2024-08-17T02:22:13.068 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages will be upgraded: 2024-08-17T02:22:13.068 INFO:teuthology.orchestra.run.smithi174.stdout:2 upgraded, 114 newly installed, 0 to remove and 295 not upgraded. 2024-08-17T02:22:13.068 INFO:teuthology.orchestra.run.smithi174.stdout:Need to get 201 MB of archives. 2024-08-17T02:22:13.068 INFO:teuthology.orchestra.run.smithi174.stdout:After this operation, 938 MB of additional disk space will be used. 2024-08-17T02:22:13.069 INFO:teuthology.orchestra.run.smithi174.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2024-08-17T02:22:13.069 INFO:teuthology.orchestra.run.smithi153.stdout: librados2 librbd1 2024-08-17T02:22:13.091 INFO:teuthology.orchestra.run.smithi174.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-08-17T02:22:13.099 INFO:teuthology.orchestra.run.smithi174.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2024-08-17T02:22:13.126 INFO:teuthology.orchestra.run.smithi174.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-08-17T02:22:13.132 INFO:teuthology.orchestra.run.smithi153.stdout:2 upgraded, 114 newly installed, 0 to remove and 295 not upgraded. 2024-08-17T02:22:13.132 INFO:teuthology.orchestra.run.smithi153.stdout:Need to get 201 MB of archives. 2024-08-17T02:22:13.133 INFO:teuthology.orchestra.run.smithi153.stdout:After this operation, 938 MB of additional disk space will be used. 2024-08-17T02:22:13.133 INFO:teuthology.orchestra.run.smithi153.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2024-08-17T02:22:13.151 INFO:teuthology.orchestra.run.smithi153.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-08-17T02:22:13.156 INFO:teuthology.orchestra.run.smithi174.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-08-17T02:22:13.157 INFO:teuthology.orchestra.run.smithi174.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-08-17T02:22:13.158 INFO:teuthology.orchestra.run.smithi153.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2024-08-17T02:22:13.167 INFO:teuthology.orchestra.run.smithi174.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-08-17T02:22:13.170 INFO:teuthology.orchestra.run.smithi174.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-08-17T02:22:13.184 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-08-17T02:22:13.187 INFO:teuthology.orchestra.run.smithi174.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-08-17T02:22:13.189 INFO:teuthology.orchestra.run.smithi174.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-08-17T02:22:13.193 INFO:teuthology.orchestra.run.smithi174.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-08-17T02:22:13.213 INFO:teuthology.orchestra.run.smithi153.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-08-17T02:22:13.215 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-08-17T02:22:13.222 INFO:teuthology.orchestra.run.smithi174.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-08-17T02:22:13.224 INFO:teuthology.orchestra.run.smithi174.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-08-17T02:22:13.225 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-08-17T02:22:13.227 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-08-17T02:22:13.230 INFO:teuthology.orchestra.run.smithi174.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-08-17T02:22:13.232 INFO:teuthology.orchestra.run.smithi174.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-08-17T02:22:13.232 INFO:teuthology.orchestra.run.smithi174.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-08-17T02:22:13.234 INFO:teuthology.orchestra.run.smithi174.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-08-17T02:22:13.235 INFO:teuthology.orchestra.run.smithi174.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-08-17T02:22:13.235 INFO:teuthology.orchestra.run.smithi174.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-08-17T02:22:13.235 INFO:teuthology.orchestra.run.smithi174.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-08-17T02:22:13.245 INFO:teuthology.orchestra.run.smithi174.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-08-17T02:22:13.245 INFO:teuthology.orchestra.run.smithi153.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-08-17T02:22:13.246 INFO:teuthology.orchestra.run.smithi174.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-08-17T02:22:13.246 INFO:teuthology.orchestra.run.smithi153.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-08-17T02:22:13.251 INFO:teuthology.orchestra.run.smithi153.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-08-17T02:22:13.262 INFO:teuthology.orchestra.run.smithi174.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-08-17T02:22:13.263 INFO:teuthology.orchestra.run.smithi174.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-08-17T02:22:13.264 INFO:teuthology.orchestra.run.smithi174.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-08-17T02:22:13.265 INFO:teuthology.orchestra.run.smithi174.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-08-17T02:22:13.266 INFO:teuthology.orchestra.run.smithi174.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-08-17T02:22:13.266 INFO:teuthology.orchestra.run.smithi174.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-08-17T02:22:13.268 INFO:teuthology.orchestra.run.smithi174.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-08-17T02:22:13.268 INFO:teuthology.orchestra.run.smithi174.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-08-17T02:22:13.278 INFO:teuthology.orchestra.run.smithi153.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-08-17T02:22:13.280 INFO:teuthology.orchestra.run.smithi174.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-08-17T02:22:13.280 INFO:teuthology.orchestra.run.smithi153.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-08-17T02:22:13.281 INFO:teuthology.orchestra.run.smithi174.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-08-17T02:22:13.285 INFO:teuthology.orchestra.run.smithi153.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-08-17T02:22:13.287 INFO:teuthology.orchestra.run.smithi153.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-08-17T02:22:13.288 INFO:teuthology.orchestra.run.smithi153.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-08-17T02:22:13.290 INFO:teuthology.orchestra.run.smithi153.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-08-17T02:22:13.290 INFO:teuthology.orchestra.run.smithi153.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-08-17T02:22:13.291 INFO:teuthology.orchestra.run.smithi153.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-08-17T02:22:13.291 INFO:teuthology.orchestra.run.smithi153.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-08-17T02:22:13.297 INFO:teuthology.orchestra.run.smithi174.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-08-17T02:22:13.302 INFO:teuthology.orchestra.run.smithi153.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-08-17T02:22:13.302 INFO:teuthology.orchestra.run.smithi153.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-08-17T02:22:13.303 INFO:teuthology.orchestra.run.smithi174.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-08-17T02:22:13.304 INFO:teuthology.orchestra.run.smithi174.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-08-17T02:22:13.305 INFO:teuthology.orchestra.run.smithi174.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-08-17T02:22:13.305 INFO:teuthology.orchestra.run.smithi174.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-08-17T02:22:13.306 INFO:teuthology.orchestra.run.smithi174.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.2 [183 kB] 2024-08-17T02:22:13.308 INFO:teuthology.orchestra.run.smithi174.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.3 [96.0 kB] 2024-08-17T02:22:13.310 INFO:teuthology.orchestra.run.smithi174.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-08-17T02:22:13.314 INFO:teuthology.orchestra.run.smithi174.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-08-17T02:22:13.316 INFO:teuthology.orchestra.run.smithi174.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-08-17T02:22:13.318 INFO:teuthology.orchestra.run.smithi153.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-08-17T02:22:13.319 INFO:teuthology.orchestra.run.smithi153.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-08-17T02:22:13.319 INFO:teuthology.orchestra.run.smithi153.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-08-17T02:22:13.321 INFO:teuthology.orchestra.run.smithi153.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-08-17T02:22:13.321 INFO:teuthology.orchestra.run.smithi153.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-08-17T02:22:13.321 INFO:teuthology.orchestra.run.smithi153.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-08-17T02:22:13.323 INFO:teuthology.orchestra.run.smithi153.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-08-17T02:22:13.323 INFO:teuthology.orchestra.run.smithi153.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-08-17T02:22:13.332 INFO:teuthology.orchestra.run.smithi174.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-08-17T02:22:13.333 INFO:teuthology.orchestra.run.smithi174.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-08-17T02:22:13.334 INFO:teuthology.orchestra.run.smithi174.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-08-17T02:22:13.334 INFO:teuthology.orchestra.run.smithi174.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-08-17T02:22:13.339 INFO:teuthology.orchestra.run.smithi153.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-08-17T02:22:13.341 INFO:teuthology.orchestra.run.smithi153.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-08-17T02:22:13.357 INFO:teuthology.orchestra.run.smithi153.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-08-17T02:22:13.363 INFO:teuthology.orchestra.run.smithi153.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-08-17T02:22:13.363 INFO:teuthology.orchestra.run.smithi153.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-08-17T02:22:13.364 INFO:teuthology.orchestra.run.smithi153.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-08-17T02:22:13.365 INFO:teuthology.orchestra.run.smithi153.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-08-17T02:22:13.366 INFO:teuthology.orchestra.run.smithi153.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.2 [183 kB] 2024-08-17T02:22:13.369 INFO:teuthology.orchestra.run.smithi153.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.3 [96.0 kB] 2024-08-17T02:22:13.371 INFO:teuthology.orchestra.run.smithi153.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-08-17T02:22:13.374 INFO:teuthology.orchestra.run.smithi153.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-08-17T02:22:13.375 INFO:teuthology.orchestra.run.smithi153.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-08-17T02:22:13.392 INFO:teuthology.orchestra.run.smithi153.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-08-17T02:22:13.393 INFO:teuthology.orchestra.run.smithi153.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-08-17T02:22:13.393 INFO:teuthology.orchestra.run.smithi153.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-08-17T02:22:13.394 INFO:teuthology.orchestra.run.smithi153.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-08-17T02:22:13.413 INFO:teuthology.orchestra.run.smithi174.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-08-17T02:22:13.428 INFO:teuthology.orchestra.run.smithi174.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-08-17T02:22:13.429 INFO:teuthology.orchestra.run.smithi174.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-08-17T02:22:13.440 INFO:teuthology.orchestra.run.smithi174.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-08-17T02:22:13.447 INFO:teuthology.orchestra.run.smithi174.stdout:Get:51 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.7-1375-g2577e813-1focal [3,506 kB] 2024-08-17T02:22:13.481 INFO:teuthology.orchestra.run.smithi153.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-08-17T02:22:13.497 INFO:teuthology.orchestra.run.smithi153.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-08-17T02:22:13.498 INFO:teuthology.orchestra.run.smithi153.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-08-17T02:22:13.505 INFO:teuthology.orchestra.run.smithi174.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-08-17T02:22:13.505 INFO:teuthology.orchestra.run.smithi174.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-08-17T02:22:13.506 INFO:teuthology.orchestra.run.smithi153.stdout:Get:50 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.7-1375-g2577e813-1focal [3,506 kB] 2024-08-17T02:22:13.506 INFO:teuthology.orchestra.run.smithi174.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-08-17T02:22:13.506 INFO:teuthology.orchestra.run.smithi174.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-08-17T02:22:13.507 INFO:teuthology.orchestra.run.smithi174.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-08-17T02:22:13.507 INFO:teuthology.orchestra.run.smithi174.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-08-17T02:22:13.509 INFO:teuthology.orchestra.run.smithi174.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-08-17T02:22:13.509 INFO:teuthology.orchestra.run.smithi174.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-08-17T02:22:13.513 INFO:teuthology.orchestra.run.smithi153.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-08-17T02:22:13.513 INFO:teuthology.orchestra.run.smithi153.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-08-17T02:22:13.513 INFO:teuthology.orchestra.run.smithi153.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-08-17T02:22:13.522 INFO:teuthology.orchestra.run.smithi174.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-08-17T02:22:13.528 INFO:teuthology.orchestra.run.smithi174.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-08-17T02:22:13.530 INFO:teuthology.orchestra.run.smithi174.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-08-17T02:22:13.532 INFO:teuthology.orchestra.run.smithi174.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-08-17T02:22:13.533 INFO:teuthology.orchestra.run.smithi174.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-08-17T02:22:13.536 INFO:teuthology.orchestra.run.smithi174.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-08-17T02:22:13.540 INFO:teuthology.orchestra.run.smithi174.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2024-08-17T02:22:13.540 INFO:teuthology.orchestra.run.smithi174.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-08-17T02:22:13.555 INFO:teuthology.orchestra.run.smithi174.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-08-17T02:22:13.557 INFO:teuthology.orchestra.run.smithi174.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-08-17T02:22:13.561 INFO:teuthology.orchestra.run.smithi153.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-08-17T02:22:13.562 INFO:teuthology.orchestra.run.smithi153.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-08-17T02:22:13.562 INFO:teuthology.orchestra.run.smithi153.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-08-17T02:22:13.563 INFO:teuthology.orchestra.run.smithi153.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-08-17T02:22:13.564 INFO:teuthology.orchestra.run.smithi153.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-08-17T02:22:13.565 INFO:teuthology.orchestra.run.smithi153.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-08-17T02:22:13.565 INFO:teuthology.orchestra.run.smithi153.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-08-17T02:22:13.570 INFO:teuthology.orchestra.run.smithi153.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-08-17T02:22:13.572 INFO:teuthology.orchestra.run.smithi153.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-08-17T02:22:13.579 INFO:teuthology.orchestra.run.smithi153.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-08-17T02:22:13.593 INFO:teuthology.orchestra.run.smithi153.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-08-17T02:22:13.596 INFO:teuthology.orchestra.run.smithi153.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-08-17T02:22:13.602 INFO:teuthology.orchestra.run.smithi153.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2024-08-17T02:22:13.602 INFO:teuthology.orchestra.run.smithi153.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-08-17T02:22:13.619 INFO:teuthology.orchestra.run.smithi153.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-08-17T02:22:13.621 INFO:teuthology.orchestra.run.smithi153.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-08-17T02:22:13.645 INFO:teuthology.orchestra.run.smithi174.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-08-17T02:22:13.647 INFO:teuthology.orchestra.run.smithi174.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-08-17T02:22:13.647 INFO:teuthology.orchestra.run.smithi174.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-08-17T02:22:13.647 INFO:teuthology.orchestra.run.smithi174.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-08-17T02:22:13.648 INFO:teuthology.orchestra.run.smithi174.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-08-17T02:22:13.649 INFO:teuthology.orchestra.run.smithi174.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-08-17T02:22:13.657 INFO:teuthology.orchestra.run.smithi153.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-08-17T02:22:13.658 INFO:teuthology.orchestra.run.smithi153.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-08-17T02:22:13.659 INFO:teuthology.orchestra.run.smithi153.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-08-17T02:22:13.659 INFO:teuthology.orchestra.run.smithi153.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-08-17T02:22:13.660 INFO:teuthology.orchestra.run.smithi153.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-08-17T02:22:13.660 INFO:teuthology.orchestra.run.smithi153.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-08-17T02:22:13.664 INFO:teuthology.orchestra.run.smithi174.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-08-17T02:22:13.665 INFO:teuthology.orchestra.run.smithi174.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-08-17T02:22:13.665 INFO:teuthology.orchestra.run.smithi174.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-08-17T02:22:13.666 INFO:teuthology.orchestra.run.smithi174.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-08-17T02:22:13.672 INFO:teuthology.orchestra.run.smithi153.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-08-17T02:22:13.672 INFO:teuthology.orchestra.run.smithi153.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-08-17T02:22:13.672 INFO:teuthology.orchestra.run.smithi153.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-08-17T02:22:13.675 INFO:teuthology.orchestra.run.smithi153.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-08-17T02:22:13.681 INFO:teuthology.orchestra.run.smithi174.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-08-17T02:22:13.681 INFO:teuthology.orchestra.run.smithi174.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-08-17T02:22:13.684 INFO:teuthology.orchestra.run.smithi174.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-08-17T02:22:13.684 INFO:teuthology.orchestra.run.smithi174.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-08-17T02:22:13.692 INFO:teuthology.orchestra.run.smithi153.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-08-17T02:22:13.693 INFO:teuthology.orchestra.run.smithi153.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-08-17T02:22:13.694 INFO:teuthology.orchestra.run.smithi153.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-08-17T02:22:13.695 INFO:teuthology.orchestra.run.smithi153.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-08-17T02:22:14.146 INFO:teuthology.orchestra.run.smithi174.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.7-1375-g2577e813-1focal [3,560 kB] 2024-08-17T02:22:14.418 INFO:teuthology.orchestra.run.smithi174.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.7-1375-g2577e813-1focal [761 kB] 2024-08-17T02:22:14.462 INFO:teuthology.orchestra.run.smithi153.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.7-1375-g2577e813-1focal [3,560 kB] 2024-08-17T02:22:14.485 INFO:teuthology.orchestra.run.smithi174.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.7-1375-g2577e813-1focal [414 kB] 2024-08-17T02:22:14.492 INFO:teuthology.orchestra.run.smithi174.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.7-1375-g2577e813-1focal [22.6 kB] 2024-08-17T02:22:14.493 INFO:teuthology.orchestra.run.smithi174.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.7-1375-g2577e813-1focal [200 kB] 2024-08-17T02:22:14.550 INFO:teuthology.orchestra.run.smithi174.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.7-1375-g2577e813-1focal [49.1 kB] 2024-08-17T02:22:14.551 INFO:teuthology.orchestra.run.smithi174.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.7-1375-g2577e813-1focal [389 kB] 2024-08-17T02:22:14.558 INFO:teuthology.orchestra.run.smithi174.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.7-1375-g2577e813-1focal [5,612 kB] 2024-08-17T02:22:14.984 INFO:teuthology.orchestra.run.smithi174.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.7-1375-g2577e813-1focal [116 kB] 2024-08-17T02:22:14.985 INFO:teuthology.orchestra.run.smithi174.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.7-1375-g2577e813-1focal [478 kB] 2024-08-17T02:22:14.992 INFO:teuthology.orchestra.run.smithi174.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.7-1375-g2577e813-1focal [26.9 MB] 2024-08-17T02:22:15.028 INFO:teuthology.orchestra.run.smithi153.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.7-1375-g2577e813-1focal [761 kB] 2024-08-17T02:22:15.151 INFO:teuthology.orchestra.run.smithi153.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.7-1375-g2577e813-1focal [414 kB] 2024-08-17T02:22:15.214 INFO:teuthology.orchestra.run.smithi153.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.7-1375-g2577e813-1focal [22.6 kB] 2024-08-17T02:22:15.215 INFO:teuthology.orchestra.run.smithi153.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.7-1375-g2577e813-1focal [200 kB] 2024-08-17T02:22:15.221 INFO:teuthology.orchestra.run.smithi153.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.7-1375-g2577e813-1focal [49.1 kB] 2024-08-17T02:22:15.222 INFO:teuthology.orchestra.run.smithi153.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.7-1375-g2577e813-1focal [389 kB] 2024-08-17T02:22:15.283 INFO:teuthology.orchestra.run.smithi153.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.7-1375-g2577e813-1focal [5,612 kB] 2024-08-17T02:22:16.173 INFO:teuthology.orchestra.run.smithi153.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.7-1375-g2577e813-1focal [116 kB] 2024-08-17T02:22:16.176 INFO:teuthology.orchestra.run.smithi153.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.7-1375-g2577e813-1focal [478 kB] 2024-08-17T02:22:16.241 INFO:teuthology.orchestra.run.smithi153.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.7-1375-g2577e813-1focal [26.9 MB] 2024-08-17T02:22:17.018 INFO:teuthology.orchestra.run.smithi174.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.7-1375-g2577e813-1focal [5,173 kB] 2024-08-17T02:22:17.277 INFO:teuthology.orchestra.run.smithi174.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.7-1375-g2577e813-1focal [223 kB] 2024-08-17T02:22:17.283 INFO:teuthology.orchestra.run.smithi174.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.7-1375-g2577e813-1focal [157 kB] 2024-08-17T02:22:17.283 INFO:teuthology.orchestra.run.smithi174.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.7-1375-g2577e813-1focal [1,594 kB] 2024-08-17T02:22:17.377 INFO:teuthology.orchestra.run.smithi174.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.7-1375-g2577e813-1focal [4,686 kB] 2024-08-17T02:22:17.702 INFO:teuthology.orchestra.run.smithi174.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.7-1375-g2577e813-1focal [23.1 MB] 2024-08-17T02:22:19.325 INFO:teuthology.orchestra.run.smithi174.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.7-1375-g2577e813-1focal [3,944 B] 2024-08-17T02:22:19.326 INFO:teuthology.orchestra.run.smithi174.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.7-1375-g2577e813-1focal [871 kB] 2024-08-17T02:22:19.339 INFO:teuthology.orchestra.run.smithi174.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.7-1375-g2577e813-1focal [2,415 kB] 2024-08-17T02:22:19.480 INFO:teuthology.orchestra.run.smithi174.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.7-1375-g2577e813-1focal [81.4 kB] 2024-08-17T02:22:19.482 INFO:teuthology.orchestra.run.smithi174.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.7-1375-g2577e813-1focal [120 kB] 2024-08-17T02:22:19.484 INFO:teuthology.orchestra.run.smithi174.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.7-1375-g2577e813-1focal [6,653 kB] 2024-08-17T02:22:19.910 INFO:teuthology.orchestra.run.smithi174.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.7-1375-g2577e813-1focal [7,886 kB] 2024-08-17T02:22:20.349 INFO:teuthology.orchestra.run.smithi153.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.7-1375-g2577e813-1focal [5,173 kB] 2024-08-17T02:22:20.426 INFO:teuthology.orchestra.run.smithi174.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.7-1375-g2577e813-1focal [4,060 B] 2024-08-17T02:22:20.427 INFO:teuthology.orchestra.run.smithi174.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.7-1375-g2577e813-1focal [53.3 MB] 2024-08-17T02:22:21.073 INFO:teuthology.orchestra.run.smithi153.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.7-1375-g2577e813-1focal [223 kB] 2024-08-17T02:22:21.091 INFO:teuthology.orchestra.run.smithi153.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.7-1375-g2577e813-1focal [157 kB] 2024-08-17T02:22:21.107 INFO:teuthology.orchestra.run.smithi153.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.7-1375-g2577e813-1focal [1,594 kB] 2024-08-17T02:22:21.376 INFO:teuthology.orchestra.run.smithi153.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.7-1375-g2577e813-1focal [4,686 kB] 2024-08-17T02:22:22.104 INFO:teuthology.orchestra.run.smithi153.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.7-1375-g2577e813-1focal [23.1 MB] 2024-08-17T02:22:24.604 INFO:teuthology.orchestra.run.smithi174.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.7-1375-g2577e813-1focal [230 kB] 2024-08-17T02:22:24.609 INFO:teuthology.orchestra.run.smithi174.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.7-1375-g2577e813-1focal [241 kB] 2024-08-17T02:22:24.612 INFO:teuthology.orchestra.run.smithi174.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.7-1375-g2577e813-1focal [22.0 kB] 2024-08-17T02:22:24.657 INFO:teuthology.orchestra.run.smithi174.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.7-1375-g2577e813-1focal [13.1 kB] 2024-08-17T02:22:24.657 INFO:teuthology.orchestra.run.smithi174.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.7-1375-g2577e813-1focal [21.9 kB] 2024-08-17T02:22:24.658 INFO:teuthology.orchestra.run.smithi174.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.7-1375-g2577e813-1focal [17.1 MB] 2024-08-17T02:22:25.792 INFO:teuthology.orchestra.run.smithi174.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.7-1375-g2577e813-1focal [80.6 kB] 2024-08-17T02:22:26.431 INFO:teuthology.orchestra.run.smithi174.stdout:Fetched 201 MB in 13s (15.7 MB/s) 2024-08-17T02:22:26.565 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pyperclip. 2024-08-17T02:22:26.623 INFO:teuthology.orchestra.run.smithi174.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141718 files and directories currently installed.) 2024-08-17T02:22:26.627 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2024-08-17T02:22:26.672 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2024-08-17T02:22:26.957 INFO:teuthology.orchestra.run.smithi153.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.7-1375-g2577e813-1focal [3,944 B] 2024-08-17T02:22:26.958 INFO:teuthology.orchestra.run.smithi153.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.7-1375-g2577e813-1focal [871 kB] 2024-08-17T02:22:27.008 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-wcwidth. 2024-08-17T02:22:27.024 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-08-17T02:22:27.056 INFO:teuthology.orchestra.run.smithi153.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.7-1375-g2577e813-1focal [2,415 kB] 2024-08-17T02:22:27.066 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-08-17T02:22:27.368 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-cmd2. 2024-08-17T02:22:27.370 INFO:teuthology.orchestra.run.smithi153.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.7-1375-g2577e813-1focal [81.4 kB] 2024-08-17T02:22:27.372 INFO:teuthology.orchestra.run.smithi153.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.7-1375-g2577e813-1focal [120 kB] 2024-08-17T02:22:27.387 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2024-08-17T02:22:27.400 INFO:teuthology.orchestra.run.smithi153.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.7-1375-g2577e813-1focal [6,653 kB] 2024-08-17T02:22:27.426 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2024-08-17T02:22:27.771 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-08-17T02:22:27.787 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-08-17T02:22:27.871 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-08-17T02:22:28.163 INFO:teuthology.orchestra.run.smithi153.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.7-1375-g2577e813-1focal [7,886 kB] 2024-08-17T02:22:28.283 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../004-librbd1_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:28.425 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking librbd1 (17.2.7-1375-g2577e813-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-08-17T02:22:29.113 INFO:teuthology.orchestra.run.smithi153.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.7-1375-g2577e813-1focal [4,060 B] 2024-08-17T02:22:29.113 INFO:teuthology.orchestra.run.smithi153.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.7-1375-g2577e813-1focal [53.3 MB] 2024-08-17T02:22:29.145 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../005-librados2_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:29.245 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking librados2 (17.2.7-1375-g2577e813-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-08-17T02:22:30.200 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libcephfs2. 2024-08-17T02:22:30.215 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../006-libcephfs2_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:30.274 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libcephfs2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:30.643 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-rados. 2024-08-17T02:22:30.659 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../007-python3-rados_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:30.701 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-rados (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:31.021 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-08-17T02:22:31.038 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:22:31.104 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-ceph-argparse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:31.373 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-cephfs. 2024-08-17T02:22:31.393 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../009-python3-cephfs_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:31.431 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-cephfs (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:31.784 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-ceph-common. 2024-08-17T02:22:31.800 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:22:31.842 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:32.203 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-prettytable. 2024-08-17T02:22:32.222 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2024-08-17T02:22:32.261 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-08-17T02:22:32.539 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-rbd. 2024-08-17T02:22:32.555 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../012-python3-rbd_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:32.589 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-rbd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:32.950 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-08-17T02:22:32.969 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-08-17T02:22:33.008 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-08-17T02:22:33.257 INFO:teuthology.orchestra.run.smithi153.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.7-1375-g2577e813-1focal [230 kB] 2024-08-17T02:22:33.262 INFO:teuthology.orchestra.run.smithi153.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.7-1375-g2577e813-1focal [241 kB] 2024-08-17T02:22:33.266 INFO:teuthology.orchestra.run.smithi153.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.7-1375-g2577e813-1focal [22.0 kB] 2024-08-17T02:22:33.267 INFO:teuthology.orchestra.run.smithi153.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.7-1375-g2577e813-1focal [13.1 kB] 2024-08-17T02:22:33.268 INFO:teuthology.orchestra.run.smithi153.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.7-1375-g2577e813-1focal [21.9 kB] 2024-08-17T02:22:33.268 INFO:teuthology.orchestra.run.smithi153.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.7-1375-g2577e813-1focal [17.1 MB] 2024-08-17T02:22:33.344 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-08-17T02:22:33.361 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2024-08-17T02:22:33.402 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-08-17T02:22:33.797 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-08-17T02:22:33.817 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-08-17T02:22:33.855 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-08-17T02:22:34.011 INFO:teuthology.orchestra.run.smithi153.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.7-1375-g2577e813-1focal [80.6 kB] 2024-08-17T02:22:34.283 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-08-17T02:22:34.302 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-08-17T02:22:34.341 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-08-17T02:22:34.661 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 201 MB in 21s (9,609 kB/s) 2024-08-17T02:22:34.669 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-08-17T02:22:34.686 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-08-17T02:22:34.727 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-08-17T02:22:34.801 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pyperclip. 2024-08-17T02:22:34.858 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141718 files and directories currently installed.) 2024-08-17T02:22:34.862 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2024-08-17T02:22:34.933 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2024-08-17T02:22:35.213 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-08-17T02:22:35.231 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-17T02:22:35.277 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-wcwidth. 2024-08-17T02:22:35.282 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:22:35.293 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-08-17T02:22:35.336 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-08-17T02:22:35.663 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cmd2. 2024-08-17T02:22:35.679 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2024-08-17T02:22:35.721 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2024-08-17T02:22:35.825 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-08-17T02:22:35.845 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-17T02:22:35.883 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:22:36.091 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-08-17T02:22:36.111 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-08-17T02:22:36.216 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-08-17T02:22:36.252 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-08-17T02:22:36.270 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-17T02:22:36.310 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:22:36.535 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../004-librbd1_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:36.636 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librbd1 (17.2.7-1375-g2577e813-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-08-17T02:22:36.714 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-08-17T02:22:36.731 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-08-17T02:22:36.805 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-08-17T02:22:37.199 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package librgw2. 2024-08-17T02:22:37.216 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../022-librgw2_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:37.258 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking librgw2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:37.335 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../005-librados2_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:37.482 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librados2 (17.2.7-1375-g2577e813-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-08-17T02:22:38.085 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-rgw. 2024-08-17T02:22:38.102 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../023-python3-rgw_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:38.153 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libcephfs2. 2024-08-17T02:22:38.168 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-rgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:38.172 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../006-libcephfs2_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:38.203 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libcephfs2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:38.504 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package liboath0. 2024-08-17T02:22:38.522 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rados. 2024-08-17T02:22:38.522 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2024-08-17T02:22:38.540 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../007-python3-rados_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:38.554 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-08-17T02:22:38.580 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rados (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:38.882 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libradosstriper1. 2024-08-17T02:22:38.899 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../025-libradosstriper1_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:38.956 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libradosstriper1 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:38.974 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-08-17T02:22:38.992 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:22:39.032 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-ceph-argparse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:39.310 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cephfs. 2024-08-17T02:22:39.326 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../009-python3-cephfs_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:39.368 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cephfs (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:39.435 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-common. 2024-08-17T02:22:39.451 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../026-ceph-common_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:39.518 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:39.754 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-ceph-common. 2024-08-17T02:22:39.770 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:22:39.812 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:40.149 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-prettytable. 2024-08-17T02:22:40.168 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2024-08-17T02:22:40.207 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-08-17T02:22:40.476 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rbd. 2024-08-17T02:22:40.493 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../012-python3-rbd_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:40.534 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rbd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:40.904 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-08-17T02:22:40.920 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-08-17T02:22:40.962 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-08-17T02:22:41.357 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-08-17T02:22:41.373 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2024-08-17T02:22:41.415 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-08-17T02:22:41.726 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-08-17T02:22:41.744 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-08-17T02:22:41.776 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-08-17T02:22:42.098 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-base. 2024-08-17T02:22:42.115 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../027-ceph-base_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:42.158 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-base (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:42.171 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-08-17T02:22:42.191 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-08-17T02:22:42.229 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-08-17T02:22:42.610 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-08-17T02:22:42.627 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-08-17T02:22:42.673 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-08-17T02:22:43.019 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-cryptography. 2024-08-17T02:22:43.035 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-08-17T02:22:43.093 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-08-17T02:22:43.101 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-08-17T02:22:43.112 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-17T02:22:43.153 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:22:43.505 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-openssl. 2024-08-17T02:22:43.525 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2024-08-17T02:22:43.563 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-08-17T02:22:43.696 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-08-17T02:22:43.713 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-17T02:22:43.754 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:22:43.933 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-packaging. 2024-08-17T02:22:43.949 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../030-python3-packaging_20.3-1_all.deb ... 2024-08-17T02:22:43.991 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-packaging (20.3-1) ... 2024-08-17T02:22:44.107 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-08-17T02:22:44.125 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-17T02:22:44.157 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:22:44.260 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-08-17T02:22:44.278 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../031-ceph-mgr-modules-core_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:22:44.318 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mgr-modules-core (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:44.542 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-08-17T02:22:44.560 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-08-17T02:22:44.610 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-08-17T02:22:44.765 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-bcrypt. 2024-08-17T02:22:44.780 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../032-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-08-17T02:22:44.823 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-08-17T02:22:44.938 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package librgw2. 2024-08-17T02:22:44.954 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../022-librgw2_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:44.988 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librgw2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:45.100 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-cherrypy3. 2024-08-17T02:22:45.118 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../033-python3-cherrypy3_8.9.1-6_all.deb ... 2024-08-17T02:22:45.150 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-08-17T02:22:46.199 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rgw. 2024-08-17T02:22:46.218 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../023-python3-rgw_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:46.257 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:46.312 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-natsort. 2024-08-17T02:22:46.328 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../034-python3-natsort_7.0.1-1_all.deb ... 2024-08-17T02:22:46.361 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-08-17T02:22:46.676 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liboath0. 2024-08-17T02:22:46.696 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2024-08-17T02:22:46.734 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-08-17T02:22:46.748 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-jwt. 2024-08-17T02:22:46.766 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../035-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-08-17T02:22:46.806 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-08-17T02:22:47.071 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libradosstriper1. 2024-08-17T02:22:47.089 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../025-libradosstriper1_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:47.129 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libradosstriper1 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:47.151 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-logutils. 2024-08-17T02:22:47.168 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../036-python3-logutils_0.3.3-7_all.deb ... 2024-08-17T02:22:47.209 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-08-17T02:22:47.536 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-markupsafe. 2024-08-17T02:22:47.554 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../037-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-08-17T02:22:47.557 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-common. 2024-08-17T02:22:47.574 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../026-ceph-common_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:47.603 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-08-17T02:22:47.640 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:47.931 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-mako. 2024-08-17T02:22:47.950 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../038-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-08-17T02:22:47.989 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-08-17T02:22:48.342 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-simplegeneric. 2024-08-17T02:22:48.360 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../039-python3-simplegeneric_0.8.1-3_all.deb ... 2024-08-17T02:22:48.425 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-08-17T02:22:48.761 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-singledispatch. 2024-08-17T02:22:48.777 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../040-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-08-17T02:22:48.819 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-08-17T02:22:49.130 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-webob. 2024-08-17T02:22:49.150 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../041-python3-webob_1%3a1.8.5-2_all.deb ... 2024-08-17T02:22:49.188 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-08-17T02:22:49.566 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-soupsieve. 2024-08-17T02:22:49.583 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../042-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-08-17T02:22:49.624 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-08-17T02:22:49.952 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-bs4. 2024-08-17T02:22:49.968 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../043-python3-bs4_4.8.2-1_all.deb ... 2024-08-17T02:22:50.010 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-08-17T02:22:50.195 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-base. 2024-08-17T02:22:50.212 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../027-ceph-base_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:50.264 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-base (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:50.413 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-waitress. 2024-08-17T02:22:50.429 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../044-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-08-17T02:22:50.475 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-08-17T02:22:50.775 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-tempita. 2024-08-17T02:22:50.790 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../045-python3-tempita_0.5.2-6_all.deb ... 2024-08-17T02:22:50.824 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-08-17T02:22:51.160 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-paste. 2024-08-17T02:22:51.178 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../046-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-08-17T02:22:51.183 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cryptography. 2024-08-17T02:22:51.202 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-08-17T02:22:51.266 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-08-17T02:22:51.393 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-08-17T02:22:51.670 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-openssl. 2024-08-17T02:22:51.688 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2024-08-17T02:22:51.727 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-08-17T02:22:51.728 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-08-17T02:22:51.746 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../047-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-08-17T02:22:51.818 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-08-17T02:22:52.056 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-packaging. 2024-08-17T02:22:52.073 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../030-python3-packaging_20.3-1_all.deb ... 2024-08-17T02:22:52.106 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-packaging (20.3-1) ... 2024-08-17T02:22:52.155 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pastedeploy. 2024-08-17T02:22:52.174 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../048-python3-pastedeploy_2.1.0-1_all.deb ... 2024-08-17T02:22:52.213 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-08-17T02:22:52.358 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-08-17T02:22:52.374 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../031-ceph-mgr-modules-core_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:22:52.416 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-modules-core (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:52.549 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-webtest. 2024-08-17T02:22:52.565 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../049-python3-webtest_2.0.32-2_all.deb ... 2024-08-17T02:22:52.607 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-08-17T02:22:52.804 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-bcrypt. 2024-08-17T02:22:52.824 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../032-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-08-17T02:22:52.879 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-08-17T02:22:52.968 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pecan. 2024-08-17T02:22:52.984 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../050-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-08-17T02:22:53.026 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-08-17T02:22:53.207 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cherrypy3. 2024-08-17T02:22:53.225 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../033-python3-cherrypy3_8.9.1-6_all.deb ... 2024-08-17T02:22:53.256 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-08-17T02:22:53.414 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-werkzeug. 2024-08-17T02:22:53.433 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../051-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.2_all.deb ... 2024-08-17T02:22:53.472 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-08-17T02:22:53.593 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-natsort. 2024-08-17T02:22:53.612 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../034-python3-natsort_7.0.1-1_all.deb ... 2024-08-17T02:22:53.651 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-08-17T02:22:53.859 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-08-17T02:22:53.878 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../052-libsqlite3-mod-ceph_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:53.926 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libsqlite3-mod-ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:53.996 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-jwt. 2024-08-17T02:22:54.013 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../035-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-08-17T02:22:54.054 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-08-17T02:22:54.337 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mgr. 2024-08-17T02:22:54.356 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../053-ceph-mgr_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:54.395 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mgr (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:54.407 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-logutils. 2024-08-17T02:22:54.423 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../036-python3-logutils_0.3.3-7_all.deb ... 2024-08-17T02:22:54.484 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-08-17T02:22:54.827 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-markupsafe. 2024-08-17T02:22:54.845 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../037-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-08-17T02:22:54.885 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-08-17T02:22:54.956 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mon. 2024-08-17T02:22:54.974 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../054-ceph-mon_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:55.016 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mon (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:55.221 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-mako. 2024-08-17T02:22:55.240 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../038-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-08-17T02:22:55.279 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-08-17T02:22:55.632 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-simplegeneric. 2024-08-17T02:22:55.652 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../039-python3-simplegeneric_0.8.1-3_all.deb ... 2024-08-17T02:22:55.682 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-08-17T02:22:55.880 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-osd. 2024-08-17T02:22:55.896 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../055-ceph-osd_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:55.938 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-osd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:56.018 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-singledispatch. 2024-08-17T02:22:56.034 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../040-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-08-17T02:22:56.110 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-08-17T02:22:56.422 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-webob. 2024-08-17T02:22:56.440 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../041-python3-webob_1%3a1.8.5-2_all.deb ... 2024-08-17T02:22:56.479 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-08-17T02:22:56.824 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-soupsieve. 2024-08-17T02:22:56.839 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../042-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-08-17T02:22:56.882 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-08-17T02:22:57.192 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-bs4. 2024-08-17T02:22:57.212 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../043-python3-bs4_4.8.2-1_all.deb ... 2024-08-17T02:22:57.250 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-08-17T02:22:57.621 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-waitress. 2024-08-17T02:22:57.637 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../044-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-08-17T02:22:57.707 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-08-17T02:22:58.066 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph. 2024-08-17T02:22:58.073 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-tempita. 2024-08-17T02:22:58.081 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../056-ceph_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:58.090 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../045-python3-tempita_0.5.2-6_all.deb ... 2024-08-17T02:22:58.122 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:58.131 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-08-17T02:22:58.439 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-paste. 2024-08-17T02:22:58.460 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../046-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-08-17T02:22:58.498 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-08-17T02:22:58.499 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-fuse. 2024-08-17T02:22:58.518 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../057-ceph-fuse_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:58.558 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:58.834 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-08-17T02:22:58.851 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../047-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-08-17T02:22:58.892 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-08-17T02:22:59.044 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mds. 2024-08-17T02:22:59.060 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../058-ceph-mds_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:59.102 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mds (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:59.228 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pastedeploy. 2024-08-17T02:22:59.246 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../048-python3-pastedeploy_2.1.0-1_all.deb ... 2024-08-17T02:22:59.312 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-08-17T02:22:59.638 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package cephadm. 2024-08-17T02:22:59.639 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-webtest. 2024-08-17T02:22:59.654 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../059-cephadm_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:59.655 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../049-python3-webtest_2.0.32-2_all.deb ... 2024-08-17T02:22:59.698 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:59.698 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-08-17T02:23:00.017 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pecan. 2024-08-17T02:23:00.031 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../050-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-08-17T02:23:00.059 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-jinja2. 2024-08-17T02:23:00.075 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-08-17T02:23:00.077 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../060-python3-jinja2_2.10.1-2ubuntu0.3_all.deb ... 2024-08-17T02:23:00.133 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-08-17T02:23:00.439 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-werkzeug. 2024-08-17T02:23:00.455 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../051-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.2_all.deb ... 2024-08-17T02:23:00.486 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-08-17T02:23:00.497 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-08-17T02:23:00.503 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../061-ceph-mgr-cephadm_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:00.544 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mgr-cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:00.859 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-08-17T02:23:00.874 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../052-libsqlite3-mod-ceph_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:00.950 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libsqlite3-mod-ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:00.972 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-repoze.lru. 2024-08-17T02:23:00.988 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2024-08-17T02:23:01.030 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-08-17T02:23:01.307 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libjs-underscore. 2024-08-17T02:23:01.326 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-08-17T02:23:01.390 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-08-17T02:23:01.648 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr. 2024-08-17T02:23:01.666 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../053-ceph-mgr_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:01.706 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:01.710 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-08-17T02:23:01.727 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-08-17T02:23:01.759 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-08-17T02:23:02.087 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-routes. 2024-08-17T02:23:02.104 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2024-08-17T02:23:02.145 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-08-17T02:23:02.168 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mon. 2024-08-17T02:23:02.185 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../054-ceph-mon_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:02.259 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mon (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:02.515 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-08-17T02:23:02.534 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:02.572 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mgr-dashboard (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:03.071 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-osd. 2024-08-17T02:23:03.091 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../055-ceph-osd_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:03.129 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-osd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:03.936 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-decorator. 2024-08-17T02:23:03.952 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-08-17T02:23:03.994 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-08-17T02:23:04.330 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-08-17T02:23:04.347 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-08-17T02:23:04.413 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-08-17T02:23:04.724 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-scipy. 2024-08-17T02:23:04.740 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-08-17T02:23:04.782 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-08-17T02:23:05.149 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph. 2024-08-17T02:23:05.166 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../056-ceph_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:05.207 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:05.518 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-fuse. 2024-08-17T02:23:05.536 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../057-ceph-fuse_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:05.601 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:06.071 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mds. 2024-08-17T02:23:06.092 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../058-ceph-mds_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:06.109 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-08-17T02:23:06.127 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-08-17T02:23:06.129 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mds (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:06.167 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-08-17T02:23:06.717 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package cephadm. 2024-08-17T02:23:06.736 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../059-cephadm_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:06.737 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-joblib. 2024-08-17T02:23:06.755 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2024-08-17T02:23:06.774 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:06.786 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-08-17T02:23:07.077 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-jinja2. 2024-08-17T02:23:07.096 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../060-python3-jinja2_2.10.1-2ubuntu0.3_all.deb ... 2024-08-17T02:23:07.127 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-08-17T02:23:07.215 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-sklearn. 2024-08-17T02:23:07.234 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-08-17T02:23:07.273 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-08-17T02:23:07.413 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-08-17T02:23:07.432 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../061-ceph-mgr-cephadm_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:07.498 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:07.816 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-repoze.lru. 2024-08-17T02:23:07.836 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2024-08-17T02:23:07.866 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-08-17T02:23:08.064 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-08-17T02:23:08.081 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:08.122 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:08.135 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libjs-underscore. 2024-08-17T02:23:08.155 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-08-17T02:23:08.193 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-08-17T02:23:08.479 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-08-17T02:23:08.497 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-08-17T02:23:08.537 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-08-17T02:23:08.890 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-routes. 2024-08-17T02:23:08.906 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2024-08-17T02:23:08.948 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-08-17T02:23:09.275 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-cachetools. 2024-08-17T02:23:09.292 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2024-08-17T02:23:09.326 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-08-17T02:23:09.333 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-08-17T02:23:09.342 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:09.409 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-dashboard (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:09.669 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pyasn1. 2024-08-17T02:23:09.687 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-08-17T02:23:09.752 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-08-17T02:23:10.105 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-08-17T02:23:10.121 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-08-17T02:23:10.163 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-08-17T02:23:10.482 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-rsa. 2024-08-17T02:23:10.502 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2024-08-17T02:23:10.540 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-rsa (4.0-3) ... 2024-08-17T02:23:10.823 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-decorator. 2024-08-17T02:23:10.841 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-08-17T02:23:10.881 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-08-17T02:23:10.902 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-google-auth. 2024-08-17T02:23:10.918 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2024-08-17T02:23:10.960 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-08-17T02:23:11.192 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-08-17T02:23:11.209 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-08-17T02:23:11.250 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-08-17T02:23:11.305 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-blinker. 2024-08-17T02:23:11.321 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-08-17T02:23:11.362 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-08-17T02:23:11.577 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-scipy. 2024-08-17T02:23:11.596 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-08-17T02:23:11.635 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-08-17T02:23:11.707 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-oauthlib. 2024-08-17T02:23:11.726 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-08-17T02:23:11.765 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-08-17T02:23:12.196 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-08-17T02:23:12.212 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-08-17T02:23:12.288 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-08-17T02:23:12.624 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-websocket. 2024-08-17T02:23:12.643 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-08-17T02:23:12.682 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-08-17T02:23:12.987 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-08-17T02:23:13.005 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-08-17T02:23:13.019 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-kubernetes. 2024-08-17T02:23:13.036 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-08-17T02:23:13.062 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-08-17T02:23:13.085 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-08-17T02:23:13.591 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-joblib. 2024-08-17T02:23:13.608 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2024-08-17T02:23:13.657 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-08-17T02:23:13.677 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:13.682 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-08-17T02:23:13.715 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mgr-k8sevents (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:14.044 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-sklearn. 2024-08-17T02:23:14.044 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libonig5:amd64. 2024-08-17T02:23:14.062 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2024-08-17T02:23:14.064 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-08-17T02:23:14.102 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-08-17T02:23:14.102 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-08-17T02:23:14.504 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libjq1:amd64. 2024-08-17T02:23:14.520 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-08-17T02:23:14.562 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:23:14.835 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-08-17T02:23:14.851 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:14.852 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package jq. 2024-08-17T02:23:14.869 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-08-17T02:23:14.893 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:14.910 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:23:15.188 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package socat. 2024-08-17T02:23:15.206 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2024-08-17T02:23:15.271 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking socat (1.7.3.3-2) ... 2024-08-17T02:23:15.599 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package xmlstarlet. 2024-08-17T02:23:15.615 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-08-17T02:23:15.656 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-08-17T02:23:16.079 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cachetools. 2024-08-17T02:23:16.086 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-test. 2024-08-17T02:23:16.095 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2024-08-17T02:23:16.106 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../090-ceph-test_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:16.137 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-08-17T02:23:16.144 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-test (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:16.456 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pyasn1. 2024-08-17T02:23:16.476 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-08-17T02:23:16.514 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-08-17T02:23:16.901 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-08-17T02:23:16.920 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-08-17T02:23:16.959 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-08-17T02:23:17.304 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rsa. 2024-08-17T02:23:17.319 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2024-08-17T02:23:17.361 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rsa (4.0-3) ... 2024-08-17T02:23:17.715 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-google-auth. 2024-08-17T02:23:17.733 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2024-08-17T02:23:17.773 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-08-17T02:23:18.164 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-blinker. 2024-08-17T02:23:18.184 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-08-17T02:23:18.234 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-08-17T02:23:18.528 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-oauthlib. 2024-08-17T02:23:18.548 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-08-17T02:23:18.586 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-08-17T02:23:19.018 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-08-17T02:23:19.034 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-08-17T02:23:19.076 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-08-17T02:23:19.404 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-websocket. 2024-08-17T02:23:19.424 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-08-17T02:23:19.487 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-08-17T02:23:19.825 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-kubernetes. 2024-08-17T02:23:19.841 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-08-17T02:23:19.883 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-08-17T02:23:20.472 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-08-17T02:23:20.492 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:20.530 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-k8sevents (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:20.807 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-volume. 2024-08-17T02:23:20.823 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../091-ceph-volume_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:20.865 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-volume (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:20.874 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libonig5:amd64. 2024-08-17T02:23:20.893 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2024-08-17T02:23:20.932 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-08-17T02:23:21.289 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package cephfs-mirror. 2024-08-17T02:23:21.305 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libjq1:amd64. 2024-08-17T02:23:21.306 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../092-cephfs-mirror_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:21.324 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-08-17T02:23:21.363 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:23:21.364 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking cephfs-mirror (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:21.658 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package jq. 2024-08-17T02:23:21.674 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-08-17T02:23:21.733 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-colorama. 2024-08-17T02:23:21.741 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:23:21.749 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2024-08-17T02:23:21.783 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2024-08-17T02:23:22.002 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package socat. 2024-08-17T02:23:22.019 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2024-08-17T02:23:22.077 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking socat (1.7.3.3-2) ... 2024-08-17T02:23:22.320 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package cephfs-shell. 2024-08-17T02:23:22.339 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../094-cephfs-shell_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:22.378 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking cephfs-shell (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:22.413 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package xmlstarlet. 2024-08-17T02:23:22.433 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-08-17T02:23:22.471 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-08-17T02:23:22.654 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package cephfs-top. 2024-08-17T02:23:22.671 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../095-cephfs-top_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:22.713 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking cephfs-top (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:22.852 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-test. 2024-08-17T02:23:22.869 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../090-ceph-test_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:22.909 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-test (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:22.992 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package fonts-mathjax. 2024-08-17T02:23:23.009 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-08-17T02:23:23.075 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:23:23.628 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libcephfs-dev. 2024-08-17T02:23:23.645 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../097-libcephfs-dev_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:23.687 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libcephfs-dev (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:24.098 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package nvme-cli. 2024-08-17T02:23:24.118 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-08-17T02:23:24.198 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-08-17T02:23:24.552 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libjs-mathjax. 2024-08-17T02:23:24.571 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../099-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-08-17T02:23:24.610 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:23:26.327 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python-natsort-doc. 2024-08-17T02:23:26.348 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../100-python-natsort-doc_7.0.1-1_all.deb ... 2024-08-17T02:23:26.384 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-08-17T02:23:26.771 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-atomicwrites. 2024-08-17T02:23:26.791 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../101-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-08-17T02:23:26.829 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-08-17T02:23:27.157 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-attr. 2024-08-17T02:23:27.173 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../102-python3-attr_19.3.0-2_all.deb ... 2024-08-17T02:23:27.215 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-08-17T02:23:27.530 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-volume. 2024-08-17T02:23:27.547 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../091-ceph-volume_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:27.588 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-webencodings. 2024-08-17T02:23:27.607 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../103-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-08-17T02:23:27.613 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-volume (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:27.650 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-08-17T02:23:28.003 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-html5lib. 2024-08-17T02:23:28.020 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../104-python3-html5lib_1.0.1-2_all.deb ... 2024-08-17T02:23:28.030 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package cephfs-mirror. 2024-08-17T02:23:28.046 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../092-cephfs-mirror_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:28.061 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-08-17T02:23:28.088 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking cephfs-mirror (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:28.414 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-08-17T02:23:28.432 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../105-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-08-17T02:23:28.434 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-colorama. 2024-08-17T02:23:28.450 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2024-08-17T02:23:28.492 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2024-08-17T02:23:28.497 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-08-17T02:23:28.770 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package cephfs-shell. 2024-08-17T02:23:28.786 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../094-cephfs-shell_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:28.828 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking cephfs-shell (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:28.992 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pastescript. 2024-08-17T02:23:29.009 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-08-17T02:23:29.075 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-08-17T02:23:29.139 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package cephfs-top. 2024-08-17T02:23:29.157 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../095-cephfs-top_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:29.222 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking cephfs-top (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:29.428 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pluggy. 2024-08-17T02:23:29.445 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2024-08-17T02:23:29.458 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package fonts-mathjax. 2024-08-17T02:23:29.477 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-08-17T02:23:29.486 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-08-17T02:23:29.549 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:23:29.839 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-psutil. 2024-08-17T02:23:29.859 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-08-17T02:23:29.897 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-08-17T02:23:30.053 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libcephfs-dev. 2024-08-17T02:23:30.070 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../097-libcephfs-dev_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:30.111 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libcephfs-dev (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:30.258 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-py. 2024-08-17T02:23:30.276 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-08-17T02:23:30.316 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-08-17T02:23:30.547 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package nvme-cli. 2024-08-17T02:23:30.566 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-08-17T02:23:30.623 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-08-17T02:23:30.703 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pyinotify. 2024-08-17T02:23:30.721 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-08-17T02:23:30.752 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-08-17T02:23:30.960 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libjs-mathjax. 2024-08-17T02:23:30.978 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../099-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-08-17T02:23:31.018 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:23:31.089 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pytest. 2024-08-17T02:23:31.105 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2024-08-17T02:23:31.147 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-08-17T02:23:31.533 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-simplejson. 2024-08-17T02:23:31.552 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-08-17T02:23:31.591 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-08-17T02:23:31.885 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-08-17T02:23:31.903 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-08-17T02:23:31.943 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-08-17T02:23:32.926 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package radosgw. 2024-08-17T02:23:32.942 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../114-radosgw_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:32.983 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking radosgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:33.395 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python-natsort-doc. 2024-08-17T02:23:33.413 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../100-python-natsort-doc_7.0.1-1_all.deb ... 2024-08-17T02:23:33.453 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-08-17T02:23:33.823 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-atomicwrites. 2024-08-17T02:23:33.844 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../101-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-08-17T02:23:33.881 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-08-17T02:23:34.192 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-attr. 2024-08-17T02:23:34.210 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../102-python3-attr_19.3.0-2_all.deb ... 2024-08-17T02:23:34.250 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-08-17T02:23:34.612 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-webencodings. 2024-08-17T02:23:34.633 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../103-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-08-17T02:23:34.670 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-08-17T02:23:34.761 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package rbd-fuse. 2024-08-17T02:23:34.781 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../115-rbd-fuse_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:34.820 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking rbd-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:35.006 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-html5lib. 2024-08-17T02:23:35.023 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../104-python3-html5lib_1.0.1-2_all.deb ... 2024-08-17T02:23:35.064 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-08-17T02:23:35.156 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-attr (19.3.0-2) ... 2024-08-17T02:23:35.467 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-08-17T02:23:35.486 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../105-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-08-17T02:23:35.493 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-08-17T02:23:35.525 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-08-17T02:23:35.626 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-08-17T02:23:35.776 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-08-17T02:23:35.978 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:36.012 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pastescript. 2024-08-17T02:23:36.032 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-08-17T02:23:36.087 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-08-17T02:23:36.407 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pluggy. 2024-08-17T02:23:36.424 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2024-08-17T02:23:36.465 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-08-17T02:23:36.658 INFO:teuthology.orchestra.run.smithi174.stdout:Adding system user cephadm....done 2024-08-17T02:23:36.801 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-psutil. 2024-08-17T02:23:36.811 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:23:36.819 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-08-17T02:23:36.859 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-08-17T02:23:36.962 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-08-17T02:23:37.204 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-py. 2024-08-17T02:23:37.222 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-08-17T02:23:37.262 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-08-17T02:23:37.322 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-08-17T02:23:37.615 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pyinotify. 2024-08-17T02:23:37.636 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-08-17T02:23:37.657 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:23:37.690 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-08-17T02:23:37.807 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-08-17T02:23:37.933 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-08-17T02:23:38.043 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pytest. 2024-08-17T02:23:38.062 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2024-08-17T02:23:38.101 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-08-17T02:23:38.293 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-08-17T02:23:38.472 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-simplejson. 2024-08-17T02:23:38.493 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-08-17T02:23:38.529 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-08-17T02:23:38.738 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-08-17T02:23:38.835 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-08-17T02:23:38.855 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-08-17T02:23:38.902 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-08-17T02:23:39.090 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-08-17T02:23:39.415 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2024-08-17T02:23:39.698 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package radosgw. 2024-08-17T02:23:39.700 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-08-17T02:23:39.715 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../114-radosgw_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:39.755 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking radosgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:39.984 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-08-17T02:23:40.294 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-ceph-argparse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:40.578 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-08-17T02:23:40.737 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2024-08-17T02:23:41.038 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-08-17T02:23:41.323 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-08-17T02:23:41.542 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package rbd-fuse. 2024-08-17T02:23:41.560 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../115-rbd-fuse_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:41.607 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-08-17T02:23:41.625 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking rbd-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:41.733 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-08-17T02:23:41.936 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-attr (19.3.0-2) ... 2024-08-17T02:23:42.134 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-08-17T02:23:42.280 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-08-17T02:23:42.398 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-08-17T02:23:42.426 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-08-17T02:23:42.527 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-08-17T02:23:42.703 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-08-17T02:23:42.753 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:43.012 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-08-17T02:23:43.313 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-08-17T02:23:43.356 INFO:teuthology.orchestra.run.smithi153.stdout:Adding system user cephadm....done 2024-08-17T02:23:43.517 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:23:43.677 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-08-17T02:23:43.689 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-08-17T02:23:43.982 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-packaging (20.3-1) ... 2024-08-17T02:23:44.020 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-08-17T02:23:44.283 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-08-17T02:23:44.314 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:23:44.409 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-08-17T02:23:44.440 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-08-17T02:23:44.560 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-08-17T02:23:44.591 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-08-17T02:23:44.836 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-08-17T02:23:44.927 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-08-17T02:23:45.237 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2024-08-17T02:23:45.321 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-08-17T02:23:45.597 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-08-17T02:23:45.613 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-08-17T02:23:45.890 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2024-08-17T02:23:45.965 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-08-17T02:23:46.199 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-08-17T02:23:46.325 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up socat (1.7.3.3-2) ... 2024-08-17T02:23:46.475 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:46.500 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-08-17T02:23:46.810 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:23:46.834 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-ceph-argparse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:46.978 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-08-17T02:23:47.144 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-08-17T02:23:47.270 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2024-08-17T02:23:47.329 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-08-17T02:23:47.455 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-08-17T02:23:47.562 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-08-17T02:23:47.614 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-08-17T02:23:47.830 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-08-17T02:23:47.907 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-08-17T02:23:48.115 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-08-17T02:23:48.225 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:23:48.240 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-08-17T02:23:48.384 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-08-17T02:23:48.510 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-08-17T02:23:48.592 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-08-17T02:23:48.878 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-08-17T02:23:48.901 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-08-17T02:23:49.163 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-08-17T02:23:49.202 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-08-17T02:23:49.455 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-08-17T02:23:49.545 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-08-17T02:23:49.581 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-08-17T02:23:49.821 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-08-17T02:23:49.874 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-08-17T02:23:50.141 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-08-17T02:23:50.200 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-08-17T02:23:50.423 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-packaging (20.3-1) ... 2024-08-17T02:23:50.543 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-08-17T02:23:50.716 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-08-17T02:23:50.842 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-08-17T02:23:50.883 INFO:teuthology.orchestra.run.smithi174.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-08-17T02:23:51.010 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-08-17T02:23:51.154 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-08-17T02:23:51.271 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-08-17T02:23:51.328 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-08-17T02:23:51.639 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-08-17T02:23:51.721 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2024-08-17T02:23:51.999 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-08-17T02:23:52.005 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-08-17T02:23:52.166 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-08-17T02:23:52.292 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-08-17T02:23:52.365 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-08-17T02:23:52.701 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-08-17T02:23:52.733 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up socat (1.7.3.3-2) ... 2024-08-17T02:23:52.893 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:52.986 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up librados2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:53.112 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-08-17T02:23:53.236 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:23:53.371 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-08-17T02:23:53.722 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-08-17T02:23:53.839 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-08-17T02:23:53.990 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-08-17T02:23:54.283 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-08-17T02:23:54.567 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libsqlite3-mod-ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:54.584 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:23:54.718 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:23:54.718 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-08-17T02:23:54.844 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-08-17T02:23:54.870 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-08-17T02:23:55.196 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-08-17T02:23:55.220 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-08-17T02:23:55.489 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-08-17T02:23:55.505 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-08-17T02:23:55.781 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:23:55.795 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-08-17T02:23:55.907 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-08-17T02:23:55.924 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-08-17T02:23:56.209 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-08-17T02:23:56.299 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libcephfs2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:56.426 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-08-17T02:23:56.494 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-08-17T02:23:56.790 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libradosstriper1 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:56.794 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-08-17T02:23:56.922 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-08-17T02:23:57.202 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-08-17T02:23:57.254 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-08-17T02:23:57.464 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-08-17T02:23:57.565 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-08-17T02:23:57.866 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-08-17T02:23:58.226 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-08-17T02:23:58.326 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up librbd1 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:58.377 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-08-17T02:23:58.477 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-08-17T02:23:58.503 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-08-17T02:23:58.603 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-08-17T02:23:58.737 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:23:58.821 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-08-17T02:23:58.863 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-rsa (4.0-3) ... 2024-08-17T02:23:59.089 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librados2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:59.190 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-08-17T02:23:59.207 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-08-17T02:23:59.340 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-08-17T02:23:59.777 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mgr-modules-core (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:59.886 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:00.106 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-17T02:24:00.106 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-17T02:24:00.587 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libcephfs-dev (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:00.646 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libsqlite3-mod-ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:00.713 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-08-17T02:24:00.755 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:24:00.856 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-08-17T02:24:01.024 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-08-17T02:24:01.257 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-08-17T02:24:01.399 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-08-17T02:24:01.592 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-08-17T02:24:01.768 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-rados (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:01.918 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:24:01.919 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up librgw2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:02.037 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up cephfs-top (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:02.044 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-08-17T02:24:02.196 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-rbd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:02.322 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up rbd-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:02.404 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libcephfs2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:02.482 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-routes (2.4.1-2) ... 2024-08-17T02:24:02.522 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-08-17T02:24:02.791 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-08-17T02:24:02.890 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libradosstriper1 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:03.016 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-08-17T02:24:03.101 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-rgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:03.260 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-cephfs (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:03.351 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-08-17T02:24:03.386 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up cephfs-shell (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:03.562 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-08-17T02:24:04.490 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:04.765 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librbd1 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:04.899 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-08-17T02:24:05.025 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-08-17T02:24:05.092 INFO:teuthology.orchestra.run.smithi174.stdout:Adding group ceph....done 2024-08-17T02:24:05.176 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:24:05.319 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rsa (4.0-3) ... 2024-08-17T02:24:05.494 INFO:teuthology.orchestra.run.smithi174.stdout:Adding system user ceph....done 2024-08-17T02:24:05.628 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-08-17T02:24:05.695 INFO:teuthology.orchestra.run.smithi174.stdout:Setting system user ceph properties....done 2024-08-17T02:24:05.715 INFO:teuthology.orchestra.run.smithi174.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-08-17T02:24:05.755 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-08-17T02:24:05.867 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-08-17T02:24:06.149 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-modules-core (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:06.176 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-08-17T02:24:06.275 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:06.512 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-17T02:24:06.513 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-17T02:24:06.633 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up cephfs-mirror (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:06.881 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:24:06.881 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:24:06.977 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libcephfs-dev (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:07.136 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-08-17T02:24:07.309 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-test (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:07.426 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up radosgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:07.438 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-08-17T02:24:07.733 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:24:07.733 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:24:07.756 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-08-17T02:24:08.125 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rados (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:08.243 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librgw2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:08.386 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up cephfs-top (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:08.386 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-base (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:08.512 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rbd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:08.662 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up rbd-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:08.770 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-08-17T02:24:08.789 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-routes (2.4.1-2) ... 2024-08-17T02:24:09.090 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-08-17T02:24:09.216 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mds (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:09.400 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:09.430 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-17T02:24:09.430 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-17T02:24:09.526 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cephfs (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:09.677 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up cephfs-shell (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:09.803 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-08-17T02:24:09.868 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mgr (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:10.115 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-17T02:24:10.115 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-17T02:24:10.553 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-osd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:10.723 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:11.042 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-17T02:24:11.042 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-17T02:24:11.309 INFO:teuthology.orchestra.run.smithi153.stdout:Adding group ceph....done 2024-08-17T02:24:11.496 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mgr-k8sevents (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:11.647 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mgr-diskprediction-local (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:11.718 INFO:teuthology.orchestra.run.smithi153.stdout:Adding system user ceph....done 2024-08-17T02:24:11.798 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mon (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:11.912 INFO:teuthology.orchestra.run.smithi153.stdout:Setting system user ceph properties....done 2024-08-17T02:24:11.935 INFO:teuthology.orchestra.run.smithi153.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-08-17T02:24:12.055 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-17T02:24:12.056 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-17T02:24:12.082 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-08-17T02:24:12.410 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-08-17T02:24:12.499 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mgr-cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:12.634 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:12.784 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mgr-dashboard (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:12.874 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up cephfs-mirror (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:12.927 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-volume (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:13.087 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-08-17T02:24:13.091 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:24:13.091 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:24:13.239 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-08-17T02:24:13.542 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-test (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:13.599 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-08-17T02:24:13.676 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up radosgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:13.970 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:24:13.970 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:24:14.628 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-base (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:15.037 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-08-17T02:24:15.505 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mds (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:15.718 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-17T02:24:15.718 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-17T02:24:16.165 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:16.374 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-17T02:24:16.374 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-17T02:24:16.484 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-08-17T02:24:16.841 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-osd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:17.109 INFO:teuthology.orchestra.run.smithi174.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-17T02:24:17.112 DEBUG:teuthology.orchestra.run.smithi174:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-08-17T02:24:17.188 INFO:teuthology.orchestra.run.smithi174.stdout:Reading package lists... 2024-08-17T02:24:17.358 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-17T02:24:17.359 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-17T02:24:17.408 INFO:teuthology.orchestra.run.smithi174.stdout:Building dependency tree... 2024-08-17T02:24:17.409 INFO:teuthology.orchestra.run.smithi174.stdout:Reading state information... 2024-08-17T02:24:17.623 INFO:teuthology.orchestra.run.smithi174.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-08-17T02:24:17.623 INFO:teuthology.orchestra.run.smithi174.stdout:flex is already the newest version (2.6.4-6.2). 2024-08-17T02:24:17.623 INFO:teuthology.orchestra.run.smithi174.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2024-08-17T02:24:17.623 INFO:teuthology.orchestra.run.smithi174.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-08-17T02:24:17.623 INFO:teuthology.orchestra.run.smithi174.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-08-17T02:24:17.623 INFO:teuthology.orchestra.run.smithi174.stdout:The following packages were automatically installed and are no longer required: 2024-08-17T02:24:17.624 INFO:teuthology.orchestra.run.smithi174.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-08-17T02:24:17.624 INFO:teuthology.orchestra.run.smithi174.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-17T02:24:17.624 INFO:teuthology.orchestra.run.smithi174.stdout:The following additional packages will be installed: 2024-08-17T02:24:17.625 INFO:teuthology.orchestra.run.smithi174.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2024-08-17T02:24:17.625 INFO:teuthology.orchestra.run.smithi174.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2024-08-17T02:24:17.625 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2024-08-17T02:24:17.625 INFO:teuthology.orchestra.run.smithi174.stdout: usb-modeswitch-data wpasupplicant 2024-08-17T02:24:17.627 INFO:teuthology.orchestra.run.smithi174.stdout:Suggested packages: 2024-08-17T02:24:17.627 INFO:teuthology.orchestra.run.smithi174.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2024-08-17T02:24:17.627 INFO:teuthology.orchestra.run.smithi174.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-08-17T02:24:17.678 INFO:teuthology.orchestra.run.smithi174.stdout:The following NEW packages will be installed: 2024-08-17T02:24:17.678 INFO:teuthology.orchestra.run.smithi174.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2024-08-17T02:24:17.678 INFO:teuthology.orchestra.run.smithi174.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2024-08-17T02:24:17.679 INFO:teuthology.orchestra.run.smithi174.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2024-08-17T02:24:17.679 INFO:teuthology.orchestra.run.smithi174.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2024-08-17T02:24:17.680 INFO:teuthology.orchestra.run.smithi174.stdout:The following packages will be upgraded: 2024-08-17T02:24:17.681 INFO:teuthology.orchestra.run.smithi174.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2024-08-17T02:24:17.737 INFO:teuthology.orchestra.run.smithi174.stdout:6 upgraded, 23 newly installed, 0 to remove and 289 not upgraded. 2024-08-17T02:24:17.737 INFO:teuthology.orchestra.run.smithi174.stdout:Need to get 10.4 MB of archives. 2024-08-17T02:24:17.738 INFO:teuthology.orchestra.run.smithi174.stdout:After this operation, 33.5 MB of additional disk space will be used. 2024-08-17T02:24:17.738 INFO:teuthology.orchestra.run.smithi174.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.6 [1,022 kB] 2024-08-17T02:24:17.801 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-k8sevents (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:17.868 INFO:teuthology.orchestra.run.smithi174.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-08-17T02:24:17.870 INFO:teuthology.orchestra.run.smithi174.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-08-17T02:24:17.870 INFO:teuthology.orchestra.run.smithi174.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-08-17T02:24:17.876 INFO:teuthology.orchestra.run.smithi174.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-08-17T02:24:17.877 INFO:teuthology.orchestra.run.smithi174.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.23 [1,323 kB] 2024-08-17T02:24:17.893 INFO:teuthology.orchestra.run.smithi174.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2024-08-17T02:24:17.893 INFO:teuthology.orchestra.run.smithi174.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2024-08-17T02:24:17.895 INFO:teuthology.orchestra.run.smithi174.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2024-08-17T02:24:17.896 INFO:teuthology.orchestra.run.smithi174.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-08-17T02:24:17.896 INFO:teuthology.orchestra.run.smithi174.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.8 [60.6 kB] 2024-08-17T02:24:17.902 INFO:teuthology.orchestra.run.smithi174.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-08-17T02:24:17.903 INFO:teuthology.orchestra.run.smithi174.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2024-08-17T02:24:17.904 INFO:teuthology.orchestra.run.smithi174.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2024-08-17T02:24:17.904 INFO:teuthology.orchestra.run.smithi174.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2024-08-17T02:24:17.919 INFO:teuthology.orchestra.run.smithi174.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libndp0 amd64 1.7-0ubuntu1.1 [11.1 kB] 2024-08-17T02:24:17.919 INFO:teuthology.orchestra.run.smithi174.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.4 [370 kB] 2024-08-17T02:24:17.924 INFO:teuthology.orchestra.run.smithi174.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2024-08-17T02:24:17.932 INFO:teuthology.orchestra.run.smithi174.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2024-08-17T02:24:17.932 INFO:teuthology.orchestra.run.smithi174.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.23 [1,586 kB] 2024-08-17T02:24:17.947 INFO:teuthology.orchestra.run.smithi174.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2024-08-17T02:24:17.947 INFO:teuthology.orchestra.run.smithi174.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2024-08-17T02:24:17.952 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-diskprediction-local (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:17.955 INFO:teuthology.orchestra.run.smithi174.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.4 [1,184 kB] 2024-08-17T02:24:17.965 INFO:teuthology.orchestra.run.smithi174.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.4 [1,854 kB] 2024-08-17T02:24:17.980 INFO:teuthology.orchestra.run.smithi174.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2024-08-17T02:24:17.983 INFO:teuthology.orchestra.run.smithi174.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2024-08-17T02:24:17.983 INFO:teuthology.orchestra.run.smithi174.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2024-08-17T02:24:17.983 INFO:teuthology.orchestra.run.smithi174.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2024-08-17T02:24:17.983 INFO:teuthology.orchestra.run.smithi174.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2024-08-17T02:24:18.079 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mon (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:18.295 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-17T02:24:18.295 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-17T02:24:18.300 INFO:teuthology.orchestra.run.smithi174.stdout:Preconfiguring packages ... 2024-08-17T02:24:18.435 INFO:teuthology.orchestra.run.smithi174.stdout:Fetched 10.4 MB in 0s (35.4 MB/s) 2024-08-17T02:24:18.729 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:18.734 INFO:teuthology.orchestra.run.smithi174.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-17T02:24:18.739 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-17T02:24:18.847 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:18.982 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-dashboard (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:19.062 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking util-linux (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-17T02:24:19.116 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-volume (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:19.293 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-08-17T02:24:19.629 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-08-17T02:24:19.931 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-08-17T02:24:20.268 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up util-linux (2.34-0.1ubuntu9.6) ... 2024-08-17T02:24:21.696 INFO:teuthology.orchestra.run.smithi174.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-17T02:24:21.700 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-17T02:24:21.859 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-17T02:24:22.292 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-17T02:24:22.481 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-17T02:24:22.800 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-08-17T02:24:22.833 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-08-17T02:24:23.343 INFO:teuthology.orchestra.run.smithi174.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-17T02:24:23.347 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-17T02:24:23.435 INFO:teuthology.orchestra.run.smithi153.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-17T02:24:23.437 DEBUG:teuthology.orchestra.run.smithi153:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-08-17T02:24:23.489 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-08-17T02:24:23.511 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-08-17T02:24:23.728 INFO:teuthology.orchestra.run.smithi153.stdout:Building dependency tree... 2024-08-17T02:24:23.729 INFO:teuthology.orchestra.run.smithi153.stdout:Reading state information... 2024-08-17T02:24:23.953 INFO:teuthology.orchestra.run.smithi153.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-08-17T02:24:23.953 INFO:teuthology.orchestra.run.smithi153.stdout:flex is already the newest version (2.6.4-6.2). 2024-08-17T02:24:23.953 INFO:teuthology.orchestra.run.smithi153.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2024-08-17T02:24:23.953 INFO:teuthology.orchestra.run.smithi153.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-08-17T02:24:23.953 INFO:teuthology.orchestra.run.smithi153.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-08-17T02:24:23.953 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages were automatically installed and are no longer required: 2024-08-17T02:24:23.954 INFO:teuthology.orchestra.run.smithi153.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-08-17T02:24:23.954 INFO:teuthology.orchestra.run.smithi153.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-17T02:24:23.954 INFO:teuthology.orchestra.run.smithi153.stdout:The following additional packages will be installed: 2024-08-17T02:24:23.955 INFO:teuthology.orchestra.run.smithi153.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2024-08-17T02:24:23.955 INFO:teuthology.orchestra.run.smithi153.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2024-08-17T02:24:23.955 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2024-08-17T02:24:23.955 INFO:teuthology.orchestra.run.smithi153.stdout: usb-modeswitch-data wpasupplicant 2024-08-17T02:24:23.957 INFO:teuthology.orchestra.run.smithi153.stdout:Suggested packages: 2024-08-17T02:24:23.957 INFO:teuthology.orchestra.run.smithi153.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2024-08-17T02:24:23.957 INFO:teuthology.orchestra.run.smithi153.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-08-17T02:24:23.996 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-17T02:24:24.013 INFO:teuthology.orchestra.run.smithi153.stdout:The following NEW packages will be installed: 2024-08-17T02:24:24.013 INFO:teuthology.orchestra.run.smithi153.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2024-08-17T02:24:24.014 INFO:teuthology.orchestra.run.smithi153.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2024-08-17T02:24:24.014 INFO:teuthology.orchestra.run.smithi153.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2024-08-17T02:24:24.014 INFO:teuthology.orchestra.run.smithi153.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2024-08-17T02:24:24.015 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages will be upgraded: 2024-08-17T02:24:24.017 INFO:teuthology.orchestra.run.smithi153.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2024-08-17T02:24:24.073 INFO:teuthology.orchestra.run.smithi153.stdout:6 upgraded, 23 newly installed, 0 to remove and 289 not upgraded. 2024-08-17T02:24:24.073 INFO:teuthology.orchestra.run.smithi153.stdout:Need to get 10.4 MB of archives. 2024-08-17T02:24:24.073 INFO:teuthology.orchestra.run.smithi153.stdout:After this operation, 33.5 MB of additional disk space will be used. 2024-08-17T02:24:24.073 INFO:teuthology.orchestra.run.smithi153.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.6 [1,022 kB] 2024-08-17T02:24:24.145 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-08-17T02:24:24.203 INFO:teuthology.orchestra.run.smithi153.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-08-17T02:24:24.204 INFO:teuthology.orchestra.run.smithi153.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-08-17T02:24:24.205 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-08-17T02:24:24.211 INFO:teuthology.orchestra.run.smithi153.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-08-17T02:24:24.211 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.23 [1,323 kB] 2024-08-17T02:24:24.228 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2024-08-17T02:24:24.228 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2024-08-17T02:24:24.230 INFO:teuthology.orchestra.run.smithi153.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2024-08-17T02:24:24.231 INFO:teuthology.orchestra.run.smithi153.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-08-17T02:24:24.231 INFO:teuthology.orchestra.run.smithi153.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.8 [60.6 kB] 2024-08-17T02:24:24.236 INFO:teuthology.orchestra.run.smithi153.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-08-17T02:24:24.237 INFO:teuthology.orchestra.run.smithi153.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2024-08-17T02:24:24.239 INFO:teuthology.orchestra.run.smithi153.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2024-08-17T02:24:24.239 INFO:teuthology.orchestra.run.smithi153.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2024-08-17T02:24:24.253 INFO:teuthology.orchestra.run.smithi153.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libndp0 amd64 1.7-0ubuntu1.1 [11.1 kB] 2024-08-17T02:24:24.254 INFO:teuthology.orchestra.run.smithi153.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.4 [370 kB] 2024-08-17T02:24:24.260 INFO:teuthology.orchestra.run.smithi153.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2024-08-17T02:24:24.269 INFO:teuthology.orchestra.run.smithi153.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2024-08-17T02:24:24.269 INFO:teuthology.orchestra.run.smithi153.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.23 [1,586 kB] 2024-08-17T02:24:24.283 INFO:teuthology.orchestra.run.smithi153.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2024-08-17T02:24:24.283 INFO:teuthology.orchestra.run.smithi153.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2024-08-17T02:24:24.290 INFO:teuthology.orchestra.run.smithi153.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.4 [1,184 kB] 2024-08-17T02:24:24.300 INFO:teuthology.orchestra.run.smithi153.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.4 [1,854 kB] 2024-08-17T02:24:24.315 INFO:teuthology.orchestra.run.smithi153.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2024-08-17T02:24:24.318 INFO:teuthology.orchestra.run.smithi153.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2024-08-17T02:24:24.319 INFO:teuthology.orchestra.run.smithi153.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2024-08-17T02:24:24.319 INFO:teuthology.orchestra.run.smithi153.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2024-08-17T02:24:24.319 INFO:teuthology.orchestra.run.smithi153.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2024-08-17T02:24:24.642 INFO:teuthology.orchestra.run.smithi153.stdout:Preconfiguring packages ... 2024-08-17T02:24:24.865 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 10.4 MB in 0s (35.4 MB/s) 2024-08-17T02:24:25.154 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-17T02:24:25.159 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-17T02:24:25.302 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking util-linux (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-17T02:24:26.057 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-08-17T02:24:26.426 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.23) over (1.1.1f-1ubuntu2.16) ... 2024-08-17T02:24:26.491 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up util-linux (2.34-0.1ubuntu9.6) ... 2024-08-17T02:24:26.971 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-08-17T02:24:26.989 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2024-08-17T02:24:27.029 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2024-08-17T02:24:27.434 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package dump. 2024-08-17T02:24:27.455 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2024-08-17T02:24:27.507 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking dump (0.4b46-6) ... 2024-08-17T02:24:27.836 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package indent. 2024-08-17T02:24:27.853 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2024-08-17T02:24:27.894 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2024-08-17T02:24:27.895 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-17T02:24:27.900 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-17T02:24:28.033 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-17T02:24:28.255 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-08-17T02:24:28.272 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2024-08-17T02:24:28.338 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-08-17T02:24:28.445 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-17T02:24:28.616 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-17T02:24:28.700 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-08-17T02:24:28.717 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.8_amd64.deb ... 2024-08-17T02:24:28.758 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-08-17T02:24:28.961 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-08-17T02:24:29.061 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-08-17T02:24:29.077 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-17T02:24:29.144 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:24:29.419 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-17T02:24:29.424 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-17T02:24:29.505 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-08-17T02:24:29.522 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:24:29.572 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:24:29.581 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-08-17T02:24:29.891 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libmbim-proxy. 2024-08-17T02:24:29.909 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:24:29.974 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:24:30.336 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-08-17T02:24:30.353 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:24:30.393 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:24:30.598 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-17T02:24:30.738 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-08-17T02:24:30.797 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libndp0:amd64. 2024-08-17T02:24:30.814 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1.1_amd64.deb ... 2024-08-17T02:24:30.854 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-08-17T02:24:31.208 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libnm0:amd64. 2024-08-17T02:24:31.228 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.4_amd64.deb ... 2024-08-17T02:24:31.257 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-08-17T02:24:31.275 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-08-17T02:24:31.401 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.23) over (1.1.1f-1ubuntu2.16) ... 2024-08-17T02:24:31.913 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-08-17T02:24:31.931 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2024-08-17T02:24:31.971 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2024-08-17T02:24:32.332 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package dump. 2024-08-17T02:24:32.350 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2024-08-17T02:24:32.412 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-08-17T02:24:32.424 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking dump (0.4b46-6) ... 2024-08-17T02:24:32.432 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:24:32.470 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:24:32.752 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package indent. 2024-08-17T02:24:32.773 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2024-08-17T02:24:32.802 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2024-08-17T02:24:32.849 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libqmi-proxy. 2024-08-17T02:24:32.866 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:24:32.906 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:24:33.142 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-08-17T02:24:33.155 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-08-17T02:24:33.162 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-08-17T02:24:33.175 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2024-08-17T02:24:33.192 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-17T02:24:33.213 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-08-17T02:24:33.575 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-08-17T02:24:33.591 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.8_amd64.deb ... 2024-08-17T02:24:33.641 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-08-17T02:24:33.737 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-08-17T02:24:33.754 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2024-08-17T02:24:33.795 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2024-08-17T02:24:33.944 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-08-17T02:24:33.962 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-17T02:24:34.027 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:24:34.148 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package modemmanager. 2024-08-17T02:24:34.166 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:24:34.242 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:24:34.389 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-08-17T02:24:34.406 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:24:34.447 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:24:34.742 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libmbim-proxy. 2024-08-17T02:24:34.759 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:24:34.799 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:24:34.896 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package wpasupplicant. 2024-08-17T02:24:34.914 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.4_amd64.deb ... 2024-08-17T02:24:34.954 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-08-17T02:24:35.161 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-08-17T02:24:35.178 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:24:35.227 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:24:35.534 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package network-manager. 2024-08-17T02:24:35.553 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.4_amd64.deb ... 2024-08-17T02:24:35.649 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking network-manager (1.22.10-1ubuntu2.4) ... 2024-08-17T02:24:36.324 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libndp0:amd64. 2024-08-17T02:24:36.340 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1.1_amd64.deb ... 2024-08-17T02:24:36.407 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-08-17T02:24:36.457 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ppp. 2024-08-17T02:24:36.475 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2024-08-17T02:24:36.741 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-08-17T02:24:36.759 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libnm0:amd64. 2024-08-17T02:24:36.778 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.4_amd64.deb ... 2024-08-17T02:24:36.818 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-08-17T02:24:37.104 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package pptp-linux. 2024-08-17T02:24:37.121 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2024-08-17T02:24:37.195 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2024-08-17T02:24:37.237 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-08-17T02:24:37.255 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:24:37.295 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:24:37.615 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libqmi-proxy. 2024-08-17T02:24:37.634 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:24:37.706 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:24:37.942 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-08-17T02:24:37.961 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-08-17T02:24:38.033 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-17T02:24:38.175 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package network-manager-pptp. 2024-08-17T02:24:38.194 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2024-08-17T02:24:38.250 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2024-08-17T02:24:38.503 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-08-17T02:24:38.523 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2024-08-17T02:24:38.553 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2024-08-17T02:24:38.587 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-08-17T02:24:38.604 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2024-08-17T02:24:38.670 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2024-08-17T02:24:39.015 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package usb-modeswitch. 2024-08-17T02:24:39.033 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2024-08-17T02:24:39.057 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package modemmanager. 2024-08-17T02:24:39.077 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:24:39.083 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-08-17T02:24:39.125 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:24:39.409 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-17T02:24:39.770 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2024-08-17T02:24:39.796 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package wpasupplicant. 2024-08-17T02:24:39.813 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.4_amd64.deb ... 2024-08-17T02:24:39.854 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-08-17T02:24:39.896 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-08-17T02:24:40.055 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-08-17T02:24:40.409 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package network-manager. 2024-08-17T02:24:40.429 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.4_amd64.deb ... 2024-08-17T02:24:40.472 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-17T02:24:40.472 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-17T02:24:40.492 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking network-manager (1.22.10-1ubuntu2.4) ... 2024-08-17T02:24:40.941 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-08-17T02:24:41.101 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2024-08-17T02:24:41.141 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ppp. 2024-08-17T02:24:41.161 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2024-08-17T02:24:41.227 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-17T02:24:41.361 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2024-08-17T02:24:41.462 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-08-17T02:24:41.471 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-08-17T02:24:41.563 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-08-17T02:24:41.881 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package pptp-linux. 2024-08-17T02:24:41.901 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2024-08-17T02:24:41.939 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2024-08-17T02:24:42.325 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package network-manager-pptp. 2024-08-17T02:24:42.342 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2024-08-17T02:24:42.401 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2024-08-17T02:24:42.622 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2024-08-17T02:24:42.653 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-08-17T02:24:42.673 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2024-08-17T02:24:42.711 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2024-08-17T02:24:42.877 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up dump (0.4b46-6) ... 2024-08-17T02:24:42.997 INFO:teuthology.orchestra.run.smithi174.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-08-17T02:24:43.053 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:24:43.106 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package usb-modeswitch. 2024-08-17T02:24:43.123 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2024-08-17T02:24:43.154 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-08-17T02:24:43.200 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-08-17T02:24:43.472 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2024-08-17T02:24:43.547 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-17T02:24:43.656 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-08-17T02:24:43.866 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-08-17T02:24:43.878 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2024-08-17T02:24:43.992 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:24:44.004 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-08-17T02:24:44.143 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:24:44.155 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-08-17T02:24:44.269 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2024-08-17T02:24:44.428 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:24:44.529 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up network-manager (1.22.10-1ubuntu2.4) ... 2024-08-17T02:24:44.550 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-17T02:24:44.550 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-17T02:24:45.016 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-08-17T02:24:45.167 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2024-08-17T02:24:45.257 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-08-17T02:24:45.258 INFO:teuthology.orchestra.run.smithi174.stdout:The following network interfaces were found in /etc/network/interfaces 2024-08-17T02:24:45.258 INFO:teuthology.orchestra.run.smithi174.stdout:which means they are currently configured by ifupdown: 2024-08-17T02:24:45.258 INFO:teuthology.orchestra.run.smithi174.stdout:- enp3s0f1 2024-08-17T02:24:45.258 INFO:teuthology.orchestra.run.smithi174.stdout:If you want to manage those interfaces with NetworkManager instead 2024-08-17T02:24:45.258 INFO:teuthology.orchestra.run.smithi174.stdout:remove their configuration from /etc/network/interfaces. 2024-08-17T02:24:45.258 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-08-17T02:24:45.293 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-17T02:24:45.416 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-08-17T02:24:45.452 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2024-08-17T02:24:45.587 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-08-17T02:24:45.738 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-08-17T02:24:45.746 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-08-17T02:24:46.265 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-08-17T02:24:46.775 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2024-08-17T02:24:46.791 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:24:46.925 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2024-08-17T02:24:47.035 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up dump (0.4b46-6) ... 2024-08-17T02:24:47.093 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:24:47.114 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-08-17T02:24:47.179 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:24:47.219 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:24:47.288 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-08-17T02:24:47.370 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:24:47.439 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2024-08-17T02:24:47.496 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:24:47.565 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-08-17T02:24:47.767 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-08-17T02:24:47.806 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-08-17T02:24:47.807 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-08-17T02:24:47.892 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:24:48.044 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:24:48.170 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2024-08-17T02:24:48.341 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2024-08-17T02:24:48.363 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:24:48.472 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up network-manager (1.22.10-1ubuntu2.4) ... 2024-08-17T02:24:48.475 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-08-17T02:24:48.984 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-08-17T02:24:49.169 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-08-17T02:24:49.230 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:24:49.230 INFO:teuthology.orchestra.run.smithi153.stdout:The following network interfaces were found in /etc/network/interfaces 2024-08-17T02:24:49.230 INFO:teuthology.orchestra.run.smithi153.stdout:which means they are currently configured by ifupdown: 2024-08-17T02:24:49.230 INFO:teuthology.orchestra.run.smithi153.stdout:- enp3s0f1 2024-08-17T02:24:49.230 INFO:teuthology.orchestra.run.smithi153.stdout:If you want to manage those interfaces with NetworkManager instead 2024-08-17T02:24:49.230 INFO:teuthology.orchestra.run.smithi153.stdout:remove their configuration from /etc/network/interfaces. 2024-08-17T02:24:49.230 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:24:49.388 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-08-17T02:24:49.462 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-08-17T02:24:49.714 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-08-17T02:24:50.249 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-08-17T02:24:50.725 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:24:50.885 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2024-08-17T02:24:51.027 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:24:51.187 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:24:51.313 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:24:51.439 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:24:51.740 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-08-17T02:24:51.740 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-08-17T02:24:52.258 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2024-08-17T02:24:52.359 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-08-17T02:24:52.501 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-08-17T02:24:52.653 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-08-17T02:24:52.955 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-08-17T02:24:53.181 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-08-17T02:24:53.290 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2024-08-17T02:24:54.190 INFO:teuthology.orchestra.run.smithi174.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-17T02:24:54.196 DEBUG:teuthology.parallel:result is None 2024-08-17T02:24:57.174 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-08-17T02:24:57.282 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2024-08-17T02:24:58.147 INFO:teuthology.orchestra.run.smithi153.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-17T02:24:58.151 DEBUG:teuthology.parallel:result is None 2024-08-17T02:24:58.152 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:24:58.298 DEBUG:teuthology.orchestra.run.smithi153:> dpkg-query -W -f '${Version}' ceph 2024-08-17T02:24:58.320 INFO:teuthology.orchestra.run.smithi153.stdout:17.2.7-1375-g2577e813-1focal 2024-08-17T02:24:58.321 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375-g2577e813-1focal 2024-08-17T02:24:58.321 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375-g2577e813-1focal is installed. 2024-08-17T02:24:58.323 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:24:58.461 DEBUG:teuthology.orchestra.run.smithi174:> dpkg-query -W -f '${Version}' ceph 2024-08-17T02:24:58.486 INFO:teuthology.orchestra.run.smithi174.stdout:17.2.7-1375-g2577e813-1focal 2024-08-17T02:24:58.486 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375-g2577e813-1focal 2024-08-17T02:24:58.486 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375-g2577e813-1focal is installed. 2024-08-17T02:24:58.488 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-17T02:24:58.488 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-08-17T02:24:58.489 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:24:58.505 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-08-17T02:24:58.505 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:24:58.520 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-17T02:24:58.520 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-08-17T02:24:58.520 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:24:58.536 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:24:58.545 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-08-17T02:24:58.545 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:24:58.576 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:24:58.585 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-17T02:24:58.585 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-08-17T02:24:58.586 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:24:58.600 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:24:58.615 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-08-17T02:24:58.615 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:24:58.630 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:24:58.690 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-17T02:24:58.690 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-08-17T02:24:58.691 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:24:58.707 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:24:58.765 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-08-17T02:24:58.765 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:24:58.781 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:24:58.791 INFO:teuthology.run_tasks:Running task ceph... 2024-08-17T02:24:58.866 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-08-17T02:24:58.866 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 777 /var/log/ceph 2024-08-17T02:24:58.869 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 777 /var/log/ceph 2024-08-17T02:24:58.884 INFO:tasks.ceph:Disabling ceph logrotate... 2024-08-17T02:24:58.884 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:24:58.886 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:24:58.896 INFO:tasks.ceph:Creating extra log directories... 2024-08-17T02:24:58.896 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:24:58.936 DEBUG:teuthology.orchestra.run.smithi174:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:24:58.964 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-08-17T02:24:58.964 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-08-17T02:24:58.964 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-08-17T02:24:58.965 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-08-17T02:24:58.965 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:24:58.973 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:24:59.052 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-08-17T02:24:59.052 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:24:59.058 DEBUG:teuthology.orchestra.run.smithi174:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:24:59.144 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-08-17T02:24:59.145 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-08-17T02:24:59.145 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858245', 'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}}', 'email': 'mchangir@redhat.com', 'first_in_suite': False, 'job_id': '7858245', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'owner': 'scheduled_mchangir@teuthology', 'priority': 25, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 5995, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'targets': {'smithi153.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi174.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestVolumes', 'tasks.cephfs.test_volumes.TestSubvolumeGroups', 'tasks.cephfs.test_volumes.TestSubvolumes']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '67db276914d29505c9707d04f3a3b8fb9d8aee4b', 'timestamp': '2024-08-17_01:02:08', 'tube': 'smithi', 'user': 'mchangir', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-08-17T02:24:59.145 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:24:59.148 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:24:59.153 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:24:59.156 DEBUG:teuthology.orchestra.run.smithi174:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:24:59.213 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-08-17T02:24:59.213 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:24:59.220 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:24:59.220 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_1 2024-08-17T02:24:59.269 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:24:59.269 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:24:59.270 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 359 Links: 1 2024-08-17T02:24:59.270 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:24:59.270 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-08-17 02:20:34.331408830 +0000 2024-08-17T02:24:59.270 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-08-17 02:20:34.327408923 +0000 2024-08-17T02:24:59.270 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-08-17 02:20:34.327408923 +0000 2024-08-17T02:24:59.270 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2024-08-17T02:24:59.270 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:24:59.285 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-08-17T02:24:59.285 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-08-17T02:24:59.285 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000432728 s, 1.2 MB/s 2024-08-17T02:24:59.286 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:24:59.294 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_2 2024-08-17T02:24:59.345 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:24:59.346 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:24:59.346 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 363 Links: 1 2024-08-17T02:24:59.346 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:24:59.346 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-08-17 02:20:34.963394289 +0000 2024-08-17T02:24:59.346 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-08-17 02:20:34.747399260 +0000 2024-08-17T02:24:59.346 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-08-17 02:20:34.747399260 +0000 2024-08-17T02:24:59.346 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2024-08-17T02:24:59.346 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:24:59.359 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-08-17T02:24:59.359 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-08-17T02:24:59.359 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000388826 s, 1.3 MB/s 2024-08-17T02:24:59.360 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:24:59.369 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_3 2024-08-17T02:24:59.421 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:24:59.422 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:24:59.422 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 370 Links: 1 2024-08-17T02:24:59.422 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:24:59.422 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-08-17 02:20:35.379384720 +0000 2024-08-17T02:24:59.422 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-08-17 02:20:35.167389596 +0000 2024-08-17T02:24:59.422 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-08-17 02:20:35.167389596 +0000 2024-08-17T02:24:59.422 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2024-08-17T02:24:59.422 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:24:59.433 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-08-17T02:24:59.434 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-08-17T02:24:59.434 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000401314 s, 1.3 MB/s 2024-08-17T02:24:59.435 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:24:59.443 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_4 2024-08-17T02:24:59.497 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:24:59.497 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:24:59.498 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 378 Links: 1 2024-08-17T02:24:59.498 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:24:59.498 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-08-17 02:20:35.823374504 +0000 2024-08-17T02:24:59.498 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-08-17 02:20:35.611379381 +0000 2024-08-17T02:24:59.498 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-08-17 02:20:35.611379381 +0000 2024-08-17T02:24:59.498 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2024-08-17T02:24:59.498 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:24:59.509 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-08-17T02:24:59.509 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-08-17T02:24:59.509 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000365258 s, 1.4 MB/s 2024-08-17T02:24:59.510 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:24:59.517 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:24:59.517 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-08-17T02:24:59.518 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:24:59.524 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:24:59.525 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_1 2024-08-17T02:24:59.532 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:24:59.532 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:24:59.532 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 6h/6d Inode: 359 Links: 1 2024-08-17T02:24:59.532 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:24:59.532 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-08-17 02:20:34.351073836 +0000 2024-08-17T02:24:59.532 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-08-17 02:20:34.347073929 +0000 2024-08-17T02:24:59.532 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-08-17 02:20:34.347073929 +0000 2024-08-17T02:24:59.532 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: - 2024-08-17T02:24:59.533 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:24:59.586 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-08-17T02:24:59.586 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-08-17T02:24:59.587 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000451203 s, 1.1 MB/s 2024-08-17T02:24:59.587 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:24:59.595 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_2 2024-08-17T02:24:59.600 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:24:59.600 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:24:59.600 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 6h/6d Inode: 366 Links: 1 2024-08-17T02:24:59.600 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:24:59.601 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-08-17 02:20:35.003058815 +0000 2024-08-17T02:24:59.601 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-08-17 02:20:34.755064528 +0000 2024-08-17T02:24:59.601 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-08-17 02:20:34.755064528 +0000 2024-08-17T02:24:59.601 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: - 2024-08-17T02:24:59.601 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:24:59.614 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-08-17T02:24:59.614 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-08-17T02:24:59.614 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000421964 s, 1.2 MB/s 2024-08-17T02:24:59.615 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:24:59.665 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_3 2024-08-17T02:24:59.673 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:24:59.673 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:24:59.673 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 6h/6d Inode: 373 Links: 1 2024-08-17T02:24:59.673 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:24:59.673 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-08-17 02:20:35.415049323 +0000 2024-08-17T02:24:59.673 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-08-17 02:20:35.211054023 +0000 2024-08-17T02:24:59.673 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-08-17 02:20:35.211054023 +0000 2024-08-17T02:24:59.673 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: - 2024-08-17T02:24:59.674 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:24:59.684 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-08-17T02:24:59.684 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-08-17T02:24:59.685 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000408234 s, 1.3 MB/s 2024-08-17T02:24:59.686 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:24:59.737 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_4 2024-08-17T02:24:59.745 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:24:59.745 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:24:59.745 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 6h/6d Inode: 379 Links: 1 2024-08-17T02:24:59.745 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:24:59.746 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-08-17 02:20:35.851039278 +0000 2024-08-17T02:24:59.746 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-08-17 02:20:35.623044531 +0000 2024-08-17T02:24:59.746 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-08-17 02:20:35.623044531 +0000 2024-08-17T02:24:59.746 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: - 2024-08-17T02:24:59.746 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:24:59.759 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-08-17T02:24:59.759 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-08-17T02:24:59.760 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000367025 s, 1.4 MB/s 2024-08-17T02:24:59.760 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:24:59.810 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:24:59.810 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi174.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:24:59.810 INFO:tasks.ceph:Generating config... 2024-08-17T02:24:59.811 INFO:tasks.ceph:[client] client mount timeout = 600 2024-08-17T02:24:59.811 INFO:tasks.ceph:[client] debug client = 20 2024-08-17T02:24:59.812 INFO:tasks.ceph:[client] debug ms = 1 2024-08-17T02:24:59.812 INFO:tasks.ceph:[client] pid file = 2024-08-17T02:24:59.812 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-08-17T02:24:59.812 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-08-17T02:24:59.812 INFO:tasks.ceph:[mds] debug mds = 20 2024-08-17T02:24:59.812 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-08-17T02:24:59.812 INFO:tasks.ceph:[mds] debug ms = 1 2024-08-17T02:24:59.812 INFO:tasks.ceph:[mds] mds debug frag = True 2024-08-17T02:24:59.813 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-08-17T02:24:59.813 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-08-17T02:24:59.813 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-08-17T02:24:59.813 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-08-17T02:24:59.813 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-08-17T02:24:59.813 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-08-17T02:24:59.813 INFO:tasks.ceph:[mgr] debug client = 20 2024-08-17T02:24:59.813 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-08-17T02:24:59.813 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-08-17T02:24:59.813 INFO:tasks.ceph:[mgr] debug ms = 1 2024-08-17T02:24:59.813 INFO:tasks.ceph:[mon] debug mon = 20 2024-08-17T02:24:59.814 INFO:tasks.ceph:[mon] debug ms = 1 2024-08-17T02:24:59.814 INFO:tasks.ceph:[mon] debug paxos = 20 2024-08-17T02:24:59.814 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-08-17T02:24:59.814 INFO:tasks.ceph:[osd] bdev async discard = True 2024-08-17T02:24:59.814 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-08-17T02:24:59.814 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-08-17T02:24:59.814 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-08-17T02:24:59.814 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-08-17T02:24:59.814 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-08-17T02:24:59.814 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-08-17T02:24:59.814 INFO:tasks.ceph:[osd] debug ms = 1 2024-08-17T02:24:59.814 INFO:tasks.ceph:[osd] debug osd = 20 2024-08-17T02:24:59.814 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-08-17T02:24:59.815 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-08-17T02:24:59.815 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-08-17T02:24:59.815 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-08-17T02:24:59.815 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-08-17T02:24:59.815 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-08-17T02:24:59.815 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-08-17T02:24:59.815 INFO:tasks.ceph:Setting up mon.a... 2024-08-17T02:24:59.815 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-08-17T02:24:59.850 INFO:teuthology.orchestra.run.smithi153.stdout:creating /etc/ceph/ceph.keyring 2024-08-17T02:24:59.853 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-08-17T02:24:59.885 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:24:59.900 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.153'), ('mon.b', '172.21.15.174'), ('mon.c', '[v2:172.21.15.174:3301,v1:172.21.15.174:6790]')] 2024-08-17T02:24:59.901 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.153,172.21.15.174,[v2:172.21.15.174:3301,v1:172.21.15.174:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-08-17T02:24:59.902 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-08-17T02:24:59.902 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:24:59.953 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.153 --add b 172.21.15.174 --addv c '[v2:172.21.15.174:3301,v1:172.21.15.174:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:24:59.991 INFO:teuthology.orchestra.run.smithi153.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:24:59.991 INFO:teuthology.orchestra.run.smithi153.stdout:monmaptool: generated fsid 56d41c33-b929-456d-96be-2aac4ecd299d 2024-08-17T02:24:59.991 INFO:teuthology.orchestra.run.smithi153.stdout:setting min_mon_release = octopus 2024-08-17T02:24:59.991 INFO:teuthology.orchestra.run.smithi153.stdout:epoch 0 2024-08-17T02:24:59.991 INFO:teuthology.orchestra.run.smithi153.stdout:fsid 56d41c33-b929-456d-96be-2aac4ecd299d 2024-08-17T02:24:59.991 INFO:teuthology.orchestra.run.smithi153.stdout:last_changed 2024-08-17T02:24:59.990578+0000 2024-08-17T02:24:59.991 INFO:teuthology.orchestra.run.smithi153.stdout:created 2024-08-17T02:24:59.990578+0000 2024-08-17T02:24:59.991 INFO:teuthology.orchestra.run.smithi153.stdout:min_mon_release 15 (octopus) 2024-08-17T02:24:59.991 INFO:teuthology.orchestra.run.smithi153.stdout:election_strategy: 1 2024-08-17T02:24:59.992 INFO:teuthology.orchestra.run.smithi153.stdout:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-08-17T02:24:59.992 INFO:teuthology.orchestra.run.smithi153.stdout:1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.b 2024-08-17T02:24:59.992 INFO:teuthology.orchestra.run.smithi153.stdout:2: [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] mon.c 2024-08-17T02:24:59.992 INFO:teuthology.orchestra.run.smithi153.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-08-17T02:24:59.993 DEBUG:teuthology.orchestra.run.smithi153:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:24:59.999 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 56d41c33-b929-456d-96be-2aac4ecd299d... 2024-08-17T02:25:00.000 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:25:00.002 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:25:00.031 INFO:teuthology.orchestra.run.smithi153.stdout:[global] 2024-08-17T02:25:00.031 INFO:teuthology.orchestra.run.smithi153.stdout: chdir = "" 2024-08-17T02:25:00.031 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:25:00.031 INFO:teuthology.orchestra.run.smithi153.stdout: auth supported = cephx 2024-08-17T02:25:00.031 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:25:00.032 INFO:teuthology.orchestra.run.smithi153.stdout: filestore xattr use omap = true 2024-08-17T02:25:00.032 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:25:00.032 INFO:teuthology.orchestra.run.smithi153.stdout: mon clock drift allowed = 1.000 2024-08-17T02:25:00.032 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:25:00.032 INFO:teuthology.orchestra.run.smithi153.stdout: osd crush chooseleaf type = 0 2024-08-17T02:25:00.032 INFO:teuthology.orchestra.run.smithi153.stdout: auth debug = true 2024-08-17T02:25:00.032 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:25:00.032 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on old message = true 2024-08-17T02:25:00.032 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on bug = true 2024-08-17T02:25:00.032 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:25:00.032 INFO:teuthology.orchestra.run.smithi153.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:25:00.032 INFO:teuthology.orchestra.run.smithi153.stdout: mon pg warn max object skew = 0 2024-08-17T02:25:00.032 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:25:00.033 INFO:teuthology.orchestra.run.smithi153.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:25:00.033 INFO:teuthology.orchestra.run.smithi153.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:25:00.033 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:25:00.033 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default size = 2 2024-08-17T02:25:00.033 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:25:00.033 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow primary affinity = true 2024-08-17T02:25:00.033 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow pg remap = true 2024-08-17T02:25:00.033 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:25:00.033 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:25:00.033 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on no sortbitwise = false 2024-08-17T02:25:00.033 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:25:00.033 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on too few osds = false 2024-08-17T02:25:00.033 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:25:00.034 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:25:00.034 INFO:teuthology.orchestra.run.smithi153.stdout: mon_allow_pool_size_one = true 2024-08-17T02:25:00.034 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:25:00.034 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:25:00.034 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:25:00.034 INFO:teuthology.orchestra.run.smithi153.stdout: osd default data pool replay window = 5 2024-08-17T02:25:00.034 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:25:00.034 INFO:teuthology.orchestra.run.smithi153.stdout: mon allow pool delete = true 2024-08-17T02:25:00.034 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:25:00.034 INFO:teuthology.orchestra.run.smithi153.stdout: mon cluster log file level = debug 2024-08-17T02:25:00.034 INFO:teuthology.orchestra.run.smithi153.stdout: debug asserts on shutdown = true 2024-08-17T02:25:00.034 INFO:teuthology.orchestra.run.smithi153.stdout: mon health detail to clog = false 2024-08-17T02:25:00.035 INFO:teuthology.orchestra.run.smithi153.stdout: mon host = "172.21.15.153,172.21.15.174,[v2:172.21.15.174:3301,v1:172.21.15.174:6790]" 2024-08-17T02:25:00.035 INFO:teuthology.orchestra.run.smithi153.stdout: fsid = 56d41c33-b929-456d-96be-2aac4ecd299d 2024-08-17T02:25:00.035 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:25:00.035 INFO:teuthology.orchestra.run.smithi153.stdout:[osd] 2024-08-17T02:25:00.035 INFO:teuthology.orchestra.run.smithi153.stdout: osd journal size = 100 2024-08-17T02:25:00.035 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:25:00.035 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub load threshold = 5.0 2024-08-17T02:25:00.035 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub max interval = 600 2024-08-17T02:25:00.036 INFO:teuthology.orchestra.run.smithi153.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:25:00.036 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:25:00.036 INFO:teuthology.orchestra.run.smithi153.stdout: osd recover clone overlap = true 2024-08-17T02:25:00.036 INFO:teuthology.orchestra.run.smithi153.stdout: osd recovery max chunk = 1048576 2024-08-17T02:25:00.036 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:25:00.036 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug shutdown = true 2024-08-17T02:25:00.036 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug op order = true 2024-08-17T02:25:00.036 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug verify stray on activate = true 2024-08-17T02:25:00.036 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:25:00.036 INFO:teuthology.orchestra.run.smithi153.stdout: osd open classes on start = true 2024-08-17T02:25:00.036 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug pg log writeout = true 2024-08-17T02:25:00.036 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:25:00.037 INFO:teuthology.orchestra.run.smithi153.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:25:00.037 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:25:00.037 INFO:teuthology.orchestra.run.smithi153.stdout: osd map max advance = 10 2024-08-17T02:25:00.037 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:25:00.037 INFO:teuthology.orchestra.run.smithi153.stdout: journal zero on create = true 2024-08-17T02:25:00.037 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:25:00.037 INFO:teuthology.orchestra.run.smithi153.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:25:00.037 INFO:teuthology.orchestra.run.smithi153.stdout: filestore apply finisher threads = 3 2024-08-17T02:25:00.037 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:25:00.037 INFO:teuthology.orchestra.run.smithi153.stdout: bdev debug aio = true 2024-08-17T02:25:00.037 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug misdirected ops = true 2024-08-17T02:25:00.037 INFO:teuthology.orchestra.run.smithi153.stdout: bdev async discard = True 2024-08-17T02:25:00.038 INFO:teuthology.orchestra.run.smithi153.stdout: bdev enable discard = True 2024-08-17T02:25:00.038 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore allocator = bitmap 2024-08-17T02:25:00.038 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore block size = 96636764160 2024-08-17T02:25:00.038 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore fsck on mount = True 2024-08-17T02:25:00.038 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluefs = 1/20 2024-08-17T02:25:00.038 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluestore = 1/20 2024-08-17T02:25:00.038 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-08-17T02:25:00.038 INFO:teuthology.orchestra.run.smithi153.stdout: debug osd = 20 2024-08-17T02:25:00.038 INFO:teuthology.orchestra.run.smithi153.stdout: debug rocksdb = 4/10 2024-08-17T02:25:00.038 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:25:00.038 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd full ratio = 0.9 2024-08-17T02:25:00.038 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:25:00.038 INFO:teuthology.orchestra.run.smithi153.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:25:00.039 INFO:teuthology.orchestra.run.smithi153.stdout: osd objectstore = bluestore 2024-08-17T02:25:00.039 INFO:teuthology.orchestra.run.smithi153.stdout: osd op complaint time = 180 2024-08-17T02:25:00.039 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:25:00.039 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr] 2024-08-17T02:25:00.039 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-08-17T02:25:00.039 INFO:teuthology.orchestra.run.smithi153.stdout: debug mgr = 20 2024-08-17T02:25:00.039 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2024-08-17T02:25:00.039 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2024-08-17T02:25:00.039 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:25:00.039 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:25:00.039 INFO:teuthology.orchestra.run.smithi153.stdout: mgr/telemetry/nag = false 2024-08-17T02:25:00.039 INFO:teuthology.orchestra.run.smithi153.stdout: debug client = 20 2024-08-17T02:25:00.039 INFO:teuthology.orchestra.run.smithi153.stdout: debug finisher = 20 2024-08-17T02:25:00.039 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:25:00.040 INFO:teuthology.orchestra.run.smithi153.stdout:[mon] 2024-08-17T02:25:00.040 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-08-17T02:25:00.040 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2024-08-17T02:25:00.040 INFO:teuthology.orchestra.run.smithi153.stdout: debug paxos = 20 2024-08-17T02:25:00.040 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2024-08-17T02:25:00.040 INFO:teuthology.orchestra.run.smithi153.stdout: mon data avail warn = 5 2024-08-17T02:25:00.040 INFO:teuthology.orchestra.run.smithi153.stdout: mon mgr mkfs grace = 240 2024-08-17T02:25:00.040 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:25:00.040 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd reporter subtree level = osd 2024-08-17T02:25:00.040 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd prime pg temp = true 2024-08-17T02:25:00.040 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:25:00.040 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:25:00.040 INFO:teuthology.orchestra.run.smithi153.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:25:00.040 INFO:teuthology.orchestra.run.smithi153.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:25:00.041 INFO:teuthology.orchestra.run.smithi153.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:25:00.041 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:25:00.041 INFO:teuthology.orchestra.run.smithi153.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:25:00.041 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:25:00.041 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:25:00.041 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:25:00.041 INFO:teuthology.orchestra.run.smithi153.stdout: # 1m isn't quite enough 2024-08-17T02:25:00.041 INFO:teuthology.orchestra.run.smithi153.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:25:00.041 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:25:00.041 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:25:00.041 INFO:teuthology.orchestra.run.smithi153.stdout: mon op complaint time = 120 2024-08-17T02:25:00.041 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:25:00.041 INFO:teuthology.orchestra.run.smithi153.stdout:[client] 2024-08-17T02:25:00.041 INFO:teuthology.orchestra.run.smithi153.stdout: rgw cache enabled = true 2024-08-17T02:25:00.042 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable ops log = true 2024-08-17T02:25:00.042 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable usage log = true 2024-08-17T02:25:00.042 INFO:teuthology.orchestra.run.smithi153.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:25:00.042 INFO:teuthology.orchestra.run.smithi153.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:25:00.042 INFO:teuthology.orchestra.run.smithi153.stdout: client mount timeout = 600 2024-08-17T02:25:00.042 INFO:teuthology.orchestra.run.smithi153.stdout: debug client = 20 2024-08-17T02:25:00.042 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-08-17T02:25:00.042 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = "" 2024-08-17T02:25:00.042 INFO:teuthology.orchestra.run.smithi153.stdout: rados mon op timeout = 900 2024-08-17T02:25:00.042 INFO:teuthology.orchestra.run.smithi153.stdout: rados osd op timeout = 900 2024-08-17T02:25:00.042 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.a] 2024-08-17T02:25:00.042 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.b] 2024-08-17T02:25:00.042 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.c] 2024-08-17T02:25:00.043 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.a] 2024-08-17T02:25:00.043 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.c] 2024-08-17T02:25:00.043 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.b] 2024-08-17T02:25:00.043 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.d] 2024-08-17T02:25:00.043 INFO:teuthology.orchestra.run.smithi153.stdout:[mds] 2024-08-17T02:25:00.043 INFO:teuthology.orchestra.run.smithi153.stdout: debug mds = 20 2024-08-17T02:25:00.043 INFO:teuthology.orchestra.run.smithi153.stdout: debug mds balancer = 20 2024-08-17T02:25:00.043 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-08-17T02:25:00.043 INFO:teuthology.orchestra.run.smithi153.stdout: mds debug frag = True 2024-08-17T02:25:00.043 INFO:teuthology.orchestra.run.smithi153.stdout: mds debug scatterstat = True 2024-08-17T02:25:00.043 INFO:teuthology.orchestra.run.smithi153.stdout: mds op complaint time = 180 2024-08-17T02:25:00.043 INFO:teuthology.orchestra.run.smithi153.stdout: mds verify scatter = True 2024-08-17T02:25:00.043 INFO:teuthology.orchestra.run.smithi153.stdout: osd op complaint time = 180 2024-08-17T02:25:00.043 INFO:teuthology.orchestra.run.smithi153.stdout: rados mon op timeout = 900 2024-08-17T02:25:00.044 INFO:teuthology.orchestra.run.smithi153.stdout: rados osd op timeout = 900 2024-08-17T02:25:00.044 INFO:teuthology.orchestra.run.smithi174.stdout:[global] 2024-08-17T02:25:00.044 INFO:teuthology.orchestra.run.smithi174.stdout: chdir = "" 2024-08-17T02:25:00.044 INFO:teuthology.orchestra.run.smithi174.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:25:00.045 INFO:teuthology.orchestra.run.smithi174.stdout: auth supported = cephx 2024-08-17T02:25:00.045 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-08-17T02:25:00.045 INFO:teuthology.orchestra.run.smithi174.stdout: filestore xattr use omap = true 2024-08-17T02:25:00.045 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-08-17T02:25:00.045 INFO:teuthology.orchestra.run.smithi174.stdout: mon clock drift allowed = 1.000 2024-08-17T02:25:00.045 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-08-17T02:25:00.045 INFO:teuthology.orchestra.run.smithi174.stdout: osd crush chooseleaf type = 0 2024-08-17T02:25:00.045 INFO:teuthology.orchestra.run.smithi174.stdout: auth debug = true 2024-08-17T02:25:00.045 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-08-17T02:25:00.045 INFO:teuthology.orchestra.run.smithi174.stdout: ms die on old message = true 2024-08-17T02:25:00.045 INFO:teuthology.orchestra.run.smithi174.stdout: ms die on bug = true 2024-08-17T02:25:00.045 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-08-17T02:25:00.046 INFO:teuthology.orchestra.run.smithi174.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:25:00.046 INFO:teuthology.orchestra.run.smithi174.stdout: mon pg warn max object skew = 0 2024-08-17T02:25:00.046 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-08-17T02:25:00.046 INFO:teuthology.orchestra.run.smithi174.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:25:00.046 INFO:teuthology.orchestra.run.smithi174.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:25:00.046 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-08-17T02:25:00.046 INFO:teuthology.orchestra.run.smithi174.stdout: osd pool default size = 2 2024-08-17T02:25:00.046 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-08-17T02:25:00.046 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd allow primary affinity = true 2024-08-17T02:25:00.046 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd allow pg remap = true 2024-08-17T02:25:00.046 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:25:00.046 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:25:00.046 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on no sortbitwise = false 2024-08-17T02:25:00.047 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:25:00.047 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on too few osds = false 2024-08-17T02:25:00.047 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:25:00.047 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:25:00.047 INFO:teuthology.orchestra.run.smithi174.stdout: mon_allow_pool_size_one = true 2024-08-17T02:25:00.047 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-08-17T02:25:00.047 INFO:teuthology.orchestra.run.smithi174.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:25:00.047 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-08-17T02:25:00.047 INFO:teuthology.orchestra.run.smithi174.stdout: osd default data pool replay window = 5 2024-08-17T02:25:00.047 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-08-17T02:25:00.047 INFO:teuthology.orchestra.run.smithi174.stdout: mon allow pool delete = true 2024-08-17T02:25:00.047 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-08-17T02:25:00.047 INFO:teuthology.orchestra.run.smithi174.stdout: mon cluster log file level = debug 2024-08-17T02:25:00.047 INFO:teuthology.orchestra.run.smithi174.stdout: debug asserts on shutdown = true 2024-08-17T02:25:00.048 INFO:teuthology.orchestra.run.smithi174.stdout: mon health detail to clog = false 2024-08-17T02:25:00.048 INFO:teuthology.orchestra.run.smithi174.stdout: mon host = "172.21.15.153,172.21.15.174,[v2:172.21.15.174:3301,v1:172.21.15.174:6790]" 2024-08-17T02:25:00.048 INFO:teuthology.orchestra.run.smithi174.stdout: fsid = 56d41c33-b929-456d-96be-2aac4ecd299d 2024-08-17T02:25:00.048 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-08-17T02:25:00.048 INFO:teuthology.orchestra.run.smithi174.stdout:[osd] 2024-08-17T02:25:00.048 INFO:teuthology.orchestra.run.smithi174.stdout: osd journal size = 100 2024-08-17T02:25:00.048 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-08-17T02:25:00.048 INFO:teuthology.orchestra.run.smithi174.stdout: osd scrub load threshold = 5.0 2024-08-17T02:25:00.048 INFO:teuthology.orchestra.run.smithi174.stdout: osd scrub max interval = 600 2024-08-17T02:25:00.048 INFO:teuthology.orchestra.run.smithi174.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:25:00.048 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-08-17T02:25:00.048 INFO:teuthology.orchestra.run.smithi174.stdout: osd recover clone overlap = true 2024-08-17T02:25:00.048 INFO:teuthology.orchestra.run.smithi174.stdout: osd recovery max chunk = 1048576 2024-08-17T02:25:00.049 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-08-17T02:25:00.049 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug shutdown = true 2024-08-17T02:25:00.049 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug op order = true 2024-08-17T02:25:00.049 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug verify stray on activate = true 2024-08-17T02:25:00.049 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-08-17T02:25:00.049 INFO:teuthology.orchestra.run.smithi174.stdout: osd open classes on start = true 2024-08-17T02:25:00.049 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug pg log writeout = true 2024-08-17T02:25:00.049 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-08-17T02:25:00.049 INFO:teuthology.orchestra.run.smithi174.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:25:00.049 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-08-17T02:25:00.049 INFO:teuthology.orchestra.run.smithi174.stdout: osd map max advance = 10 2024-08-17T02:25:00.049 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-08-17T02:25:00.049 INFO:teuthology.orchestra.run.smithi174.stdout: journal zero on create = true 2024-08-17T02:25:00.049 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-08-17T02:25:00.050 INFO:teuthology.orchestra.run.smithi174.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:25:00.050 INFO:teuthology.orchestra.run.smithi174.stdout: filestore apply finisher threads = 3 2024-08-17T02:25:00.050 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-08-17T02:25:00.050 INFO:teuthology.orchestra.run.smithi174.stdout: bdev debug aio = true 2024-08-17T02:25:00.050 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug misdirected ops = true 2024-08-17T02:25:00.050 INFO:teuthology.orchestra.run.smithi174.stdout: bdev async discard = True 2024-08-17T02:25:00.050 INFO:teuthology.orchestra.run.smithi174.stdout: bdev enable discard = True 2024-08-17T02:25:00.050 INFO:teuthology.orchestra.run.smithi174.stdout: bluestore allocator = bitmap 2024-08-17T02:25:00.050 INFO:teuthology.orchestra.run.smithi174.stdout: bluestore block size = 96636764160 2024-08-17T02:25:00.050 INFO:teuthology.orchestra.run.smithi174.stdout: bluestore fsck on mount = True 2024-08-17T02:25:00.050 INFO:teuthology.orchestra.run.smithi174.stdout: debug bluefs = 1/20 2024-08-17T02:25:00.050 INFO:teuthology.orchestra.run.smithi174.stdout: debug bluestore = 1/20 2024-08-17T02:25:00.051 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2024-08-17T02:25:00.051 INFO:teuthology.orchestra.run.smithi174.stdout: debug osd = 20 2024-08-17T02:25:00.051 INFO:teuthology.orchestra.run.smithi174.stdout: debug rocksdb = 4/10 2024-08-17T02:25:00.051 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:25:00.051 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd full ratio = 0.9 2024-08-17T02:25:00.051 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:25:00.051 INFO:teuthology.orchestra.run.smithi174.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:25:00.051 INFO:teuthology.orchestra.run.smithi174.stdout: osd objectstore = bluestore 2024-08-17T02:25:00.051 INFO:teuthology.orchestra.run.smithi174.stdout: osd op complaint time = 180 2024-08-17T02:25:00.051 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-08-17T02:25:00.051 INFO:teuthology.orchestra.run.smithi174.stdout:[mgr] 2024-08-17T02:25:00.052 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2024-08-17T02:25:00.052 INFO:teuthology.orchestra.run.smithi174.stdout: debug mgr = 20 2024-08-17T02:25:00.052 INFO:teuthology.orchestra.run.smithi174.stdout: debug mon = 20 2024-08-17T02:25:00.052 INFO:teuthology.orchestra.run.smithi174.stdout: debug auth = 20 2024-08-17T02:25:00.052 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:25:00.052 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:25:00.052 INFO:teuthology.orchestra.run.smithi174.stdout: mgr/telemetry/nag = false 2024-08-17T02:25:00.052 INFO:teuthology.orchestra.run.smithi174.stdout: debug client = 20 2024-08-17T02:25:00.052 INFO:teuthology.orchestra.run.smithi174.stdout: debug finisher = 20 2024-08-17T02:25:00.052 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-08-17T02:25:00.052 INFO:teuthology.orchestra.run.smithi174.stdout:[mon] 2024-08-17T02:25:00.052 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2024-08-17T02:25:00.052 INFO:teuthology.orchestra.run.smithi174.stdout: debug mon = 20 2024-08-17T02:25:00.053 INFO:teuthology.orchestra.run.smithi174.stdout: debug paxos = 20 2024-08-17T02:25:00.053 INFO:teuthology.orchestra.run.smithi174.stdout: debug auth = 20 2024-08-17T02:25:00.053 INFO:teuthology.orchestra.run.smithi174.stdout: mon data avail warn = 5 2024-08-17T02:25:00.053 INFO:teuthology.orchestra.run.smithi174.stdout: mon mgr mkfs grace = 240 2024-08-17T02:25:00.053 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:25:00.053 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd reporter subtree level = osd 2024-08-17T02:25:00.053 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd prime pg temp = true 2024-08-17T02:25:00.053 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:25:00.053 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-08-17T02:25:00.053 INFO:teuthology.orchestra.run.smithi174.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:25:00.053 INFO:teuthology.orchestra.run.smithi174.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:25:00.053 INFO:teuthology.orchestra.run.smithi174.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:25:00.053 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-08-17T02:25:00.054 INFO:teuthology.orchestra.run.smithi174.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:25:00.054 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:25:00.054 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:25:00.054 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-08-17T02:25:00.054 INFO:teuthology.orchestra.run.smithi174.stdout: # 1m isn't quite enough 2024-08-17T02:25:00.054 INFO:teuthology.orchestra.run.smithi174.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:25:00.054 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-08-17T02:25:00.054 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:25:00.054 INFO:teuthology.orchestra.run.smithi174.stdout: mon op complaint time = 120 2024-08-17T02:25:00.054 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-08-17T02:25:00.054 INFO:teuthology.orchestra.run.smithi174.stdout:[client] 2024-08-17T02:25:00.054 INFO:teuthology.orchestra.run.smithi174.stdout: rgw cache enabled = true 2024-08-17T02:25:00.054 INFO:teuthology.orchestra.run.smithi174.stdout: rgw enable ops log = true 2024-08-17T02:25:00.054 INFO:teuthology.orchestra.run.smithi174.stdout: rgw enable usage log = true 2024-08-17T02:25:00.055 INFO:teuthology.orchestra.run.smithi174.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:25:00.055 INFO:teuthology.orchestra.run.smithi174.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:25:00.055 INFO:teuthology.orchestra.run.smithi174.stdout: client mount timeout = 600 2024-08-17T02:25:00.055 INFO:teuthology.orchestra.run.smithi174.stdout: debug client = 20 2024-08-17T02:25:00.055 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2024-08-17T02:25:00.055 INFO:teuthology.orchestra.run.smithi174.stdout: pid file = "" 2024-08-17T02:25:00.055 INFO:teuthology.orchestra.run.smithi174.stdout: rados mon op timeout = 900 2024-08-17T02:25:00.055 INFO:teuthology.orchestra.run.smithi174.stdout: rados osd op timeout = 900 2024-08-17T02:25:00.055 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.a] 2024-08-17T02:25:00.055 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.b] 2024-08-17T02:25:00.055 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.c] 2024-08-17T02:25:00.055 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.a] 2024-08-17T02:25:00.055 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.c] 2024-08-17T02:25:00.055 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.b] 2024-08-17T02:25:00.056 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.d] 2024-08-17T02:25:00.056 INFO:teuthology.orchestra.run.smithi174.stdout:[mds] 2024-08-17T02:25:00.056 INFO:teuthology.orchestra.run.smithi174.stdout: debug mds = 20 2024-08-17T02:25:00.056 INFO:teuthology.orchestra.run.smithi174.stdout: debug mds balancer = 20 2024-08-17T02:25:00.056 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2024-08-17T02:25:00.056 INFO:teuthology.orchestra.run.smithi174.stdout: mds debug frag = True 2024-08-17T02:25:00.056 INFO:teuthology.orchestra.run.smithi174.stdout: mds debug scatterstat = True 2024-08-17T02:25:00.056 INFO:teuthology.orchestra.run.smithi174.stdout: mds op complaint time = 180 2024-08-17T02:25:00.056 INFO:teuthology.orchestra.run.smithi174.stdout: mds verify scatter = True 2024-08-17T02:25:00.056 INFO:teuthology.orchestra.run.smithi174.stdout: osd op complaint time = 180 2024-08-17T02:25:00.056 INFO:teuthology.orchestra.run.smithi174.stdout: rados mon op timeout = 900 2024-08-17T02:25:00.056 INFO:teuthology.orchestra.run.smithi174.stdout: rados osd op timeout = 900 2024-08-17T02:25:00.057 INFO:tasks.ceph:Creating admin key on mon.a... 2024-08-17T02:25:00.058 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-08-17T02:25:00.149 INFO:tasks.ceph:Copying monmap to all nodes... 2024-08-17T02:25:00.150 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-08-17T02:25:00.150 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-08-17T02:25:00.156 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-08-17T02:25:00.157 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-08-17T02:25:00.162 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi153.front.sepia.ceph.com 2024-08-17T02:25:00.162 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-08-17T02:25:00.162 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:25:00.162 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:25:00.181 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-08-17T02:25:00.181 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:00.229 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi174.front.sepia.ceph.com 2024-08-17T02:25:00.229 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-08-17T02:25:00.229 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:25:00.229 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:25:00.255 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-08-17T02:25:00.255 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:00.260 INFO:tasks.ceph:Setting up mon nodes... 2024-08-17T02:25:00.260 INFO:tasks.ceph:Setting up mgr nodes... 2024-08-17T02:25:00.260 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:25:00.305 INFO:teuthology.orchestra.run.smithi153.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:25:00.308 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:25:00.352 INFO:teuthology.orchestra.run.smithi174.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:25:00.354 INFO:tasks.ceph:Setting up mds nodes... 2024-08-17T02:25:00.354 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:25:00.397 INFO:teuthology.orchestra.run.smithi153.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:25:00.400 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-08-17T02:25:00.456 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:25:00.499 INFO:teuthology.orchestra.run.smithi153.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:25:00.502 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-08-17T02:25:00.516 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:25:00.565 INFO:teuthology.orchestra.run.smithi174.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:25:00.568 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-08-17T02:25:00.582 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:25:00.623 INFO:teuthology.orchestra.run.smithi174.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:25:00.625 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-08-17T02:25:00.637 INFO:tasks.ceph_client:Setting up client nodes... 2024-08-17T02:25:00.638 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-17T02:25:00.675 INFO:teuthology.orchestra.run.smithi153.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-08-17T02:25:00.688 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-08-17T02:25:00.767 INFO:teuthology.orchestra.run.smithi153.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-08-17T02:25:00.781 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-08-17T02:25:00.818 INFO:teuthology.orchestra.run.smithi174.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-08-17T02:25:00.831 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-08-17T02:25:00.862 INFO:teuthology.orchestra.run.smithi174.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-08-17T02:25:00.873 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-08-17T02:25:00.873 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi174.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:25:00.873 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-08-17T02:25:00.890 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:00.890 INFO:tasks.ceph:role: osd.0 2024-08-17T02:25:00.890 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com 2024-08-17T02:25:00.890 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:25:01.459 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:01.460 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:01.460 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:01.460 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 2024-08-17T02:25:01.460 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:01.460 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:01.460 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:01.460 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:25:01.460 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:01.460 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:01.462 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-08-17T02:25:01.462 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-08-17T02:25:01.572 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-08-17T02:25:01.585 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:25:01.586 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:25:01.586 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-08-17T02:25:01.646 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:01.647 INFO:tasks.ceph:role: osd.1 2024-08-17T02:25:01.647 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi153.front.sepia.ceph.com 2024-08-17T02:25:01.647 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:25:02.162 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:02.162 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:02.162 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:02.162 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 2024-08-17T02:25:02.163 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:02.163 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:02.163 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:02.163 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:25:02.163 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:02.163 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:02.164 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-08-17T02:25:02.164 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-08-17T02:25:02.198 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-08-17T02:25:02.208 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:25:02.208 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:25:02.208 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-08-17T02:25:02.267 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:02.267 INFO:tasks.ceph:role: osd.2 2024-08-17T02:25:02.267 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi153.front.sepia.ceph.com 2024-08-17T02:25:02.267 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:25:02.762 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:02.762 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:02.762 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:02.762 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 2024-08-17T02:25:02.762 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:02.762 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:02.762 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:02.763 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:25:02.763 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:02.763 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:02.764 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-08-17T02:25:02.764 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-08-17T02:25:02.821 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-08-17T02:25:02.833 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:25:02.833 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:25:02.834 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-08-17T02:25:02.844 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:02.844 INFO:tasks.ceph:role: osd.3 2024-08-17T02:25:02.844 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi153.front.sepia.ceph.com 2024-08-17T02:25:02.844 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:25:03.377 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:03.378 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:03.378 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:03.378 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 2024-08-17T02:25:03.378 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:03.378 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:03.378 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:03.379 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:25:03.379 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:03.379 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:03.380 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-08-17T02:25:03.380 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-08-17T02:25:03.431 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-08-17T02:25:03.442 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:25:03.443 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:25:03.444 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:03.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:03.514+0000 7fb977caf3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-08-17T02:25:03.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:03.518+0000 7fb977caf3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-08-17T02:25:03.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:03.518+0000 7fb977caf3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:25:03.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:03.518+0000 7fb977caf3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:25:03.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:03.518+0000 7fb977caf3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:25:03.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:03.522+0000 7fb977caf3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-08-17T02:25:04.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:04.090+0000 7fb977caf3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:04.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:04.866+0000 7fb977caf3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:05.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:05.646+0000 7fb977caf3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:06.495 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-17T02:25:06.512 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:06.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:06.590+0000 7ff2867603c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-08-17T02:25:06.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:06.590+0000 7ff2867603c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-08-17T02:25:06.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:06.590+0000 7ff2867603c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:25:06.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:06.590+0000 7ff2867603c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:25:06.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:06.590+0000 7ff2867603c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:25:06.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:06.590+0000 7ff2867603c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-08-17T02:25:07.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:07.146+0000 7ff2867603c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:07.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:07.930+0000 7ff2867603c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:08.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:08.710+0000 7ff2867603c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:09.567 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-17T02:25:09.581 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:09.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:09.618+0000 7f51d48643c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-08-17T02:25:09.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:09.618+0000 7f51d48643c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-08-17T02:25:09.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:09.618+0000 7f51d48643c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:25:09.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:09.618+0000 7f51d48643c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:25:09.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:09.618+0000 7f51d48643c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:25:09.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:09.618+0000 7f51d48643c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-08-17T02:25:10.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:10.186+0000 7f51d48643c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:10.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:10.966+0000 7f51d48643c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:11.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:11.762+0000 7f51d48643c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:12.610 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-17T02:25:12.671 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:12.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:12.702+0000 7f732de0b3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-08-17T02:25:12.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:12.702+0000 7f732de0b3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-08-17T02:25:12.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:12.702+0000 7f732de0b3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:25:12.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:12.702+0000 7f732de0b3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:25:12.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:12.702+0000 7f732de0b3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:25:12.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:12.706+0000 7f732de0b3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-08-17T02:25:13.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:13.262+0000 7f732de0b3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:14.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:14.042+0000 7f732de0b3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:14.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:14.826+0000 7f732de0b3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:15.674 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-17T02:25:15.690 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-08-17T02:25:15.707 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:15.707 INFO:tasks.ceph:role: osd.4 2024-08-17T02:25:15.707 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi174.front.sepia.ceph.com 2024-08-17T02:25:15.707 DEBUG:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:25:16.261 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:16.262 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:16.262 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:16.262 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 2024-08-17T02:25:16.262 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:16.262 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:16.262 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:16.262 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:25:16.262 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:16.262 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:16.264 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2024-08-17T02:25:16.264 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-08-17T02:25:16.352 DEBUG:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-08-17T02:25:16.363 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:25:16.363 INFO:teuthology.orchestra.run.smithi174.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:25:16.364 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-08-17T02:25:16.422 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:16.422 INFO:tasks.ceph:role: osd.5 2024-08-17T02:25:16.422 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi174.front.sepia.ceph.com 2024-08-17T02:25:16.422 DEBUG:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:25:16.949 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:16.950 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:16.950 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:16.950 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 2024-08-17T02:25:16.950 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:16.950 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:16.950 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:16.950 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:25:16.950 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:16.950 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:16.951 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2024-08-17T02:25:16.952 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-08-17T02:25:16.988 DEBUG:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-08-17T02:25:16.999 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:25:16.999 INFO:teuthology.orchestra.run.smithi174.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:25:17.000 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-08-17T02:25:17.009 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:17.010 INFO:tasks.ceph:role: osd.6 2024-08-17T02:25:17.010 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi174.front.sepia.ceph.com 2024-08-17T02:25:17.010 DEBUG:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:25:17.465 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:17.465 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:17.465 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:17.465 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 2024-08-17T02:25:17.465 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:17.465 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:17.465 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:17.465 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:25:17.465 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:17.465 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:17.466 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2024-08-17T02:25:17.466 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-08-17T02:25:17.526 DEBUG:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-08-17T02:25:17.537 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:25:17.537 INFO:teuthology.orchestra.run.smithi174.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:25:17.538 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-08-17T02:25:17.549 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:17.549 INFO:tasks.ceph:role: osd.7 2024-08-17T02:25:17.549 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi174.front.sepia.ceph.com 2024-08-17T02:25:17.549 DEBUG:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:25:18.069 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:18.069 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:18.069 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:18.069 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 2024-08-17T02:25:18.069 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:18.069 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:18.069 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:18.069 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:25:18.069 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:18.069 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:18.071 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2024-08-17T02:25:18.071 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-08-17T02:25:18.128 DEBUG:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-08-17T02:25:18.139 INFO:teuthology.orchestra.run.smithi174.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:25:18.140 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:25:18.140 DEBUG:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:18.213 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:18.206+0000 7f1bc58a73c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-08-17T02:25:18.215 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:18.210+0000 7f1bc58a73c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-08-17T02:25:18.215 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:18.210+0000 7f1bc58a73c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:25:18.215 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:18.210+0000 7f1bc58a73c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:25:18.216 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:18.210+0000 7f1bc58a73c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:25:18.216 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:18.210+0000 7f1bc58a73c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-08-17T02:25:18.776 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:18.770+0000 7f1bc58a73c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:19.555 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:19.550+0000 7f1bc58a73c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:20.335 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:20.330+0000 7f1bc58a73c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:21.194 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-17T02:25:21.209 DEBUG:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:21.290 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:21.282+0000 7f1b46c453c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-08-17T02:25:21.290 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:21.286+0000 7f1b46c453c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-08-17T02:25:21.290 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:21.286+0000 7f1b46c453c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:25:21.290 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:21.286+0000 7f1b46c453c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:25:21.290 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:21.286+0000 7f1b46c453c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:25:21.291 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:21.286+0000 7f1b46c453c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-08-17T02:25:21.846 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:21.842+0000 7f1b46c453c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:22.627 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:22.622+0000 7f1b46c453c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:23.410 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:23.406+0000 7f1b46c453c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:24.242 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-17T02:25:24.259 DEBUG:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:24.301 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:24.294+0000 7f71693343c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-08-17T02:25:24.301 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:24.294+0000 7f71693343c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-08-17T02:25:24.301 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:24.294+0000 7f71693343c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:25:24.301 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:24.294+0000 7f71693343c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:25:24.301 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:24.294+0000 7f71693343c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:25:24.301 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:24.294+0000 7f71693343c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-08-17T02:25:24.855 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:24.850+0000 7f71693343c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:25.638 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:25.634+0000 7f71693343c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:26.429 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:26.422+0000 7f71693343c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:27.281 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-08-17T02:25:27.337 DEBUG:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:27.372 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:27.366+0000 7f8c39f963c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-08-17T02:25:27.373 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:27.366+0000 7f8c39f963c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-08-17T02:25:27.373 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:27.366+0000 7f8c39f963c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:25:27.373 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:27.366+0000 7f8c39f963c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:25:27.373 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:27.366+0000 7f8c39f963c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:25:27.374 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:27.370+0000 7f8c39f963c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-08-17T02:25:27.928 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:27.922+0000 7f8c39f963c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:28.713 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:28.706+0000 7f8c39f963c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:29.146 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:29.149 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:29.496 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:29.490+0000 7f8c39f963c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:30.345 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-08-17T02:25:30.361 INFO:tasks.ceph:Reading keys from all nodes... 2024-08-17T02:25:30.361 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-08-17T02:25:30.362 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-08-17T02:25:30.377 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-08-17T02:25:30.377 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-08-17T02:25:30.389 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-08-17T02:25:30.389 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-08-17T02:25:30.447 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-08-17T02:25:30.447 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-08-17T02:25:30.456 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-08-17T02:25:30.457 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-08-17T02:25:30.472 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-08-17T02:25:30.472 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-08-17T02:25:30.530 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-08-17T02:25:30.531 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-08-17T02:25:30.540 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-08-17T02:25:30.540 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-08-17T02:25:30.556 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-08-17T02:25:30.556 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-08-17T02:25:30.613 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-08-17T02:25:30.614 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-08-17T02:25:30.624 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-08-17T02:25:30.624 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-08-17T02:25:30.638 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-08-17T02:25:30.638 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-08-17T02:25:30.697 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-08-17T02:25:30.698 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-08-17T02:25:30.707 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-08-17T02:25:30.708 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-08-17T02:25:30.718 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-08-17T02:25:30.718 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-08-17T02:25:30.725 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-08-17T02:25:30.725 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-08-17T02:25:30.773 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-08-17T02:25:30.773 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-08-17T02:25:30.780 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-08-17T02:25:30.780 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-08-17T02:25:30.828 INFO:tasks.ceph:Adding keys to all mons... 2024-08-17T02:25:30.828 DEBUG:teuthology.orchestra.run.smithi153:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:25:30.830 DEBUG:teuthology.orchestra.run.smithi174:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:25:30.842 INFO:teuthology.orchestra.run.smithi174.stdout:[mgr.y] 2024-08-17T02:25:30.842 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQD8CcBm1lgwEhAAYBzLN+/4eml8Dac0VcnqGA== 2024-08-17T02:25:30.842 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.a] 2024-08-17T02:25:30.842 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQD8CcBm2U+sFxAAzA6rDgNnZkpY9gZMrTw2ug== 2024-08-17T02:25:30.842 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.c] 2024-08-17T02:25:30.842 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQD8CcBmfUDIHRAAnioAeAUXY2NHEockqg8e0A== 2024-08-17T02:25:30.842 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.0] 2024-08-17T02:25:30.842 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQD/CcBmVo++HhAADJGBfNoy5d4mV58B7ryJeA== 2024-08-17T02:25:30.843 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.1] 2024-08-17T02:25:30.843 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQACCsBmoQ9XIxAAuVnPjkH1q/zbdSr+wNBUQg== 2024-08-17T02:25:30.843 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.2] 2024-08-17T02:25:30.843 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQAFCsBm2vH/JBAAARKKRyz95fL8kJUwrGD1QA== 2024-08-17T02:25:30.843 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.3] 2024-08-17T02:25:30.843 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQAICsBm9lQSKhAAoDfvXgpICdZzv+wOiLu5ag== 2024-08-17T02:25:30.843 INFO:teuthology.orchestra.run.smithi174.stdout:[mgr.x] 2024-08-17T02:25:30.843 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQD8CcBmgCTrFBAAuuFSiFL5Mys0z2lfN4+tPA== 2024-08-17T02:25:30.843 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.b] 2024-08-17T02:25:30.843 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQD8CcBmnQmgIRAAuDBR2XGip6zNsZAxr0MLLw== 2024-08-17T02:25:30.843 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.d] 2024-08-17T02:25:30.843 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQD8CcBmRBUTJRAA0tObsMEc2W5pq4LJMGTPZA== 2024-08-17T02:25:30.844 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.4] 2024-08-17T02:25:30.844 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQAOCsBmWYGgDBAANfj9Q4yqEhT6kLVMhyc06w== 2024-08-17T02:25:30.844 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.5] 2024-08-17T02:25:30.844 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQARCsBmRJkvERAAriyC92UbxvDvOHjA4LxFbQ== 2024-08-17T02:25:30.844 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.6] 2024-08-17T02:25:30.844 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQAUCsBmkmLKERAA02WSRiTSFugNJFeePCCXdQ== 2024-08-17T02:25:30.844 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.7] 2024-08-17T02:25:30.844 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQAXCsBmhGolFhAAwkUO3YePQzExT6dK/BC5xQ== 2024-08-17T02:25:30.844 INFO:teuthology.orchestra.run.smithi174.stdout:[client.0] 2024-08-17T02:25:30.844 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQD8CcBmfJk+KBAAY2Mtg0xuAkxYn7ISl/rQAw== 2024-08-17T02:25:30.844 INFO:teuthology.orchestra.run.smithi174.stdout:[client.2] 2024-08-17T02:25:30.844 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQD8CcBmWH60LRAAVWXjLB37JpBi/+K3bXMesg== 2024-08-17T02:25:30.844 INFO:teuthology.orchestra.run.smithi174.stdout:[client.1] 2024-08-17T02:25:30.844 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQD8CcBm6iuxMBAAZUapzmHbnkW+kkorhcR7MA== 2024-08-17T02:25:30.845 INFO:teuthology.orchestra.run.smithi174.stdout:[client.3] 2024-08-17T02:25:30.845 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQD8CcBmFXZUMxAAzeJqvSL/sTLVMZOdTJk7Cg== 2024-08-17T02:25:30.846 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr.y] 2024-08-17T02:25:30.846 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQD8CcBm1lgwEhAAYBzLN+/4eml8Dac0VcnqGA== 2024-08-17T02:25:30.846 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.a] 2024-08-17T02:25:30.846 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQD8CcBm2U+sFxAAzA6rDgNnZkpY9gZMrTw2ug== 2024-08-17T02:25:30.846 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.c] 2024-08-17T02:25:30.847 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQD8CcBmfUDIHRAAnioAeAUXY2NHEockqg8e0A== 2024-08-17T02:25:30.847 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.0] 2024-08-17T02:25:30.847 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQD/CcBmVo++HhAADJGBfNoy5d4mV58B7ryJeA== 2024-08-17T02:25:30.847 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.1] 2024-08-17T02:25:30.847 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQACCsBmoQ9XIxAAuVnPjkH1q/zbdSr+wNBUQg== 2024-08-17T02:25:30.847 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.2] 2024-08-17T02:25:30.847 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQAFCsBm2vH/JBAAARKKRyz95fL8kJUwrGD1QA== 2024-08-17T02:25:30.847 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.3] 2024-08-17T02:25:30.847 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQAICsBm9lQSKhAAoDfvXgpICdZzv+wOiLu5ag== 2024-08-17T02:25:30.847 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr.x] 2024-08-17T02:25:30.847 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQD8CcBmgCTrFBAAuuFSiFL5Mys0z2lfN4+tPA== 2024-08-17T02:25:30.847 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.b] 2024-08-17T02:25:30.848 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQD8CcBmnQmgIRAAuDBR2XGip6zNsZAxr0MLLw== 2024-08-17T02:25:30.848 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.d] 2024-08-17T02:25:30.848 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQD8CcBmRBUTJRAA0tObsMEc2W5pq4LJMGTPZA== 2024-08-17T02:25:30.848 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.4] 2024-08-17T02:25:30.848 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQAOCsBmWYGgDBAANfj9Q4yqEhT6kLVMhyc06w== 2024-08-17T02:25:30.848 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.5] 2024-08-17T02:25:30.848 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQARCsBmRJkvERAAriyC92UbxvDvOHjA4LxFbQ== 2024-08-17T02:25:30.848 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.6] 2024-08-17T02:25:30.848 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQAUCsBmkmLKERAA02WSRiTSFugNJFeePCCXdQ== 2024-08-17T02:25:30.848 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.7] 2024-08-17T02:25:30.848 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQAXCsBmhGolFhAAwkUO3YePQzExT6dK/BC5xQ== 2024-08-17T02:25:30.848 INFO:teuthology.orchestra.run.smithi153.stdout:[client.0] 2024-08-17T02:25:30.848 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQD8CcBmfJk+KBAAY2Mtg0xuAkxYn7ISl/rQAw== 2024-08-17T02:25:30.849 INFO:teuthology.orchestra.run.smithi153.stdout:[client.2] 2024-08-17T02:25:30.849 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQD8CcBmWH60LRAAVWXjLB37JpBi/+K3bXMesg== 2024-08-17T02:25:30.849 INFO:teuthology.orchestra.run.smithi153.stdout:[client.1] 2024-08-17T02:25:30.849 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQD8CcBm6iuxMBAAZUapzmHbnkW+kkorhcR7MA== 2024-08-17T02:25:30.849 INFO:teuthology.orchestra.run.smithi153.stdout:[client.3] 2024-08-17T02:25:30.849 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQD8CcBmFXZUMxAAzeJqvSL/sTLVMZOdTJk7Cg== 2024-08-17T02:25:30.849 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:25:30.888 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:25:30.996 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:25:30.999 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:25:31.047 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:25:31.050 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:25:31.102 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:31.104 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:31.176 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:31.192 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:31.240 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:31.242 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:31.285 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:31.332 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:31.377 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:25:31.379 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:25:31.424 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:25:31.427 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:25:31.513 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:25:31.515 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:25:31.564 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:31.566 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:31.609 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:31.612 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:31.700 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:31.702 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:31.747 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:31.788 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:31.834 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:25:31.836 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:25:31.928 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:25:31.930 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:25:31.979 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:25:31.981 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:25:32.028 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:25:32.030 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:25:32.114 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-08-17T02:25:32.115 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-08-17T02:25:32.134 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:25:32.184 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-08-17T02:25:32.197 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-08-17T02:25:32.212 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:25:32.262 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-08-17T02:25:32.275 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-08-17T02:25:32.288 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:25:32.338 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-08-17T02:25:32.350 DEBUG:teuthology.orchestra.run.smithi153:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:32.352 DEBUG:teuthology.orchestra.run.smithi174:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:32.357 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-08-17T02:25:32.358 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-17T02:25:32.358 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-17T02:25:32.360 INFO:tasks.ceph.mon.a:Started 2024-08-17T02:25:32.360 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-17T02:25:32.360 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-17T02:25:32.403 INFO:tasks.ceph.mon.b:Started 2024-08-17T02:25:32.403 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-17T02:25:32.403 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-17T02:25:32.405 INFO:tasks.ceph.mon.c:Started 2024-08-17T02:25:32.406 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-08-17T02:25:32.406 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-08-17T02:25:32.406 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-08-17T02:25:32.408 INFO:tasks.ceph.mgr.y:Started 2024-08-17T02:25:32.408 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-08-17T02:25:32.408 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-08-17T02:25:32.410 INFO:tasks.ceph.mgr.x:Started 2024-08-17T02:25:32.411 INFO:tasks.ceph:Setting crush tunables to default 2024-08-17T02:25:32.411 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd crush tunables default 2024-08-17T02:25:32.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:32.505+0000 7fa047009700 1 Processor -- start 2024-08-17T02:25:32.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:32.505+0000 7fa047009700 1 -- start start 2024-08-17T02:25:32.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:32.509+0000 7fa047009700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa040068db0 0x7fa040150580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:32.509+0000 7fa047009700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa04015a3b0 con 0x7fa0401501b0 2024-08-17T02:25:32.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:32.509+0000 7fa047009700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0400b0550 con 0x7fa0400ab860 2024-08-17T02:25:32.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:32.509+0000 7fa046007700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fa0401501b0 0x7fa040156e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:37620/0 (socket says 172.21.15.153:37620) 2024-08-17T02:25:32.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:32.509+0000 7fa046007700 1 -- 172.21.15.153:0/3568477578 learned_addr learned my addr 172.21.15.153:0/3568477578 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:25:32.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:32.509+0000 7fa047009700 1 -- 172.21.15.153:0/3568477578 --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa040159ac0 con 0x7fa040068db0 2024-08-17T02:25:32.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:32.509+0000 7fa046808700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa040068db0 0x7fa040150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:32.509+0000 7fa046808700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa040068db0 msgr2=0x7fa040150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:25:32.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:32.509+0000 7fa046808700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa040068db0 msgr2=0x7fa040150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:32.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:32.509+0000 7fa046808700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa040068db0 0x7fa040150580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:32.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:32.509+0000 7fa046808700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa040068db0 0x7fa040150580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:25:32.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:32.709+0000 7fa046808700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa040068db0 0x7fa040150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:32.713+0000 7fa046808700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa040068db0 msgr2=0x7fa040150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:25:32.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:32.713+0000 7fa046808700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa040068db0 msgr2=0x7fa040150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:32.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:32.713+0000 7fa046808700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa040068db0 0x7fa040150580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:32.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:32.713+0000 7fa046808700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa040068db0 0x7fa040150580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:25:33.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:33.113+0000 7fa046808700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa040068db0 0x7fa040150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:33.113+0000 7fa046808700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa040068db0 msgr2=0x7fa040150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:25:33.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:33.113+0000 7fa046808700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa040068db0 msgr2=0x7fa040150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:33.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:33.113+0000 7fa046808700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa040068db0 0x7fa040150580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:33.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:33.113+0000 7fa046808700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa040068db0 0x7fa040150580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-17T02:25:33.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:33.913+0000 7fa046808700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa040068db0 0x7fa040150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:33.913+0000 7fa046808700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa040068db0 msgr2=0x7fa040150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:25:33.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:33.913+0000 7fa046808700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa040068db0 msgr2=0x7fa040150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:33.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:33.913+0000 7fa046808700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa040068db0 0x7fa040150580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:33.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:33.913+0000 7fa046808700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa040068db0 0x7fa040150580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-17T02:25:35.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:35.509+0000 7fa037fff700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa040068db0 msgr2=0x7fa040150580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:25:35.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:35.509+0000 7fa037fff700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa040068db0 0x7fa040150580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:35.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:35.509+0000 7fa037fff700 1 -- 172.21.15.153:0/3568477578 >> v1:172.21.15.174:6789/0 conn(0x7fa0400ab860 legacy=0x7fa0400686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:35.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:35.509+0000 7fa037fff700 1 -- 172.21.15.153:0/3568477578 >> v1:172.21.15.153:6789/0 conn(0x7fa0401501b0 legacy=0x7fa040156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:35.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:35.509+0000 7fa037fff700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa024005970 0x7fa024007d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:35.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:35.509+0000 7fa037fff700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024008420 0x7fa02400a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:35.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:35.509+0000 7fa037fff700 1 -- 172.21.15.153:0/3568477578 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa040159ac0 con 0x7fa024008420 2024-08-17T02:25:35.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:35.509+0000 7fa037fff700 1 -- 172.21.15.153:0/3568477578 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa02400af80 con 0x7fa024005970 2024-08-17T02:25:35.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:35.509+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024008420 0x7fa02400a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:35.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:35.509+0000 7fa046007700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa024005970 0x7fa024007d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:35.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:35.509+0000 7fa045806700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024008420 msgr2=0x7fa02400a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:25:35.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:35.509+0000 7fa045806700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024008420 msgr2=0x7fa02400a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:35.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:35.509+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024008420 0x7fa02400a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:35.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:35.509+0000 7fa046007700 1 -- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa024005970 msgr2=0x7fa024007d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:25:35.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:35.509+0000 7fa046007700 1 -- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa024005970 msgr2=0x7fa024007d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:35.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:35.509+0000 7fa046007700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa024005970 0x7fa024007d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:35.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:35.509+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024008420 0x7fa02400a8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:25:35.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:35.509+0000 7fa046007700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa024005970 0x7fa024007d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:25:35.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:35.709+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024008420 0x7fa02400a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:35.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:35.713+0000 7fa046007700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa024005970 0x7fa024007d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:35.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:35.713+0000 7fa045806700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024008420 msgr2=0x7fa02400a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:25:35.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:35.713+0000 7fa045806700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024008420 msgr2=0x7fa02400a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:35.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:35.713+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024008420 0x7fa02400a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:35.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:35.713+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024008420 0x7fa02400a8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:25:35.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:35.713+0000 7fa046007700 1 -- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa024005970 msgr2=0x7fa024007d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:25:35.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:35.713+0000 7fa046007700 1 -- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa024005970 msgr2=0x7fa024007d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:35.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:35.713+0000 7fa046007700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa024005970 0x7fa024007d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:35.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:35.713+0000 7fa046007700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa024005970 0x7fa024007d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:25:36.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:36.113+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024008420 0x7fa02400a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:36.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:36.113+0000 7fa046007700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa024005970 0x7fa024007d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:36.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:36.113+0000 7fa045806700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024008420 msgr2=0x7fa02400a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:25:36.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:36.113+0000 7fa045806700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024008420 msgr2=0x7fa02400a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:36.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:36.113+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024008420 0x7fa02400a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:36.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:36.113+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024008420 0x7fa02400a8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-17T02:25:36.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:36.113+0000 7fa046007700 1 -- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa024005970 msgr2=0x7fa024007d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:25:36.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:36.113+0000 7fa046007700 1 -- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa024005970 msgr2=0x7fa024007d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:36.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:36.113+0000 7fa046007700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa024005970 0x7fa024007d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:36.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:36.113+0000 7fa046007700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa024005970 0x7fa024007d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-17T02:25:36.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:36.913+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024008420 0x7fa02400a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:36.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:36.913+0000 7fa045806700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024008420 msgr2=0x7fa02400a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:25:36.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:36.913+0000 7fa046007700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa024005970 0x7fa024007d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:36.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:36.913+0000 7fa045806700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024008420 msgr2=0x7fa02400a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:36.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:36.913+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024008420 0x7fa02400a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:36.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:36.913+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024008420 0x7fa02400a8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-17T02:25:36.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:36.913+0000 7fa046007700 1 -- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa024005970 msgr2=0x7fa024007d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:25:36.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:36.913+0000 7fa046007700 1 -- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa024005970 msgr2=0x7fa024007d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:36.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:36.913+0000 7fa046007700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa024005970 0x7fa024007d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:36.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:36.913+0000 7fa046007700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa024005970 0x7fa024007d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-17T02:25:38.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:38.509+0000 7fa037fff700 1 -- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa024005970 msgr2=0x7fa024007d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:25:38.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:38.509+0000 7fa037fff700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa024005970 0x7fa024007d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:38.509+0000 7fa037fff700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024008420 msgr2=0x7fa02400a8d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:25:38.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:38.509+0000 7fa037fff700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024008420 0x7fa02400a8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:38.509+0000 7fa046808700 1 -- 172.21.15.153:0/3568477578 reap_dead start 2024-08-17T02:25:38.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:38.509+0000 7fa037fff700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 0x7fa02400a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:38.509+0000 7fa037fff700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa02400a940 0x7fa02400f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:38.509+0000 7fa037fff700 1 -- 172.21.15.153:0/3568477578 --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa040159d60 con 0x7fa024005d80 2024-08-17T02:25:38.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:38.509+0000 7fa037fff700 1 -- 172.21.15.153:0/3568477578 --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa040159ac0 con 0x7fa024009fe0 2024-08-17T02:25:38.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:38.509+0000 7fa037fff700 1 -- 172.21.15.153:0/3568477578 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa02400af80 con 0x7fa02400a940 2024-08-17T02:25:38.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:38.509+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 0x7fa02400a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:38.509+0000 7fa046808700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa02400a940 0x7fa02400f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:38.509+0000 7fa045806700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 msgr2=0x7fa02400a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:25:38.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:38.509+0000 7fa045806700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 msgr2=0x7fa02400a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:38.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:38.509+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 0x7fa02400a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:38.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:38.509+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 0x7fa02400a400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:25:38.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:38.509+0000 7fa046808700 1 -- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa02400a940 msgr2=0x7fa02400f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:25:38.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:38.509+0000 7fa046808700 1 -- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa02400a940 msgr2=0x7fa02400f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:38.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:38.509+0000 7fa046808700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa02400a940 0x7fa02400f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:38.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:38.509+0000 7fa046808700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa02400a940 0x7fa02400f3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:25:38.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:38.713+0000 7fa046808700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa02400a940 0x7fa02400f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:38.713+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 0x7fa02400a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:38.713+0000 7fa046808700 1 -- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa02400a940 msgr2=0x7fa02400f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:25:38.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:38.713+0000 7fa045806700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 msgr2=0x7fa02400a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:25:38.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:38.713+0000 7fa046808700 1 -- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa02400a940 msgr2=0x7fa02400f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:38.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:38.713+0000 7fa045806700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 msgr2=0x7fa02400a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:38.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:38.713+0000 7fa046808700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa02400a940 0x7fa02400f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:38.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:38.713+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 0x7fa02400a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:38.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:38.713+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 0x7fa02400a400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:25:38.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:38.713+0000 7fa046808700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa02400a940 0x7fa02400f3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:25:39.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:39.117+0000 7fa046808700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa02400a940 0x7fa02400f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:39.117+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 0x7fa02400a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:39.117+0000 7fa046808700 1 -- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa02400a940 msgr2=0x7fa02400f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:25:39.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:39.117+0000 7fa046808700 1 -- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa02400a940 msgr2=0x7fa02400f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:39.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:39.117+0000 7fa046808700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa02400a940 0x7fa02400f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:39.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:39.117+0000 7fa046808700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa02400a940 0x7fa02400f3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-17T02:25:39.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:39.117+0000 7fa045806700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 msgr2=0x7fa02400a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:25:39.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:39.117+0000 7fa045806700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 msgr2=0x7fa02400a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:39.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:39.117+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 0x7fa02400a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:39.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:39.117+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 0x7fa02400a400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-17T02:25:39.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:39.921+0000 7fa046808700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa02400a940 0x7fa02400f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:39.921+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 0x7fa02400a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:39.921+0000 7fa046808700 1 -- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa02400a940 msgr2=0x7fa02400f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:25:39.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:39.921+0000 7fa046808700 1 -- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa02400a940 msgr2=0x7fa02400f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:39.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:39.921+0000 7fa046808700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa02400a940 0x7fa02400f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:39.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:39.921+0000 7fa046808700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa02400a940 0x7fa02400f3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-17T02:25:39.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:39.921+0000 7fa045806700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 msgr2=0x7fa02400a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:25:39.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:39.921+0000 7fa045806700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 msgr2=0x7fa02400a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:39.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:39.921+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 0x7fa02400a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:39.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:39.921+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 0x7fa02400a400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-17T02:25:41.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:41.509+0000 7fa037fff700 1 -- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa02400a940 msgr2=0x7fa02400f3a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:25:41.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:41.509+0000 7fa037fff700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa02400a940 0x7fa02400f3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:41.509+0000 7fa037fff700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 msgr2=0x7fa02400a400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:25:41.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:41.509+0000 7fa037fff700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 0x7fa02400a400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:41.509+0000 7fa037fff700 1 -- 172.21.15.153:0/3568477578 >> v1:172.21.15.153:6789/0 conn(0x7fa024005d80 legacy=0x7fa0240088c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:41.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:41.509+0000 7fa037fff700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 0x7fa024016240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:41.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:41.509+0000 7fa037fff700 1 -- 172.21.15.153:0/3568477578 --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa024010c10 con 0x7fa02400fcc0 2024-08-17T02:25:41.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:41.509+0000 7fa037fff700 1 -- 172.21.15.153:0/3568477578 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa040159ac0 con 0x7fa024013e60 2024-08-17T02:25:41.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:41.509+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 0x7fa024016240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:41.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:41.513+0000 7fa045806700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 msgr2=0x7fa024016240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:25:41.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:41.513+0000 7fa045806700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 msgr2=0x7fa024016240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:41.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:41.513+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 0x7fa024016240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:41.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:41.513+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 0x7fa024016240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:25:41.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:41.717+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 0x7fa024016240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:41.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:41.717+0000 7fa045806700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 msgr2=0x7fa024016240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:25:41.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:41.717+0000 7fa045806700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 msgr2=0x7fa024016240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:41.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:41.717+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 0x7fa024016240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:41.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:41.717+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 0x7fa024016240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:25:42.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:42.121+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 0x7fa024016240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:42.121+0000 7fa045806700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 msgr2=0x7fa024016240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:25:42.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:42.121+0000 7fa045806700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 msgr2=0x7fa024016240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:42.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:42.121+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 0x7fa024016240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:42.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:42.121+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 0x7fa024016240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-17T02:25:42.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:42.925+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 0x7fa024016240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:42.925+0000 7fa045806700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 msgr2=0x7fa024016240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:25:42.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:42.925+0000 7fa045806700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 msgr2=0x7fa024016240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:42.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:42.925+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 0x7fa024016240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:42.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:42.925+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 0x7fa024016240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-17T02:25:44.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.509+0000 7fa037fff700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 msgr2=0x7fa024016240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:25:44.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.509+0000 7fa037fff700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 0x7fa024016240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.509+0000 7fa037fff700 1 -- 172.21.15.153:0/3568477578 >> v1:172.21.15.174:6789/0 conn(0x7fa02400fcc0 legacy=0x7fa0240100c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.509+0000 7fa046808700 1 -- 172.21.15.153:0/3568477578 reap_dead start 2024-08-17T02:25:44.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.509+0000 7fa037fff700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 0x7fa02400a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.509+0000 7fa037fff700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 0x7fa024016240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.509+0000 7fa037fff700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0240100c0 0x7fa0240168b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.509+0000 7fa037fff700 1 -- 172.21.15.153:0/3568477578 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa040159ac0 con 0x7fa024013e60 2024-08-17T02:25:44.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.509+0000 7fa037fff700 1 -- 172.21.15.153:0/3568477578 --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa02400af80 con 0x7fa024009fe0 2024-08-17T02:25:44.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.509+0000 7fa037fff700 1 -- 172.21.15.153:0/3568477578 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa024010620 con 0x7fa0240100c0 2024-08-17T02:25:44.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.513+0000 7fa046007700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 0x7fa02400a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.513+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 0x7fa024016240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.513+0000 7fa046808700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0240100c0 0x7fa0240168b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.513+0000 7fa045806700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 msgr2=0x7fa024016240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:25:44.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.513+0000 7fa045806700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 msgr2=0x7fa024016240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:44.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.513+0000 7fa046007700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 msgr2=0x7fa02400a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:25:44.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.513+0000 7fa046007700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 msgr2=0x7fa02400a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:44.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.513+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 0x7fa024016240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:44.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.513+0000 7fa046007700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 0x7fa02400a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:44.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.513+0000 7fa046007700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 0x7fa02400a400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:25:44.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.513+0000 7fa046808700 1 -- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0240100c0 msgr2=0x7fa0240168b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:25:44.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.513+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 0x7fa024016240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:25:44.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.513+0000 7fa046808700 1 -- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0240100c0 msgr2=0x7fa0240168b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:44.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.513+0000 7fa046808700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0240100c0 0x7fa0240168b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:44.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.513+0000 7fa046808700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0240100c0 0x7fa0240168b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:25:44.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.717+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 0x7fa024016240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.717+0000 7fa046007700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 0x7fa02400a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.717+0000 7fa045806700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 msgr2=0x7fa024016240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:25:44.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.717+0000 7fa046808700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0240100c0 0x7fa0240168b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.717+0000 7fa045806700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 msgr2=0x7fa024016240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:44.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.717+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 0x7fa024016240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:44.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.717+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 0x7fa024016240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:25:44.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.717+0000 7fa046007700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 msgr2=0x7fa02400a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:25:44.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.717+0000 7fa046007700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 msgr2=0x7fa02400a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:44.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.717+0000 7fa046007700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 0x7fa02400a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:44.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.717+0000 7fa046007700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 0x7fa02400a400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:25:44.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.717+0000 7fa046808700 1 -- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0240100c0 msgr2=0x7fa0240168b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:25:44.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.717+0000 7fa046808700 1 -- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0240100c0 msgr2=0x7fa0240168b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:44.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.717+0000 7fa046808700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0240100c0 0x7fa0240168b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:44.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:44.717+0000 7fa046808700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0240100c0 0x7fa0240168b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:25:45.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:45.121+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 0x7fa024016240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:45.121+0000 7fa046007700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 0x7fa02400a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:45.121+0000 7fa045806700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 msgr2=0x7fa024016240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:25:45.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:45.121+0000 7fa045806700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 msgr2=0x7fa024016240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:45.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:45.121+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 0x7fa024016240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:45.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:45.121+0000 7fa046808700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0240100c0 0x7fa0240168b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:45.121+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 0x7fa024016240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-17T02:25:45.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:45.121+0000 7fa046007700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 msgr2=0x7fa02400a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:25:45.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:45.121+0000 7fa046007700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 msgr2=0x7fa02400a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:45.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:45.121+0000 7fa046007700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 0x7fa02400a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:45.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:45.121+0000 7fa046007700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 0x7fa02400a400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-17T02:25:45.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:45.121+0000 7fa046808700 1 -- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0240100c0 msgr2=0x7fa0240168b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:25:45.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:45.121+0000 7fa046808700 1 -- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0240100c0 msgr2=0x7fa0240168b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:45.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:45.121+0000 7fa046808700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0240100c0 0x7fa0240168b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:45.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:45.121+0000 7fa046808700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0240100c0 0x7fa0240168b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-17T02:25:45.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:45.925+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 0x7fa024016240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:45.925+0000 7fa046007700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 0x7fa02400a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:45.925+0000 7fa045806700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 msgr2=0x7fa024016240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:25:45.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:45.925+0000 7fa046808700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0240100c0 0x7fa0240168b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:45.925+0000 7fa045806700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 msgr2=0x7fa024016240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:45.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:45.925+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 0x7fa024016240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:45.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:45.925+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 0x7fa024016240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-17T02:25:45.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:45.925+0000 7fa046808700 1 -- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0240100c0 msgr2=0x7fa0240168b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:25:45.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:45.925+0000 7fa046808700 1 -- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0240100c0 msgr2=0x7fa0240168b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:45.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:45.925+0000 7fa046808700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0240100c0 0x7fa0240168b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:45.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:45.925+0000 7fa046808700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0240100c0 0x7fa0240168b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-17T02:25:45.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:45.925+0000 7fa046007700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 msgr2=0x7fa02400a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:25:45.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:45.925+0000 7fa046007700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 msgr2=0x7fa02400a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:45.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:45.925+0000 7fa046007700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 0x7fa02400a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:45.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:45.925+0000 7fa046007700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 0x7fa02400a400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-17T02:25:47.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.509+0000 7fa037fff700 1 -- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0240100c0 msgr2=0x7fa0240168b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:25:47.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.509+0000 7fa037fff700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0240100c0 0x7fa0240168b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:47.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.513+0000 7fa037fff700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 msgr2=0x7fa02400a400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:25:47.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.513+0000 7fa037fff700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.174:3300/0 conn(0x7fa024009fe0 0x7fa02400a400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:47.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.513+0000 7fa037fff700 1 -- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 msgr2=0x7fa024016240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:25:47.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.513+0000 7fa037fff700 1 --2- 172.21.15.153:0/3568477578 >> v2:172.21.15.153:3300/0 conn(0x7fa024013e60 0x7fa024016240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:47.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.513+0000 7fa037fff700 1 -- 172.21.15.153:0/3568477578 --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa024017790 con 0x7fa0240171c0 2024-08-17T02:25:47.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.513+0000 7fa037fff700 1 -- 172.21.15.153:0/3568477578 --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0240175c0 con 0x7fa024016df0 2024-08-17T02:25:47.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.777+0000 7fa045005700 1 -- 172.21.15.153:0/3568477578 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3180182419 0 0) 0x7fa024017790 con 0x7fa0240171c0 2024-08-17T02:25:47.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.777+0000 7fa045005700 1 -- 172.21.15.153:0/3568477578 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa02c003570 con 0x7fa0240171c0 2024-08-17T02:25:47.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.777+0000 7fa045005700 1 -- 172.21.15.153:0/3568477578 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3865571367 0 0) 0x7fa0240175c0 con 0x7fa024016df0 2024-08-17T02:25:47.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.777+0000 7fa045005700 1 -- 172.21.15.153:0/3568477578 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa024017790 con 0x7fa024016df0 2024-08-17T02:25:47.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.777+0000 7fa045005700 1 -- 172.21.15.153:0/3568477578 <== mon.1 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1497025664 0 0) 0x7fa024017790 con 0x7fa024016df0 2024-08-17T02:25:47.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.777+0000 7fa045005700 1 -- 172.21.15.153:0/3568477578 >> v1:172.21.15.153:6789/0 conn(0x7fa0240171c0 legacy=0x7fa024010e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:47.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.777+0000 7fa045005700 1 -- 172.21.15.153:0/3568477578 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa024007f10 con 0x7fa024016df0 2024-08-17T02:25:47.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.777+0000 7fa045005700 1 -- 172.21.15.153:0/3568477578 <== mon.1 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3701463666 0 0) 0x7fa03c001cc0 con 0x7fa024016df0 2024-08-17T02:25:47.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.777+0000 7fa045005700 1 -- 172.21.15.153:0/3568477578 >> v1:172.21.15.174:6789/0 conn(0x7fa024016df0 legacy=0x7fa024008820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:47.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.777+0000 7fa046808700 1 -- 172.21.15.153:0/3568477578 reap_dead start 2024-08-17T02:25:47.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.777+0000 7fa045005700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa02c003bf0 0x7fa02c003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:47.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.777+0000 7fa045005700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0240100c0 0x7fa02c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:47.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.777+0000 7fa045005700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa02c004d50 0x7fa02c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:47.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.777+0000 7fa045005700 1 -- 172.21.15.153:0/3568477578 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c00bc60 con 0x7fa02c003bf0 2024-08-17T02:25:47.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.777+0000 7fa045005700 1 -- 172.21.15.153:0/3568477578 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c00bdd0 con 0x7fa02c004d50 2024-08-17T02:25:47.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.777+0000 7fa045005700 1 -- 172.21.15.153:0/3568477578 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c00bf90 con 0x7fa0240100c0 2024-08-17T02:25:47.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.777+0000 7fa046007700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa02c003bf0 0x7fa02c003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:47.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.777+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0240100c0 0x7fa02c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:47.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.777+0000 7fa046808700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa02c004d50 0x7fa02c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:47.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.781+0000 7fa045806700 1 -- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa02c004d50 msgr2=0x7fa02c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:47.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.781+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa02c004d50 0x7fa02c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:47.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.781+0000 7fa045806700 1 -- 172.21.15.153:0/3568477578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa02c003bf0 msgr2=0x7fa02c003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:47.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.781+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa02c003bf0 0x7fa02c003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:47.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.781+0000 7fa045806700 1 -- 172.21.15.153:0/3568477578 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa024017790 con 0x7fa0240100c0 2024-08-17T02:25:47.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.781+0000 7fa046007700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa02c003bf0 0x7fa02c003fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:47.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.781+0000 7fa045806700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0240100c0 0x7fa02c004810 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa030007fd0 tx=0x7fa030009040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bb3def10d152953 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:47.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.781+0000 7fa045005700 1 -- 172.21.15.153:0/3568477578 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03001c0d0 con 0x7fa0240100c0 2024-08-17T02:25:47.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.781+0000 7fa045005700 1 -- 172.21.15.153:0/3568477578 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa030020040 con 0x7fa0240100c0 2024-08-17T02:25:47.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.781+0000 7fa045005700 1 -- 172.21.15.153:0/3568477578 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03001c270 con 0x7fa0240100c0 2024-08-17T02:25:47.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.781+0000 7fa047009700 1 -- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0240100c0 msgr2=0x7fa02c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:47.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.781+0000 7fa047009700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0240100c0 0x7fa02c004810 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa030007fd0 tx=0x7fa030009040 comp rx=0 tx=0).stop 2024-08-17T02:25:47.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.781+0000 7fa047009700 1 -- 172.21.15.153:0/3568477578 shutdown_connections 2024-08-17T02:25:47.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.781+0000 7fa047009700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa02c004d50 0x7fa02c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:47.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.781+0000 7fa047009700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0240100c0 0x7fa02c004810 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:47.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.781+0000 7fa047009700 1 --2- 172.21.15.153:0/3568477578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa02c003bf0 0x7fa02c003fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:47.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.781+0000 7fa047009700 1 -- 172.21.15.153:0/3568477578 >> 172.21.15.153:0/3568477578 conn(0x7fa04006e350 msgr2=0x7fa04006b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:47.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.781+0000 7fa047009700 1 -- 172.21.15.153:0/3568477578 shutdown_connections 2024-08-17T02:25:47.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.785+0000 7fa047009700 1 -- 172.21.15.153:0/3568477578 wait complete. 2024-08-17T02:25:47.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.785+0000 7fa047009700 1 Processor -- start 2024-08-17T02:25:47.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.785+0000 7fa047009700 1 -- start start 2024-08-17T02:25:47.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.789+0000 7fa047009700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0240100c0 0x7fa040152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:47.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.789+0000 7fa047009700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa02c003bf0 0x7fa040168bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:47.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.789+0000 7fa047009700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa02c004d50 0x7fa040156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:47.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.789+0000 7fa047009700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0401690f0 con 0x7fa0240100c0 2024-08-17T02:25:47.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.789+0000 7fa047009700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa040150eb0 con 0x7fa02c003bf0 2024-08-17T02:25:47.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.789+0000 7fa047009700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa040156980 con 0x7fa02c004d50 2024-08-17T02:25:47.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.789+0000 7fa046007700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0240100c0 0x7fa040152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:47.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.789+0000 7fa046007700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0240100c0 0x7fa040152db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38126/0 (socket says 172.21.15.153:38126) 2024-08-17T02:25:47.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.789+0000 7fa046007700 1 -- 172.21.15.153:0/3165504317 learned_addr learned my addr 172.21.15.153:0/3165504317 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:25:47.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.789+0000 7fa045806700 1 --2- 172.21.15.153:0/3165504317 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa02c003bf0 0x7fa040168bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:47.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.789+0000 7fa046808700 1 --2- 172.21.15.153:0/3165504317 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa02c004d50 0x7fa040156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:47.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.789+0000 7fa046007700 1 -- 172.21.15.153:0/3165504317 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa02c004d50 msgr2=0x7fa040156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:47.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.789+0000 7fa046007700 1 --2- 172.21.15.153:0/3165504317 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa02c004d50 0x7fa040156440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:47.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.789+0000 7fa046007700 1 -- 172.21.15.153:0/3165504317 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa02c003bf0 msgr2=0x7fa040168bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:47.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.789+0000 7fa046007700 1 --2- 172.21.15.153:0/3165504317 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa02c003bf0 0x7fa040168bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:47.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.789+0000 7fa046007700 1 -- 172.21.15.153:0/3165504317 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0401533b0 con 0x7fa0240100c0 2024-08-17T02:25:47.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.789+0000 7fa046007700 1 --2- 172.21.15.153:0/3165504317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0240100c0 0x7fa040152db0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa03c007ae0 tx=0x7fa03c01e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:47.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.789+0000 7fa0367fc700 1 -- 172.21.15.153:0/3165504317 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c007b10 con 0x7fa0240100c0 2024-08-17T02:25:47.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.789+0000 7fa0367fc700 1 -- 172.21.15.153:0/3165504317 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03c022040 con 0x7fa0240100c0 2024-08-17T02:25:47.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.789+0000 7fa047009700 1 -- 172.21.15.153:0/3165504317 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa040150580 con 0x7fa0240100c0 2024-08-17T02:25:47.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.789+0000 7fa0367fc700 1 -- 172.21.15.153:0/3165504317 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c01c050 con 0x7fa0240100c0 2024-08-17T02:25:47.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.789+0000 7fa047009700 1 -- 172.21.15.153:0/3165504317 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa040150b40 con 0x7fa0240100c0 2024-08-17T02:25:47.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.793+0000 7fa0367fc700 1 -- 172.21.15.153:0/3165504317 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fa03c01c480 con 0x7fa0240100c0 2024-08-17T02:25:47.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.793+0000 7fa0367fc700 1 -- 172.21.15.153:0/3165504317 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa03c01bd10 con 0x7fa0240100c0 2024-08-17T02:25:47.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.793+0000 7fa047009700 1 -- 172.21.15.153:0/3165504317 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0400638f0 con 0x7fa0240100c0 2024-08-17T02:25:47.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.793+0000 7fa0367fc700 1 -- 172.21.15.153:0/3165504317 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fa03c035060 con 0x7fa0240100c0 2024-08-17T02:25:47.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.865+0000 7fa047009700 1 -- 172.21.15.153:0/3165504317 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fa0400638f0 con 0x7fa0240100c0 2024-08-17T02:25:47.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.869+0000 7fa0367fc700 1 -- 172.21.15.153:0/3165504317 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fa03c02b070 con 0x7fa0240100c0 2024-08-17T02:25:47.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.869+0000 7fa047009700 1 -- 172.21.15.153:0/3165504317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0240100c0 msgr2=0x7fa040152db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:47.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.869+0000 7fa047009700 1 --2- 172.21.15.153:0/3165504317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0240100c0 0x7fa040152db0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa03c007ae0 tx=0x7fa03c01e040 comp rx=0 tx=0).stop 2024-08-17T02:25:47.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.869+0000 7fa047009700 1 -- 172.21.15.153:0/3165504317 shutdown_connections 2024-08-17T02:25:47.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.869+0000 7fa047009700 1 --2- 172.21.15.153:0/3165504317 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa02c004d50 0x7fa040156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:47.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.869+0000 7fa047009700 1 --2- 172.21.15.153:0/3165504317 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa02c003bf0 0x7fa040168bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:47.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.869+0000 7fa047009700 1 --2- 172.21.15.153:0/3165504317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0240100c0 0x7fa040152db0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:47.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.869+0000 7fa047009700 1 -- 172.21.15.153:0/3165504317 >> 172.21.15.153:0/3165504317 conn(0x7fa04006e350 msgr2=0x7fa0400ac130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:47.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.869+0000 7fa047009700 1 -- 172.21.15.153:0/3165504317 shutdown_connections 2024-08-17T02:25:47.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:47.869+0000 7fa047009700 1 -- 172.21.15.153:0/3165504317 wait complete. 2024-08-17T02:25:47.875 INFO:teuthology.orchestra.run.smithi153.stderr:adjusted tunables profile to default 2024-08-17T02:25:47.886 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-08-17T02:25:47.886 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-08-17T02:25:47.887 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-08-17T02:25:47.897 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-08-17T02:25:47.897 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-08-17T02:25:47.906 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-08-17T02:25:47.907 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-08-17T02:25:47.916 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-08-17T02:25:47.916 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-08-17T02:25:47.971 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-08-17T02:25:47.971 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-08-17T02:25:47.974 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-08-17T02:25:47.969+0000 7f19132dd000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:25:47.987 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-08-17T02:25:47.987 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-08-17T02:25:47.995 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-08-17T02:25:47.995 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-08-17T02:25:48.000 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-08-17T02:25:47.995+0000 7f51463a9000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:25:48.006 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-08-17T02:25:48.006 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-08-17T02:25:48.021 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new 0736f8e6-818e-42e6-a0dc-8aaf813315d3 0 2024-08-17T02:25:48.170 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.167+0000 7ff82f59e700 1 Processor -- start 2024-08-17T02:25:48.170 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.167+0000 7ff82f59e700 1 -- start start 2024-08-17T02:25:48.171 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.167+0000 7ff82f59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8300b0fa0 0x7ff8300b1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.171 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.167+0000 7ff82f59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8300b3970 con 0x7ff830142b90 2024-08-17T02:25:48.171 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.167+0000 7ff82f59e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8300b3c50 con 0x7ff8300b2db0 2024-08-17T02:25:48.171 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.167+0000 7ff82f59e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8300b3f30 con 0x7ff8300b0fa0 2024-08-17T02:25:48.171 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.167+0000 7ff82e59c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8300b0fa0 0x7ff8300b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.171 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.167+0000 7ff82dd9b700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7ff8300b2db0 0x7ff830142480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:34410/0 (socket says 172.21.15.174:34410) 2024-08-17T02:25:48.171 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.167+0000 7ff82dd9b700 1 -- 172.21.15.174:0/3101395490 learned_addr learned my addr 172.21.15.174:0/3101395490 (peer_addr_for_me v1:172.21.15.174:0/0) 2024-08-17T02:25:48.173 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.167+0000 7ff82e59c700 1 -- 172.21.15.174:0/3101395490 >> v1:172.21.15.174:6789/0 conn(0x7ff8300b2db0 legacy=0x7ff830142480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.173 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.167+0000 7ff82e59c700 1 -- 172.21.15.174:0/3101395490 >> v1:172.21.15.153:6789/0 conn(0x7ff830142b90 legacy=0x7ff830068fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.173 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.167+0000 7ff82d59a700 1 -- 172.21.15.174:0/3101395490 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3075929445 0 0) 0x7ff8300b3c50 con 0x7ff8300b2db0 2024-08-17T02:25:48.173 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.167+0000 7ff82e59c700 1 -- 172.21.15.174:0/3101395490 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8300687c0 con 0x7ff8300b0fa0 2024-08-17T02:25:48.173 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.167+0000 7ff82e59c700 1 --2- 172.21.15.174:0/3101395490 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8300b0fa0 0x7ff8300b1370 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff820009910 tx=0x7ff8200091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6b136c67e443177 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:48.173 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.167+0000 7ff82d59a700 1 -- 172.21.15.174:0/3101395490 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82000b860 con 0x7ff8300b0fa0 2024-08-17T02:25:48.173 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.167+0000 7ff82d59a700 1 -- 172.21.15.174:0/3101395490 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82000b9c0 con 0x7ff8300b0fa0 2024-08-17T02:25:48.173 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.167+0000 7ff82d59a700 1 -- 172.21.15.174:0/3101395490 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82000bd60 con 0x7ff8300b0fa0 2024-08-17T02:25:48.173 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.167+0000 7ff82f59e700 1 -- 172.21.15.174:0/3101395490 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8300b0fa0 msgr2=0x7ff8300b1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.174 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.167+0000 7ff82f59e700 1 --2- 172.21.15.174:0/3101395490 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8300b0fa0 0x7ff8300b1370 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff820009910 tx=0x7ff8200091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.174 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.167+0000 7ff82f59e700 1 -- 172.21.15.174:0/3101395490 shutdown_connections 2024-08-17T02:25:48.174 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.167+0000 7ff82f59e700 1 --2- 172.21.15.174:0/3101395490 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8300b0fa0 0x7ff8300b1370 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.174 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.167+0000 7ff82f59e700 1 -- 172.21.15.174:0/3101395490 >> 172.21.15.174:0/3101395490 conn(0x7ff83006cbe0 msgr2=0x7ff83006cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:48.174 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.167+0000 7ff82f59e700 1 -- 172.21.15.174:0/3101395490 shutdown_connections 2024-08-17T02:25:48.174 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.167+0000 7ff82f59e700 1 -- 172.21.15.174:0/3101395490 wait complete. 2024-08-17T02:25:48.176 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.171+0000 7ff82f59e700 1 Processor -- start 2024-08-17T02:25:48.176 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.171+0000 7ff82f59e700 1 -- start start 2024-08-17T02:25:48.176 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.171+0000 7ff82f59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8300b0fa0 0x7ff83016ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.176 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.171+0000 7ff82f59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8300b2db0 0x7ff83016c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.177 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.171+0000 7ff82f59e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff830142b90 0x7ff8300c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.177 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.171+0000 7ff82f59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff830068ec0 con 0x7ff8300b0fa0 2024-08-17T02:25:48.177 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.171+0000 7ff82f59e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff830069760 con 0x7ff830142b90 2024-08-17T02:25:48.177 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.171+0000 7ff82f59e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83016a880 con 0x7ff8300b2db0 2024-08-17T02:25:48.177 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.171+0000 7ff82dd9b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8300b2db0 0x7ff83016c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.177 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.171+0000 7ff82dd9b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8300b2db0 0x7ff83016c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:47458/0 (socket says 172.21.15.174:47458) 2024-08-17T02:25:48.177 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.171+0000 7ff82dd9b700 1 -- 172.21.15.174:0/1927932477 learned_addr learned my addr 172.21.15.174:0/1927932477 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-08-17T02:25:48.177 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.171+0000 7ff82ed9d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff830142b90 0x7ff8300c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.177 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.171+0000 7ff82e59c700 1 --2- 172.21.15.174:0/1927932477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8300b0fa0 0x7ff83016ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.177 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.171+0000 7ff82dd9b700 1 -- 172.21.15.174:0/1927932477 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff830142b90 msgr2=0x7ff8300c9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.177 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.171+0000 7ff82dd9b700 1 --2- 172.21.15.174:0/1927932477 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff830142b90 0x7ff8300c9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.177 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.171+0000 7ff82dd9b700 1 -- 172.21.15.174:0/1927932477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8300b0fa0 msgr2=0x7ff83016ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.178 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.171+0000 7ff82dd9b700 1 --2- 172.21.15.174:0/1927932477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8300b0fa0 0x7ff83016ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.178 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.171+0000 7ff82dd9b700 1 -- 172.21.15.174:0/1927932477 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff820009420 con 0x7ff8300b2db0 2024-08-17T02:25:48.178 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.171+0000 7ff82e59c700 1 --2- 172.21.15.174:0/1927932477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8300b0fa0 0x7ff83016ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:48.178 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.171+0000 7ff82dd9b700 1 --2- 172.21.15.174:0/1927932477 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8300b2db0 0x7ff83016c7b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff82400c840 tx=0x7ff824007d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:48.178 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.171+0000 7ff81e7fc700 1 -- 172.21.15.174:0/1927932477 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff824005c00 con 0x7ff8300b2db0 2024-08-17T02:25:48.178 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.171+0000 7ff81e7fc700 1 -- 172.21.15.174:0/1927932477 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff824005d60 con 0x7ff8300b2db0 2024-08-17T02:25:48.178 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.171+0000 7ff81e7fc700 1 -- 172.21.15.174:0/1927932477 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff824007320 con 0x7ff8300b2db0 2024-08-17T02:25:48.178 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.171+0000 7ff82f59e700 1 -- 172.21.15.174:0/1927932477 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff830069110 con 0x7ff8300b2db0 2024-08-17T02:25:48.178 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.171+0000 7ff82f59e700 1 -- 172.21.15.174:0/1927932477 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff83016ccf0 con 0x7ff8300b2db0 2024-08-17T02:25:48.178 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.171+0000 7ff81e7fc700 1 -- 172.21.15.174:0/1927932477 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7ff82401c440 con 0x7ff8300b2db0 2024-08-17T02:25:48.178 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.171+0000 7ff81e7fc700 1 -- 172.21.15.174:0/1927932477 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7ff824012750 con 0x7ff8300b2db0 2024-08-17T02:25:48.179 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.171+0000 7ff82f59e700 1 -- 172.21.15.174:0/1927932477 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8300638f0 con 0x7ff8300b2db0 2024-08-17T02:25:48.180 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.175+0000 7ff81e7fc700 1 -- 172.21.15.174:0/1927932477 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7ff824017070 con 0x7ff8300b2db0 2024-08-17T02:25:48.255 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.251+0000 7ff82f59e700 1 -- 172.21.15.174:0/1927932477 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0736f8e6-818e-42e6-a0dc-8aaf813315d3", "id": 0} v 0) v1 -- 0x7ff8300698a0 con 0x7ff8300b2db0 2024-08-17T02:25:48.263 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.259+0000 7ff81e7fc700 1 -- 172.21.15.174:0/1927932477 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0736f8e6-818e-42e6-a0dc-8aaf813315d3", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff824007710 con 0x7ff8300b2db0 2024-08-17T02:25:48.263 INFO:teuthology.orchestra.run.smithi174.stdout:0 2024-08-17T02:25:48.264 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.259+0000 7ff82f59e700 1 -- 172.21.15.174:0/1927932477 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8300b2db0 msgr2=0x7ff83016c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.265 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.259+0000 7ff82f59e700 1 --2- 172.21.15.174:0/1927932477 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8300b2db0 0x7ff83016c7b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff82400c840 tx=0x7ff824007d90 comp rx=0 tx=0).stop 2024-08-17T02:25:48.265 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.259+0000 7ff82f59e700 1 -- 172.21.15.174:0/1927932477 shutdown_connections 2024-08-17T02:25:48.265 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.259+0000 7ff82f59e700 1 --2- 172.21.15.174:0/1927932477 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff830142b90 0x7ff8300c9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.265 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.259+0000 7ff82f59e700 1 --2- 172.21.15.174:0/1927932477 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8300b2db0 0x7ff83016c7b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.265 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.259+0000 7ff82f59e700 1 --2- 172.21.15.174:0/1927932477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8300b0fa0 0x7ff83016ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.265 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.259+0000 7ff82f59e700 1 -- 172.21.15.174:0/1927932477 >> 172.21.15.174:0/1927932477 conn(0x7ff83006cbe0 msgr2=0x7ff8301416f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:48.265 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.259+0000 7ff82f59e700 1 -- 172.21.15.174:0/1927932477 shutdown_connections 2024-08-17T02:25:48.265 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.259+0000 7ff82f59e700 1 -- 172.21.15.174:0/1927932477 wait complete. 2024-08-17T02:25:48.277 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new 011762e9-6c2d-441a-aa56-68474639d72f 1 2024-08-17T02:25:48.382 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.379+0000 7f1c162fa700 1 Processor -- start 2024-08-17T02:25:48.383 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.379+0000 7f1c162fa700 1 -- start start 2024-08-17T02:25:48.385 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.379+0000 7f1c162fa700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1c10156d70 0x7f1c100678c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.385 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.379+0000 7f1c162fa700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c100cba90 con 0x7f1c10157140 2024-08-17T02:25:48.385 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.379+0000 7f1c162fa700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c100cae80 con 0x7f1c100b2770 2024-08-17T02:25:48.385 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.379+0000 7f1c162fa700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c100cb160 con 0x7f1c10156d70 2024-08-17T02:25:48.385 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.379+0000 7f1c15af9700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f1c100b2770 0x7f1c100698a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:34424/0 (socket says 172.21.15.174:34424) 2024-08-17T02:25:48.385 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.379+0000 7f1c15af9700 1 -- 172.21.15.174:0/4215211440 learned_addr learned my addr 172.21.15.174:0/4215211440 (peer_addr_for_me v1:172.21.15.174:0/0) 2024-08-17T02:25:48.385 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.383+0000 7f1c152f8700 1 --2- 172.21.15.174:0/4215211440 >> v2:172.21.15.153:3300/0 conn(0x7f1c10156d70 0x7f1c100678c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.387 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.383+0000 7f1c0ffff700 1 -- 172.21.15.174:0/4215211440 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 650269271 0 0) 0x7f1c100cae80 con 0x7f1c100b2770 2024-08-17T02:25:48.387 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.383+0000 7f1c0ffff700 1 -- 172.21.15.174:0/4215211440 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bf8003570 con 0x7f1c100b2770 2024-08-17T02:25:48.387 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.383+0000 7f1c0ffff700 1 -- 172.21.15.174:0/4215211440 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2038568455 0 0) 0x7f1c100cba90 con 0x7f1c10157140 2024-08-17T02:25:48.387 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.383+0000 7f1c0ffff700 1 -- 172.21.15.174:0/4215211440 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c100cae80 con 0x7f1c10157140 2024-08-17T02:25:48.387 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.383+0000 7f1c0ffff700 1 -- 172.21.15.174:0/4215211440 <== mon.1 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2523320446 0 0) 0x7f1bf8003570 con 0x7f1c100b2770 2024-08-17T02:25:48.387 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.383+0000 7f1c152f8700 1 -- 172.21.15.174:0/4215211440 >> v1:172.21.15.174:6789/0 conn(0x7f1c100b2770 legacy=0x7f1c100698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.387 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.383+0000 7f1c152f8700 1 -- 172.21.15.174:0/4215211440 >> v1:172.21.15.153:6789/0 conn(0x7f1c10157140 legacy=0x7f1c100b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.387 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.383+0000 7f1c152f8700 1 -- 172.21.15.174:0/4215211440 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c100cb440 con 0x7f1c10156d70 2024-08-17T02:25:48.387 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.383+0000 7f1c152f8700 1 --2- 172.21.15.174:0/4215211440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c10156d70 0x7f1c100678c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1c000098e0 tx=0x7f1c000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df79b4df60c01cd3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:48.387 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.383+0000 7f1c0ffff700 1 -- 172.21.15.174:0/4215211440 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c00011630 con 0x7f1c10156d70 2024-08-17T02:25:48.388 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.383+0000 7f1c0ffff700 1 -- 172.21.15.174:0/4215211440 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c00011790 con 0x7f1c10156d70 2024-08-17T02:25:48.388 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.383+0000 7f1c0ffff700 1 -- 172.21.15.174:0/4215211440 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c00011b30 con 0x7f1c10156d70 2024-08-17T02:25:48.389 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.383+0000 7f1c162fa700 1 -- 172.21.15.174:0/4215211440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c10156d70 msgr2=0x7f1c100678c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.389 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.383+0000 7f1c162fa700 1 --2- 172.21.15.174:0/4215211440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c10156d70 0x7f1c100678c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1c000098e0 tx=0x7f1c000091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.389 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.383+0000 7f1c162fa700 1 -- 172.21.15.174:0/4215211440 shutdown_connections 2024-08-17T02:25:48.389 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.383+0000 7f1c162fa700 1 --2- 172.21.15.174:0/4215211440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c10156d70 0x7f1c100678c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.389 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.383+0000 7f1c162fa700 1 -- 172.21.15.174:0/4215211440 >> 172.21.15.174:0/4215211440 conn(0x7f1c1006e170 msgr2=0x7f1c1006e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:48.389 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.383+0000 7f1c162fa700 1 -- 172.21.15.174:0/4215211440 shutdown_connections 2024-08-17T02:25:48.389 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.383+0000 7f1c162fa700 1 -- 172.21.15.174:0/4215211440 wait complete. 2024-08-17T02:25:48.390 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.387+0000 7f1c162fa700 1 Processor -- start 2024-08-17T02:25:48.390 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.387+0000 7f1c162fa700 1 -- start start 2024-08-17T02:25:48.392 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.387+0000 7f1c162fa700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1c100b2770 0x7f1c10169000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.392 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.387+0000 7f1c162fa700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1c10156d70 0x7f1c100ad3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.393 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.387+0000 7f1c162fa700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c10157140 0x7f1c100aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.393 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.387+0000 7f1c162fa700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c10169540 con 0x7f1c10157140 2024-08-17T02:25:48.393 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.387+0000 7f1c162fa700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c100acc40 con 0x7f1c10156d70 2024-08-17T02:25:48.393 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.387+0000 7f1c162fa700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c100b0c20 con 0x7f1c100b2770 2024-08-17T02:25:48.393 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.387+0000 7f1c152f8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1c100b2770 0x7f1c10169000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.393 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.387+0000 7f1c14af7700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1c10156d70 0x7f1c100ad3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.393 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.387+0000 7f1c152f8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1c100b2770 0x7f1c10169000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:47468/0 (socket says 172.21.15.174:47468) 2024-08-17T02:25:48.393 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.387+0000 7f1c152f8700 1 -- 172.21.15.174:0/574668846 learned_addr learned my addr 172.21.15.174:0/574668846 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-08-17T02:25:48.393 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.387+0000 7f1c15af9700 1 --2- 172.21.15.174:0/574668846 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c10157140 0x7f1c100aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.395 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.387+0000 7f1c14af7700 1 -- 172.21.15.174:0/574668846 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1c100b2770 msgr2=0x7f1c10169000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.395 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.391+0000 7f1c14af7700 1 --2- 172.21.15.174:0/574668846 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1c100b2770 0x7f1c10169000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.395 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.391+0000 7f1c14af7700 1 -- 172.21.15.174:0/574668846 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c10157140 msgr2=0x7f1c100aedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.395 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.391+0000 7f1c14af7700 1 --2- 172.21.15.174:0/574668846 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c10157140 0x7f1c100aedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.395 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.391+0000 7f1c14af7700 1 -- 172.21.15.174:0/574668846 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c00009420 con 0x7f1c10156d70 2024-08-17T02:25:48.395 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.391+0000 7f1c15af9700 1 --2- 172.21.15.174:0/574668846 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c10157140 0x7f1c100aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:48.395 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.391+0000 7f1c14af7700 1 --2- 172.21.15.174:0/574668846 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1c10156d70 0x7f1c100ad3c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1c0400c560 tx=0x7f1c04007d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:48.395 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.391+0000 7f1c0d7fa700 1 -- 172.21.15.174:0/574668846 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c04011590 con 0x7f1c10156d70 2024-08-17T02:25:48.395 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.391+0000 7f1c0d7fa700 1 -- 172.21.15.174:0/574668846 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c040116f0 con 0x7f1c10156d70 2024-08-17T02:25:48.395 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.391+0000 7f1c162fa700 1 -- 172.21.15.174:0/574668846 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c100b0f00 con 0x7f1c10156d70 2024-08-17T02:25:48.395 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.391+0000 7f1c0d7fa700 1 -- 172.21.15.174:0/574668846 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c04011ab0 con 0x7f1c10156d70 2024-08-17T02:25:48.396 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.391+0000 7f1c162fa700 1 -- 172.21.15.174:0/574668846 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c100b14c0 con 0x7f1c10156d70 2024-08-17T02:25:48.396 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.391+0000 7f1c0d7fa700 1 -- 172.21.15.174:0/574668846 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f1c0401c460 con 0x7f1c10156d70 2024-08-17T02:25:48.396 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.391+0000 7f1c0d7fa700 1 -- 172.21.15.174:0/574668846 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f1c040127e0 con 0x7f1c10156d70 2024-08-17T02:25:48.396 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.391+0000 7f1c162fa700 1 -- 172.21.15.174:0/574668846 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c10070080 con 0x7f1c10156d70 2024-08-17T02:25:48.401 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.399+0000 7f1c0d7fa700 1 -- 172.21.15.174:0/574668846 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f1c10070080 con 0x7f1c10156d70 2024-08-17T02:25:48.476 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.471+0000 7f1c162fa700 1 -- 172.21.15.174:0/574668846 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd new", "uuid": "011762e9-6c2d-441a-aa56-68474639d72f", "id": 1} v 0) v1 -- 0x7f1c100a9fa0 con 0x7f1c10156d70 2024-08-17T02:25:48.482 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.479+0000 7f1c0d7fa700 1 -- 172.21.15.174:0/574668846 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "011762e9-6c2d-441a-aa56-68474639d72f", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1c100a9fa0 con 0x7f1c10156d70 2024-08-17T02:25:48.483 INFO:teuthology.orchestra.run.smithi174.stdout:1 2024-08-17T02:25:48.484 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.479+0000 7f1c162fa700 1 -- 172.21.15.174:0/574668846 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1c10156d70 msgr2=0x7f1c100ad3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.484 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.479+0000 7f1c162fa700 1 --2- 172.21.15.174:0/574668846 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1c10156d70 0x7f1c100ad3c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1c0400c560 tx=0x7f1c04007d50 comp rx=0 tx=0).stop 2024-08-17T02:25:48.484 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.479+0000 7f1c162fa700 1 -- 172.21.15.174:0/574668846 shutdown_connections 2024-08-17T02:25:48.484 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.479+0000 7f1c162fa700 1 --2- 172.21.15.174:0/574668846 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c10157140 0x7f1c100aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.484 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.479+0000 7f1c162fa700 1 --2- 172.21.15.174:0/574668846 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1c10156d70 0x7f1c100ad3c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.484 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.479+0000 7f1c162fa700 1 --2- 172.21.15.174:0/574668846 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1c100b2770 0x7f1c10169000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.485 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.479+0000 7f1c162fa700 1 -- 172.21.15.174:0/574668846 >> 172.21.15.174:0/574668846 conn(0x7f1c1006e170 msgr2=0x7f1c100b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:48.485 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.479+0000 7f1c162fa700 1 -- 172.21.15.174:0/574668846 shutdown_connections 2024-08-17T02:25:48.485 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.479+0000 7f1c162fa700 1 -- 172.21.15.174:0/574668846 wait complete. 2024-08-17T02:25:48.495 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new b562cd97-aa12-455e-b46a-e720a2ec9d3e 2 2024-08-17T02:25:48.600 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.595+0000 7f069ae9d700 1 Processor -- start 2024-08-17T02:25:48.600 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.595+0000 7f069ae9d700 1 -- start start 2024-08-17T02:25:48.603 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.599+0000 7f069ae9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f06940afd50 0x7f06940a9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.603 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.599+0000 7f069ae9d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06940a9da0 0x7f06940ab2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.603 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.599+0000 7f069ae9d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06940aae50 con 0x7f06940ab820 2024-08-17T02:25:48.603 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.599+0000 7f069ae9d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06941594c0 con 0x7f06940afd50 2024-08-17T02:25:48.603 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.599+0000 7f069ae9d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06940aa240 con 0x7f06940a9da0 2024-08-17T02:25:48.603 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.599+0000 7f069969a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06940a9da0 0x7f06940ab2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.603 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.599+0000 7f0699e9b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f06940afd50 0x7f06940a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.603 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.599+0000 7f069969a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06940a9da0 0x7f06940ab2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:47472/0 (socket says 172.21.15.174:47472) 2024-08-17T02:25:48.603 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.599+0000 7f069969a700 1 -- 172.21.15.174:0/3880341206 learned_addr learned my addr 172.21.15.174:0/3880341206 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-08-17T02:25:48.603 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.599+0000 7f0699e9b700 1 -- 172.21.15.174:0/3880341206 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06940a9da0 msgr2=0x7f06940ab2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:48.603 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.599+0000 7f0699e9b700 1 --2- 172.21.15.174:0/3880341206 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06940a9da0 0x7f06940ab2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.604 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.599+0000 7f0699e9b700 1 -- 172.21.15.174:0/3880341206 >> v1:172.21.15.174:6789/0 conn(0x7f06940ab820 legacy=0x7f06940c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.604 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.599+0000 7f0699e9b700 1 -- 172.21.15.174:0/3880341206 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06940aa520 con 0x7f06940afd50 2024-08-17T02:25:48.604 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.599+0000 7f0699e9b700 1 --2- 172.21.15.174:0/3880341206 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06940afd50 0x7f06940a9860 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f06900098e0 tx=0x7f06900091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ad83f94eb0bfd42 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:48.604 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.599+0000 7f0698e99700 1 -- 172.21.15.174:0/3880341206 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069000b640 con 0x7f06940afd50 2024-08-17T02:25:48.604 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.599+0000 7f0698e99700 1 -- 172.21.15.174:0/3880341206 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069000b7a0 con 0x7f06940afd50 2024-08-17T02:25:48.604 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.599+0000 7f0698e99700 1 -- 172.21.15.174:0/3880341206 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069000bb40 con 0x7f06940afd50 2024-08-17T02:25:48.605 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.599+0000 7f069ae9d700 1 -- 172.21.15.174:0/3880341206 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06940afd50 msgr2=0x7f06940a9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.605 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.599+0000 7f069ae9d700 1 --2- 172.21.15.174:0/3880341206 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06940afd50 0x7f06940a9860 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f06900098e0 tx=0x7f06900091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.605 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.599+0000 7f069ae9d700 1 -- 172.21.15.174:0/3880341206 shutdown_connections 2024-08-17T02:25:48.605 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.599+0000 7f069ae9d700 1 --2- 172.21.15.174:0/3880341206 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06940a9da0 0x7f06940ab2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.605 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.599+0000 7f069ae9d700 1 --2- 172.21.15.174:0/3880341206 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06940afd50 0x7f06940a9860 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.605 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.599+0000 7f069ae9d700 1 -- 172.21.15.174:0/3880341206 >> 172.21.15.174:0/3880341206 conn(0x7f069406e170 msgr2=0x7f069406e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:48.605 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.599+0000 7f069ae9d700 1 -- 172.21.15.174:0/3880341206 shutdown_connections 2024-08-17T02:25:48.606 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.599+0000 7f069ae9d700 1 -- 172.21.15.174:0/3880341206 wait complete. 2024-08-17T02:25:48.606 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.599+0000 7f069ae9d700 1 Processor -- start 2024-08-17T02:25:48.606 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.599+0000 7f069ae9d700 1 -- start start 2024-08-17T02:25:48.607 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.603+0000 7f069ae9d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06940a9da0 0x7f0694142040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.608 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.603+0000 7f069ae9d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06940ab820 0x7f06941535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.608 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.603+0000 7f069ae9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06940afd50 0x7f069406a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.608 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.603+0000 7f069ae9d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069415ea20 con 0x7f06940afd50 2024-08-17T02:25:48.608 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.603+0000 7f069ae9d700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069406b400 con 0x7f06940ab820 2024-08-17T02:25:48.608 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.603+0000 7f069ae9d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f069406b120 con 0x7f06940a9da0 2024-08-17T02:25:48.608 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.603+0000 7f0699e9b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06940a9da0 0x7f0694142040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.608 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.603+0000 7f069969a700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06940ab820 0x7f06941535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.608 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.603+0000 7f069969a700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06940ab820 0x7f06941535b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:43730/0 (socket says 172.21.15.174:43730) 2024-08-17T02:25:48.608 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.603+0000 7f0699e9b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06940a9da0 0x7f0694142040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:47478/0 (socket says 172.21.15.174:47478) 2024-08-17T02:25:48.608 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.603+0000 7f069969a700 1 -- 172.21.15.174:0/1830115569 learned_addr learned my addr 172.21.15.174:0/1830115569 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-08-17T02:25:48.608 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.603+0000 7f069a69c700 1 --2- 172.21.15.174:0/1830115569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06940afd50 0x7f069406a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.609 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.603+0000 7f069969a700 1 -- 172.21.15.174:0/1830115569 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06940a9da0 msgr2=0x7f0694142040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.609 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.603+0000 7f069969a700 1 --2- 172.21.15.174:0/1830115569 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06940a9da0 0x7f0694142040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.609 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.603+0000 7f069969a700 1 -- 172.21.15.174:0/1830115569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06940afd50 msgr2=0x7f069406a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.609 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.603+0000 7f069969a700 1 --2- 172.21.15.174:0/1830115569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06940afd50 0x7f069406a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.609 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.603+0000 7f069969a700 1 -- 172.21.15.174:0/1830115569 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0690009420 con 0x7f06940ab820 2024-08-17T02:25:48.609 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.603+0000 7f0699e9b700 1 --2- 172.21.15.174:0/1830115569 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06940a9da0 0x7f0694142040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:48.609 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.603+0000 7f069a69c700 1 --2- 172.21.15.174:0/1830115569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06940afd50 0x7f069406a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:48.609 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.603+0000 7f069969a700 1 --2- 172.21.15.174:0/1830115569 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06940ab820 0x7f06941535b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f068400ea20 tx=0x7f0684009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:48.609 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.603+0000 7f0689ffb700 1 -- 172.21.15.174:0/1830115569 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068400eeb0 con 0x7f06940ab820 2024-08-17T02:25:48.609 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.603+0000 7f0689ffb700 1 -- 172.21.15.174:0/1830115569 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068400c850 con 0x7f06940ab820 2024-08-17T02:25:48.609 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.603+0000 7f0689ffb700 1 -- 172.21.15.174:0/1830115569 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068400cc10 con 0x7f06940ab820 2024-08-17T02:25:48.609 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.603+0000 7f069ae9d700 1 -- 172.21.15.174:0/1830115569 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f069415e3d0 con 0x7f06940ab820 2024-08-17T02:25:48.610 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.603+0000 7f069ae9d700 1 -- 172.21.15.174:0/1830115569 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0694067860 con 0x7f06940ab820 2024-08-17T02:25:48.610 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.603+0000 7f0689ffb700 1 -- 172.21.15.174:0/1830115569 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f0684005a00 con 0x7f06940ab820 2024-08-17T02:25:48.610 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.603+0000 7f0689ffb700 1 -- 172.21.15.174:0/1830115569 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f0684013470 con 0x7f06940ab820 2024-08-17T02:25:48.610 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.603+0000 7f069ae9d700 1 -- 172.21.15.174:0/1830115569 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06940638f0 con 0x7f06940ab820 2024-08-17T02:25:48.611 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.607+0000 7f0689ffb700 1 -- 172.21.15.174:0/1830115569 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f068403a7a0 con 0x7f06940ab820 2024-08-17T02:25:48.684 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.679+0000 7f069ae9d700 1 -- 172.21.15.174:0/1830115569 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b562cd97-aa12-455e-b46a-e720a2ec9d3e", "id": 2} v 0) v1 -- 0x7f06940ca6c0 con 0x7f06940ab820 2024-08-17T02:25:48.691 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.687+0000 7f0689ffb700 1 -- 172.21.15.174:0/1830115569 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b562cd97-aa12-455e-b46a-e720a2ec9d3e", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0684029070 con 0x7f06940ab820 2024-08-17T02:25:48.692 INFO:teuthology.orchestra.run.smithi174.stdout:2 2024-08-17T02:25:48.693 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.687+0000 7f069ae9d700 1 -- 172.21.15.174:0/1830115569 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06940ab820 msgr2=0x7f06941535b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.693 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.687+0000 7f069ae9d700 1 --2- 172.21.15.174:0/1830115569 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06940ab820 0x7f06941535b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f068400ea20 tx=0x7f0684009250 comp rx=0 tx=0).stop 2024-08-17T02:25:48.693 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.687+0000 7f069ae9d700 1 -- 172.21.15.174:0/1830115569 shutdown_connections 2024-08-17T02:25:48.693 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.687+0000 7f069ae9d700 1 --2- 172.21.15.174:0/1830115569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06940afd50 0x7f069406a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.694 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.687+0000 7f069ae9d700 1 --2- 172.21.15.174:0/1830115569 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06940ab820 0x7f06941535b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.694 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.687+0000 7f069ae9d700 1 --2- 172.21.15.174:0/1830115569 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06940a9da0 0x7f0694142040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.694 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.687+0000 7f069ae9d700 1 -- 172.21.15.174:0/1830115569 >> 172.21.15.174:0/1830115569 conn(0x7f069406e170 msgr2=0x7f06940c9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:48.694 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.691+0000 7f069ae9d700 1 -- 172.21.15.174:0/1830115569 shutdown_connections 2024-08-17T02:25:48.694 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.691+0000 7f069ae9d700 1 -- 172.21.15.174:0/1830115569 wait complete. 2024-08-17T02:25:48.705 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new 222da52f-90c2-4132-a5d2-6f6cf83d4780 3 2024-08-17T02:25:48.708 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-08-17T02:25:48.703+0000 7f51463a9000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:25:48.723 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-08-17T02:25:48.721+0000 7f19132dd000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:25:48.766 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-08-17T02:25:48.763+0000 7f51463a9000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:25:48.780 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-08-17T02:25:48.777+0000 7f19132dd000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:25:48.801 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.795+0000 7fc723fff700 1 Processor -- start 2024-08-17T02:25:48.801 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.799+0000 7fc723fff700 1 -- start start 2024-08-17T02:25:48.804 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.799+0000 7fc723fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc724140790 0x7fc7240c8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.804 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.799+0000 7fc723fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc724140b60 0x7fc7240aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.804 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.799+0000 7fc723fff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc724067700 con 0x7fc72406e700 2024-08-17T02:25:48.804 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.799+0000 7fc723fff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc724157a50 con 0x7fc724140790 2024-08-17T02:25:48.804 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.799+0000 7fc723fff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc724157700 con 0x7fc724140b60 2024-08-17T02:25:48.804 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.799+0000 7fc722ffd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc724140790 0x7fc7240c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.804 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.799+0000 7fc7227fc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc724140b60 0x7fc7240aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.804 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.799+0000 7fc722ffd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc724140790 0x7fc7240c8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:43742/0 (socket says 172.21.15.174:43742) 2024-08-17T02:25:48.804 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.799+0000 7fc7237fe700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fc72406e700 0x7fc7240afd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:34440/0 (socket says 172.21.15.174:34440) 2024-08-17T02:25:48.804 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.799+0000 7fc7237fe700 1 -- 172.21.15.174:0/4253644987 learned_addr learned my addr 172.21.15.174:0/4253644987 (peer_addr_for_me v1:172.21.15.174:0/0) 2024-08-17T02:25:48.804 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.799+0000 7fc722ffd700 1 -- 172.21.15.174:0/4253644987 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc724140b60 msgr2=0x7fc7240aebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:48.805 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.799+0000 7fc722ffd700 1 --2- 172.21.15.174:0/4253644987 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc724140b60 0x7fc7240aebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.805 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.799+0000 7fc722ffd700 1 -- 172.21.15.174:0/4253644987 >> v1:172.21.15.174:6789/0 conn(0x7fc72406e700 legacy=0x7fc7240afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.805 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.799+0000 7fc721ffb700 1 -- 172.21.15.174:0/4253644987 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1890171289 0 0) 0x7fc724067700 con 0x7fc72406e700 2024-08-17T02:25:48.805 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.799+0000 7fc722ffd700 1 -- 172.21.15.174:0/4253644987 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7240c8c80 con 0x7fc724140790 2024-08-17T02:25:48.805 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.799+0000 7fc7227fc700 1 --2- 172.21.15.174:0/4253644987 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc724140b60 0x7fc7240aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:48.805 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.799+0000 7fc722ffd700 1 --2- 172.21.15.174:0/4253644987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc724140790 0x7fc7240c8430 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc7140098e0 tx=0x7fc7140091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec3009b35add6ccb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:48.805 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.799+0000 7fc721ffb700 1 -- 172.21.15.174:0/4253644987 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71400b6d0 con 0x7fc724140790 2024-08-17T02:25:48.805 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.799+0000 7fc721ffb700 1 -- 172.21.15.174:0/4253644987 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc71400b830 con 0x7fc724140790 2024-08-17T02:25:48.805 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.799+0000 7fc721ffb700 1 -- 172.21.15.174:0/4253644987 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71400bbd0 con 0x7fc724140790 2024-08-17T02:25:48.806 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.799+0000 7fc723fff700 1 -- 172.21.15.174:0/4253644987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc724140790 msgr2=0x7fc7240c8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.806 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.799+0000 7fc723fff700 1 --2- 172.21.15.174:0/4253644987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc724140790 0x7fc7240c8430 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc7140098e0 tx=0x7fc7140091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.806 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.799+0000 7fc723fff700 1 -- 172.21.15.174:0/4253644987 shutdown_connections 2024-08-17T02:25:48.806 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.799+0000 7fc723fff700 1 --2- 172.21.15.174:0/4253644987 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc724140b60 0x7fc7240aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.806 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.799+0000 7fc723fff700 1 --2- 172.21.15.174:0/4253644987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc724140790 0x7fc7240c8430 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.806 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.799+0000 7fc723fff700 1 -- 172.21.15.174:0/4253644987 >> 172.21.15.174:0/4253644987 conn(0x7fc7240ca2c0 msgr2=0x7fc72406dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:48.807 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.799+0000 7fc723fff700 1 -- 172.21.15.174:0/4253644987 shutdown_connections 2024-08-17T02:25:48.807 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.799+0000 7fc723fff700 1 -- 172.21.15.174:0/4253644987 wait complete. 2024-08-17T02:25:48.807 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.803+0000 7fc723fff700 1 Processor -- start 2024-08-17T02:25:48.807 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.803+0000 7fc723fff700 1 -- start start 2024-08-17T02:25:48.809 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.803+0000 7fc723fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc72406e700 0x7fc72416a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.810 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.803+0000 7fc723fff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc724140790 0x7fc724169c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.810 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.803+0000 7fc723fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc724140b60 0x7fc7240c7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.810 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.803+0000 7fc723fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7240c7c60 con 0x7fc72406e700 2024-08-17T02:25:48.810 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.803+0000 7fc723fff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7240aca90 con 0x7fc724140790 2024-08-17T02:25:48.810 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.803+0000 7fc723fff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7240c7980 con 0x7fc724140b60 2024-08-17T02:25:48.810 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.803+0000 7fc7237fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc724140b60 0x7fc7240c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.810 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.803+0000 7fc7227fc700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc724140790 0x7fc724169c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.810 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.803+0000 7fc7227fc700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc724140790 0x7fc724169c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:43752/0 (socket says 172.21.15.174:43752) 2024-08-17T02:25:48.810 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.803+0000 7fc7237fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc724140b60 0x7fc7240c7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:47500/0 (socket says 172.21.15.174:47500) 2024-08-17T02:25:48.810 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.803+0000 7fc7227fc700 1 -- 172.21.15.174:0/1226949957 learned_addr learned my addr 172.21.15.174:0/1226949957 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-08-17T02:25:48.810 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.803+0000 7fc722ffd700 1 --2- 172.21.15.174:0/1226949957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc72406e700 0x7fc72416a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.810 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.803+0000 7fc7237fe700 1 -- 172.21.15.174:0/1226949957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc724140790 msgr2=0x7fc724169c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.811 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.803+0000 7fc7237fe700 1 --2- 172.21.15.174:0/1226949957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc724140790 0x7fc724169c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.811 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.803+0000 7fc7237fe700 1 -- 172.21.15.174:0/1226949957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc72406e700 msgr2=0x7fc72416a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.811 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.803+0000 7fc7237fe700 1 --2- 172.21.15.174:0/1226949957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc72406e700 0x7fc72416a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.811 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.803+0000 7fc7237fe700 1 -- 172.21.15.174:0/1226949957 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc718009420 con 0x7fc724140b60 2024-08-17T02:25:48.811 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.803+0000 7fc722ffd700 1 --2- 172.21.15.174:0/1226949957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc72406e700 0x7fc72416a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:48.811 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.807+0000 7fc7237fe700 1 --2- 172.21.15.174:0/1226949957 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc724140b60 0x7fc7240c7280 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc71c00cb90 tx=0x7fc71c0018f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:48.811 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.807+0000 7fc70affd700 1 -- 172.21.15.174:0/1226949957 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71c00a850 con 0x7fc724140b60 2024-08-17T02:25:48.811 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.807+0000 7fc70affd700 1 -- 172.21.15.174:0/1226949957 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc71c00a9b0 con 0x7fc724140b60 2024-08-17T02:25:48.811 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.807+0000 7fc723fff700 1 -- 172.21.15.174:0/1226949957 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc714009420 con 0x7fc724140b60 2024-08-17T02:25:48.811 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.807+0000 7fc70affd700 1 -- 172.21.15.174:0/1226949957 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71c00ad70 con 0x7fc724140b60 2024-08-17T02:25:48.811 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.807+0000 7fc723fff700 1 -- 172.21.15.174:0/1226949957 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7240ad010 con 0x7fc724140b60 2024-08-17T02:25:48.811 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.807+0000 7fc70affd700 1 -- 172.21.15.174:0/1226949957 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fc71c007300 con 0x7fc724140b60 2024-08-17T02:25:48.811 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.807+0000 7fc70affd700 1 -- 172.21.15.174:0/1226949957 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7fc71c012400 con 0x7fc724140b60 2024-08-17T02:25:48.812 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.807+0000 7fc723fff700 1 -- 172.21.15.174:0/1226949957 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7240ad230 con 0x7fc724140b60 2024-08-17T02:25:48.814 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.811+0000 7fc70affd700 1 -- 172.21.15.174:0/1226949957 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fc71c0075b0 con 0x7fc724140b60 2024-08-17T02:25:48.886 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.883+0000 7fc723fff700 1 -- 172.21.15.174:0/1226949957 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd new", "uuid": "222da52f-90c2-4132-a5d2-6f6cf83d4780", "id": 3} v 0) v1 -- 0x7fc7240638f0 con 0x7fc724140b60 2024-08-17T02:25:48.887 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-08-17T02:25:48.883+0000 7f51463a9000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:25:48.892 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.887+0000 7fc70affd700 1 -- 172.21.15.174:0/1226949957 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "222da52f-90c2-4132-a5d2-6f6cf83d4780", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc71c007830 con 0x7fc724140b60 2024-08-17T02:25:48.893 INFO:teuthology.orchestra.run.smithi174.stdout:3 2024-08-17T02:25:48.893 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-08-17T02:25:48.889+0000 7f19132dd000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:25:48.894 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.891+0000 7fc723fff700 1 -- 172.21.15.174:0/1226949957 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc724140b60 msgr2=0x7fc7240c7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.894 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.891+0000 7fc723fff700 1 --2- 172.21.15.174:0/1226949957 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc724140b60 0x7fc7240c7280 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc71c00cb90 tx=0x7fc71c0018f0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.894 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.891+0000 7fc723fff700 1 -- 172.21.15.174:0/1226949957 shutdown_connections 2024-08-17T02:25:48.894 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.891+0000 7fc723fff700 1 --2- 172.21.15.174:0/1226949957 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc724140b60 0x7fc7240c7280 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.894 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.891+0000 7fc723fff700 1 --2- 172.21.15.174:0/1226949957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc724140790 0x7fc724169c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.894 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.891+0000 7fc723fff700 1 --2- 172.21.15.174:0/1226949957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc72406e700 0x7fc72416a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.895 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.891+0000 7fc723fff700 1 -- 172.21.15.174:0/1226949957 >> 172.21.15.174:0/1226949957 conn(0x7fc7240ca2c0 msgr2=0x7fc7240ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:48.895 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.891+0000 7fc723fff700 1 -- 172.21.15.174:0/1226949957 shutdown_connections 2024-08-17T02:25:48.895 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:48.891+0000 7fc723fff700 1 -- 172.21.15.174:0/1226949957 wait complete. 2024-08-17T02:25:48.906 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new a38a04cd-032b-4977-a260-1ef3567d0c46 4 2024-08-17T02:25:49.012 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.007+0000 7f0c371d3700 1 Processor -- start 2024-08-17T02:25:49.012 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.007+0000 7f0c371d3700 1 -- start start 2024-08-17T02:25:49.015 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.007+0000 7f0c371d3700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0c30160bf0 0x7f0c301616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.015 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.007+0000 7f0c371d3700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c301420d0 con 0x7f0c301612f0 2024-08-17T02:25:49.015 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.007+0000 7f0c371d3700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c301414c0 con 0x7f0c300cb270 2024-08-17T02:25:49.015 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.007+0000 7f0c371d3700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c301412a0 con 0x7f0c30160bf0 2024-08-17T02:25:49.015 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c359d0700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f0c300cb270 0x7f0c301604e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:34446/0 (socket says 172.21.15.174:34446) 2024-08-17T02:25:49.015 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c359d0700 1 -- 172.21.15.174:0/532265961 learned_addr learned my addr 172.21.15.174:0/532265961 (peer_addr_for_me v1:172.21.15.174:0/0) 2024-08-17T02:25:49.015 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c369d2700 1 --2- 172.21.15.174:0/532265961 >> v2:172.21.15.153:3300/0 conn(0x7f0c30160bf0 0x7f0c301616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.015 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c351cf700 1 -- 172.21.15.174:0/532265961 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1396224278 0 0) 0x7f0c301414c0 con 0x7f0c300cb270 2024-08-17T02:25:49.015 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c351cf700 1 -- 172.21.15.174:0/532265961 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c1c003570 con 0x7f0c300cb270 2024-08-17T02:25:49.016 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c351cf700 1 -- 172.21.15.174:0/532265961 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3118515855 0 0) 0x7f0c301420d0 con 0x7f0c301612f0 2024-08-17T02:25:49.016 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c351cf700 1 -- 172.21.15.174:0/532265961 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c301414c0 con 0x7f0c301612f0 2024-08-17T02:25:49.016 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c351cf700 1 -- 172.21.15.174:0/532265961 <== mon.1 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3266138536 0 0) 0x7f0c1c003570 con 0x7f0c300cb270 2024-08-17T02:25:49.016 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c351cf700 1 -- 172.21.15.174:0/532265961 >> v2:172.21.15.153:3300/0 conn(0x7f0c30160bf0 msgr2=0x7f0c301616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:49.016 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c351cf700 1 --2- 172.21.15.174:0/532265961 >> v2:172.21.15.153:3300/0 conn(0x7f0c30160bf0 0x7f0c301616c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.016 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c351cf700 1 -- 172.21.15.174:0/532265961 >> v1:172.21.15.153:6789/0 conn(0x7f0c301612f0 legacy=0x7f0c30140b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.016 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c351cf700 1 -- 172.21.15.174:0/532265961 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c301417a0 con 0x7f0c300cb270 2024-08-17T02:25:49.016 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c351cf700 1 -- 172.21.15.174:0/532265961 <== mon.1 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3701463666 0 0) 0x7f0c20001470 con 0x7f0c300cb270 2024-08-17T02:25:49.016 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c351cf700 1 -- 172.21.15.174:0/532265961 >> v1:172.21.15.174:6789/0 conn(0x7f0c300cb270 legacy=0x7f0c301604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.016 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c351cf700 1 --2- 172.21.15.174:0/532265961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c1c003c40 0x7f0c1c004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.016 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c351cf700 1 --2- 172.21.15.174:0/532265961 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c1c004810 0x7f0c1c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.016 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c351cf700 1 --2- 172.21.15.174:0/532265961 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c1c005210 0x7f0c1c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.016 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c351cf700 1 -- 172.21.15.174:0/532265961 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c301412a0 con 0x7f0c1c003c40 2024-08-17T02:25:49.016 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c351cf700 1 -- 172.21.15.174:0/532265961 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1c00c1b0 con 0x7f0c1c004810 2024-08-17T02:25:49.017 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c351cf700 1 -- 172.21.15.174:0/532265961 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1c00c370 con 0x7f0c1c005210 2024-08-17T02:25:49.017 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c359d0700 1 --2- 172.21.15.174:0/532265961 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c1c004810 0x7f0c1c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.017 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c369d2700 1 --2- 172.21.15.174:0/532265961 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c1c005210 0x7f0c1c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.017 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c361d1700 1 --2- 172.21.15.174:0/532265961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c1c003c40 0x7f0c1c004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.017 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c369d2700 1 -- 172.21.15.174:0/532265961 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c1c004810 msgr2=0x7f0c1c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:49.017 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c369d2700 1 --2- 172.21.15.174:0/532265961 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c1c004810 0x7f0c1c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.017 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c369d2700 1 -- 172.21.15.174:0/532265961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c1c003c40 msgr2=0x7f0c1c004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:49.017 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c369d2700 1 --2- 172.21.15.174:0/532265961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c1c003c40 0x7f0c1c004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.017 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c369d2700 1 -- 172.21.15.174:0/532265961 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c1c003570 con 0x7f0c1c005210 2024-08-17T02:25:49.017 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c359d0700 1 --2- 172.21.15.174:0/532265961 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c1c004810 0x7f0c1c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:49.017 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c369d2700 1 -- 172.21.15.174:0/532265961 reap_dead start 2024-08-17T02:25:49.017 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c369d2700 1 --2- 172.21.15.174:0/532265961 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c1c005210 0x7f0c1c00ba60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0c280094d0 tx=0x7f0c2800b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b0b748dadf5bf09 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:49.017 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c351cf700 1 -- 172.21.15.174:0/532265961 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2800ea90 con 0x7f0c1c005210 2024-08-17T02:25:49.018 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c351cf700 1 -- 172.21.15.174:0/532265961 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c2800f040 con 0x7f0c1c005210 2024-08-17T02:25:49.018 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c351cf700 1 -- 172.21.15.174:0/532265961 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2800ee60 con 0x7f0c1c005210 2024-08-17T02:25:49.020 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c371d3700 1 -- 172.21.15.174:0/532265961 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c1c005210 msgr2=0x7f0c1c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.021 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c371d3700 1 --2- 172.21.15.174:0/532265961 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c1c005210 0x7f0c1c00ba60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0c280094d0 tx=0x7f0c2800b040 comp rx=0 tx=0).stop 2024-08-17T02:25:49.021 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c371d3700 1 -- 172.21.15.174:0/532265961 shutdown_connections 2024-08-17T02:25:49.021 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c371d3700 1 --2- 172.21.15.174:0/532265961 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c1c005210 0x7f0c1c00ba60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.021 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c371d3700 1 -- 172.21.15.174:0/532265961 >> 172.21.15.174:0/532265961 conn(0x7f0c3006e170 msgr2=0x7f0c3006e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:49.021 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c371d3700 1 -- 172.21.15.174:0/532265961 shutdown_connections 2024-08-17T02:25:49.021 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.011+0000 7f0c371d3700 1 -- 172.21.15.174:0/532265961 wait complete. 2024-08-17T02:25:49.021 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.015+0000 7f0c371d3700 1 Processor -- start 2024-08-17T02:25:49.021 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.015+0000 7f0c371d3700 1 -- start start 2024-08-17T02:25:49.021 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.015+0000 7f0c371d3700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c1c005210 0x7f0c30068900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.021 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.015+0000 7f0c371d3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c301709d0 0x7f0c300694c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.021 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.015+0000 7f0c371d3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c301585f0 0x7f0c30158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.021 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.015+0000 7f0c371d3700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c301408e0 con 0x7f0c301585f0 2024-08-17T02:25:49.021 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.015+0000 7f0c371d3700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c30170e20 con 0x7f0c1c005210 2024-08-17T02:25:49.022 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.015+0000 7f0c371d3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c30069a00 con 0x7f0c301709d0 2024-08-17T02:25:49.022 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.015+0000 7f0c361d1700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c1c005210 0x7f0c30068900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.022 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.015+0000 7f0c359d0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c301709d0 0x7f0c300694c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.022 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.015+0000 7f0c361d1700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c1c005210 0x7f0c30068900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:43774/0 (socket says 172.21.15.174:43774) 2024-08-17T02:25:49.022 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.015+0000 7f0c361d1700 1 -- 172.21.15.174:0/2575366917 learned_addr learned my addr 172.21.15.174:0/2575366917 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-08-17T02:25:49.022 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.015+0000 7f0c369d2700 1 --2- 172.21.15.174:0/2575366917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c301585f0 0x7f0c30158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.022 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.015+0000 7f0c361d1700 1 -- 172.21.15.174:0/2575366917 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c301709d0 msgr2=0x7f0c300694c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.022 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.015+0000 7f0c361d1700 1 --2- 172.21.15.174:0/2575366917 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c301709d0 0x7f0c300694c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.022 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.015+0000 7f0c361d1700 1 -- 172.21.15.174:0/2575366917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c301585f0 msgr2=0x7f0c30158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.022 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.015+0000 7f0c361d1700 1 --2- 172.21.15.174:0/2575366917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c301585f0 0x7f0c30158a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.022 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.015+0000 7f0c361d1700 1 -- 172.21.15.174:0/2575366917 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c30158fa0 con 0x7f0c1c005210 2024-08-17T02:25:49.022 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.015+0000 7f0c369d2700 1 --2- 172.21.15.174:0/2575366917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c301585f0 0x7f0c30158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:49.023 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.015+0000 7f0c361d1700 1 --2- 172.21.15.174:0/2575366917 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c1c005210 0x7f0c30068900 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c002ab0 tx=0x7f0c2c007d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:49.023 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.015+0000 7f0c267fc700 1 -- 172.21.15.174:0/2575366917 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c006a30 con 0x7f0c1c005210 2024-08-17T02:25:49.023 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.015+0000 7f0c267fc700 1 -- 172.21.15.174:0/2575366917 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c2c006b90 con 0x7f0c1c005210 2024-08-17T02:25:49.023 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.015+0000 7f0c371d3700 1 -- 172.21.15.174:0/2575366917 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c3006a840 con 0x7f0c1c005210 2024-08-17T02:25:49.023 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.015+0000 7f0c267fc700 1 -- 172.21.15.174:0/2575366917 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c007050 con 0x7f0c1c005210 2024-08-17T02:25:49.023 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.015+0000 7f0c371d3700 1 -- 172.21.15.174:0/2575366917 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c30069f10 con 0x7f0c1c005210 2024-08-17T02:25:49.023 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.015+0000 7f0c267fc700 1 -- 172.21.15.174:0/2575366917 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f0c2c00f660 con 0x7f0c1c005210 2024-08-17T02:25:49.023 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.015+0000 7f0c267fc700 1 -- 172.21.15.174:0/2575366917 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f0c2c007690 con 0x7f0c1c005210 2024-08-17T02:25:49.023 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.019+0000 7f0c371d3700 1 -- 172.21.15.174:0/2575366917 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c30070080 con 0x7f0c1c005210 2024-08-17T02:25:49.025 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.023+0000 7f0c267fc700 1 -- 172.21.15.174:0/2575366917 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f0c30070080 con 0x7f0c1c005210 2024-08-17T02:25:49.099 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.095+0000 7f0c371d3700 1 -- 172.21.15.174:0/2575366917 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a38a04cd-032b-4977-a260-1ef3567d0c46", "id": 4} v 0) v1 -- 0x7f0c300638f0 con 0x7f0c1c005210 2024-08-17T02:25:49.106 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.103+0000 7f0c267fc700 1 -- 172.21.15.174:0/2575366917 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a38a04cd-032b-4977-a260-1ef3567d0c46", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0c2c00f910 con 0x7f0c1c005210 2024-08-17T02:25:49.106 INFO:teuthology.orchestra.run.smithi174.stdout:4 2024-08-17T02:25:49.107 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.103+0000 7f0c371d3700 1 -- 172.21.15.174:0/2575366917 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c1c005210 msgr2=0x7f0c30068900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.107 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.103+0000 7f0c371d3700 1 --2- 172.21.15.174:0/2575366917 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c1c005210 0x7f0c30068900 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c002ab0 tx=0x7f0c2c007d30 comp rx=0 tx=0).stop 2024-08-17T02:25:49.107 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.103+0000 7f0c371d3700 1 -- 172.21.15.174:0/2575366917 shutdown_connections 2024-08-17T02:25:49.107 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.103+0000 7f0c371d3700 1 --2- 172.21.15.174:0/2575366917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c301585f0 0x7f0c30158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.108 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.103+0000 7f0c371d3700 1 --2- 172.21.15.174:0/2575366917 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c301709d0 0x7f0c300694c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.108 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.103+0000 7f0c371d3700 1 --2- 172.21.15.174:0/2575366917 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c1c005210 0x7f0c30068900 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.108 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.103+0000 7f0c371d3700 1 -- 172.21.15.174:0/2575366917 >> 172.21.15.174:0/2575366917 conn(0x7f0c3006e170 msgr2=0x7f0c300b0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:49.108 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.103+0000 7f0c371d3700 1 -- 172.21.15.174:0/2575366917 shutdown_connections 2024-08-17T02:25:49.108 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.103+0000 7f0c371d3700 1 -- 172.21.15.174:0/2575366917 wait complete. 2024-08-17T02:25:49.113 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-08-17T02:25:49.109+0000 7f19132dd000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:25:49.120 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new c7778084-e751-48da-87a1-ab8bbe85aa2d 5 2024-08-17T02:25:49.133 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-08-17T02:25:49.131+0000 7f51463a9000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:25:49.161 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-08-17T02:25:49.157+0000 7f19132dd000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:25:49.186 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-08-17T02:25:49.183+0000 7f51463a9000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:25:49.225 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.219+0000 7fa34d719700 1 Processor -- start 2024-08-17T02:25:49.225 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.219+0000 7fa34d719700 1 -- start start 2024-08-17T02:25:49.227 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.223+0000 7fa34d719700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa348159400 0x7fa3480b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.227 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.223+0000 7fa34d719700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa34806bac0 0x7fa3480686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.227 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.223+0000 7fa34d719700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3480adb00 con 0x7fa3481597d0 2024-08-17T02:25:49.227 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.223+0000 7fa34d719700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa34806bf60 con 0x7fa348159400 2024-08-17T02:25:49.228 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.223+0000 7fa34d719700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3480ac630 con 0x7fa34806bac0 2024-08-17T02:25:49.228 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.223+0000 7fa3477fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa34806bac0 0x7fa3480686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.228 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.223+0000 7fa3477fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa34806bac0 0x7fa3480686a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:47540/0 (socket says 172.21.15.174:47540) 2024-08-17T02:25:49.228 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.223+0000 7fa3477fe700 1 -- 172.21.15.174:0/1498736510 learned_addr learned my addr 172.21.15.174:0/1498736510 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-08-17T02:25:49.228 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.223+0000 7fa346ffd700 1 --2- 172.21.15.174:0/1498736510 >> v2:172.21.15.174:3300/0 conn(0x7fa348159400 0x7fa3480b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.229 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.223+0000 7fa346ffd700 1 -- 172.21.15.174:0/1498736510 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa34806bac0 msgr2=0x7fa3480686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:49.229 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.223+0000 7fa346ffd700 1 --2- 172.21.15.174:0/1498736510 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa34806bac0 0x7fa3480686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.229 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.223+0000 7fa346ffd700 1 -- 172.21.15.174:0/1498736510 >> v1:172.21.15.174:6789/0 conn(0x7fa3481597d0 legacy=0x7fa3480ad3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.230 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.223+0000 7fa345ffb700 1 -- 172.21.15.174:0/1498736510 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1882009816 0 0) 0x7fa3480adb00 con 0x7fa3481597d0 2024-08-17T02:25:49.230 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.223+0000 7fa346ffd700 1 -- 172.21.15.174:0/1498736510 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3480ac910 con 0x7fa348159400 2024-08-17T02:25:49.230 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.223+0000 7fa346ffd700 1 --2- 172.21.15.174:0/1498736510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa348159400 0x7fa3480b1c00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa3380098e0 tx=0x7fa3380091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44bcddb9040f0f95 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:49.230 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.223+0000 7fa345ffb700 1 -- 172.21.15.174:0/1498736510 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33800b640 con 0x7fa348159400 2024-08-17T02:25:49.230 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.223+0000 7fa345ffb700 1 -- 172.21.15.174:0/1498736510 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa33800b7a0 con 0x7fa348159400 2024-08-17T02:25:49.230 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.223+0000 7fa345ffb700 1 -- 172.21.15.174:0/1498736510 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33800bb40 con 0x7fa348159400 2024-08-17T02:25:49.230 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.227+0000 7fa34d719700 1 -- 172.21.15.174:0/1498736510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa348159400 msgr2=0x7fa3480b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.230 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.227+0000 7fa34d719700 1 --2- 172.21.15.174:0/1498736510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa348159400 0x7fa3480b1c00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa3380098e0 tx=0x7fa3380091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.230 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.227+0000 7fa34d719700 1 -- 172.21.15.174:0/1498736510 shutdown_connections 2024-08-17T02:25:49.230 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.227+0000 7fa34d719700 1 --2- 172.21.15.174:0/1498736510 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa34806bac0 0x7fa3480686a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.230 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.227+0000 7fa34d719700 1 --2- 172.21.15.174:0/1498736510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa348159400 0x7fa3480b1c00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.230 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.227+0000 7fa34d719700 1 -- 172.21.15.174:0/1498736510 >> 172.21.15.174:0/1498736510 conn(0x7fa3480c9bf0 msgr2=0x7fa34806d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:49.231 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.227+0000 7fa34d719700 1 -- 172.21.15.174:0/1498736510 shutdown_connections 2024-08-17T02:25:49.231 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.227+0000 7fa34d719700 1 -- 172.21.15.174:0/1498736510 wait complete. 2024-08-17T02:25:49.233 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.227+0000 7fa34d719700 1 Processor -- start 2024-08-17T02:25:49.233 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.227+0000 7fa34d719700 1 -- start start 2024-08-17T02:25:49.233 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.227+0000 7fa34d719700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa34806bac0 0x7fa3480a5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.233 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.227+0000 7fa34d719700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa348159400 0x7fa348164310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.233 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.227+0000 7fa34d719700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa3481597d0 0x7fa3480b0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.233 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.227+0000 7fa34d719700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3480a9600 con 0x7fa34806bac0 2024-08-17T02:25:49.233 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.227+0000 7fa34d719700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3480a7890 con 0x7fa348159400 2024-08-17T02:25:49.233 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.227+0000 7fa34d719700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3480a8fd0 con 0x7fa3481597d0 2024-08-17T02:25:49.234 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.227+0000 7fa3467fc700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa348159400 0x7fa348164310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.234 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.227+0000 7fa3467fc700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa348159400 0x7fa348164310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:43790/0 (socket says 172.21.15.174:43790) 2024-08-17T02:25:49.234 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.227+0000 7fa3467fc700 1 -- 172.21.15.174:0/3112009150 learned_addr learned my addr 172.21.15.174:0/3112009150 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-08-17T02:25:49.234 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.227+0000 7fa3477fe700 1 --2- 172.21.15.174:0/3112009150 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa3481597d0 0x7fa3480b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.234 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.227+0000 7fa346ffd700 1 --2- 172.21.15.174:0/3112009150 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa34806bac0 0x7fa3480a5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.234 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.227+0000 7fa3467fc700 1 -- 172.21.15.174:0/3112009150 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa3481597d0 msgr2=0x7fa3480b0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.234 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.227+0000 7fa3467fc700 1 --2- 172.21.15.174:0/3112009150 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa3481597d0 0x7fa3480b0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.234 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.227+0000 7fa3467fc700 1 -- 172.21.15.174:0/3112009150 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa34806bac0 msgr2=0x7fa3480a5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.234 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.227+0000 7fa3467fc700 1 --2- 172.21.15.174:0/3112009150 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa34806bac0 0x7fa3480a5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.234 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.227+0000 7fa3467fc700 1 -- 172.21.15.174:0/3112009150 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa338009420 con 0x7fa348159400 2024-08-17T02:25:49.234 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.227+0000 7fa3467fc700 1 --2- 172.21.15.174:0/3112009150 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa348159400 0x7fa348164310 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa33c00c7e0 tx=0x7fa33c007df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:49.234 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.227+0000 7fa32effd700 1 -- 172.21.15.174:0/3112009150 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33c012700 con 0x7fa348159400 2024-08-17T02:25:49.235 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.227+0000 7fa32effd700 1 -- 172.21.15.174:0/3112009150 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa33c012880 con 0x7fa348159400 2024-08-17T02:25:49.235 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.227+0000 7fa34d719700 1 -- 172.21.15.174:0/3112009150 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3480a6c80 con 0x7fa348159400 2024-08-17T02:25:49.235 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.227+0000 7fa32effd700 1 -- 172.21.15.174:0/3112009150 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33c012c40 con 0x7fa348159400 2024-08-17T02:25:49.235 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.227+0000 7fa34d719700 1 -- 172.21.15.174:0/3112009150 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3480a7240 con 0x7fa348159400 2024-08-17T02:25:49.235 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.227+0000 7fa32effd700 1 -- 172.21.15.174:0/3112009150 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fa33c01b400 con 0x7fa348159400 2024-08-17T02:25:49.235 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.227+0000 7fa32effd700 1 -- 172.21.15.174:0/3112009150 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7fa33c011380 con 0x7fa348159400 2024-08-17T02:25:49.235 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.231+0000 7fa34d719700 1 -- 172.21.15.174:0/3112009150 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3480645c0 con 0x7fa348159400 2024-08-17T02:25:49.235 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.231+0000 7fa32effd700 1 -- 172.21.15.174:0/3112009150 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fa33c01b6b0 con 0x7fa348159400 2024-08-17T02:25:49.309 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.307+0000 7fa34d719700 1 -- 172.21.15.174:0/3112009150 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c7778084-e751-48da-87a1-ab8bbe85aa2d", "id": 5} v 0) v1 -- 0x7fa3480a79d0 con 0x7fa348159400 2024-08-17T02:25:49.319 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.315+0000 7fa32effd700 1 -- 172.21.15.174:0/3112009150 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c7778084-e751-48da-87a1-ab8bbe85aa2d", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa33c01b850 con 0x7fa348159400 2024-08-17T02:25:49.319 INFO:teuthology.orchestra.run.smithi174.stdout:5 2024-08-17T02:25:49.321 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.315+0000 7fa34d719700 1 -- 172.21.15.174:0/3112009150 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa348159400 msgr2=0x7fa348164310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.321 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.315+0000 7fa34d719700 1 --2- 172.21.15.174:0/3112009150 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa348159400 0x7fa348164310 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa33c00c7e0 tx=0x7fa33c007df0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.321 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.315+0000 7fa34d719700 1 -- 172.21.15.174:0/3112009150 shutdown_connections 2024-08-17T02:25:49.321 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.315+0000 7fa34d719700 1 --2- 172.21.15.174:0/3112009150 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa3481597d0 0x7fa3480b0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.321 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.315+0000 7fa34d719700 1 --2- 172.21.15.174:0/3112009150 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa348159400 0x7fa348164310 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.321 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.315+0000 7fa34d719700 1 --2- 172.21.15.174:0/3112009150 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa34806bac0 0x7fa3480a5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.321 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.315+0000 7fa34d719700 1 -- 172.21.15.174:0/3112009150 >> 172.21.15.174:0/3112009150 conn(0x7fa3480c9bf0 msgr2=0x7fa3480ca6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:49.321 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.315+0000 7fa34d719700 1 -- 172.21.15.174:0/3112009150 shutdown_connections 2024-08-17T02:25:49.321 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.315+0000 7fa34d719700 1 -- 172.21.15.174:0/3112009150 wait complete. 2024-08-17T02:25:49.333 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new 2d8e0715-254f-442c-9625-50721d0bc858 6 2024-08-17T02:25:49.349 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-08-17T02:25:49.345+0000 7f19132dd000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:25:49.376 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-08-17T02:25:49.371+0000 7f51463a9000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:25:49.408 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-08-17T02:25:49.405+0000 7f19132dd000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:25:49.442 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-08-17T02:25:49.439+0000 7f51463a9000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:25:49.469 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-08-17T02:25:49.465+0000 7f19132dd000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:25:49.485 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.483+0000 7fd2b5a6c700 1 Processor -- start 2024-08-17T02:25:49.485 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.483+0000 7fd2b5a6c700 1 -- start start 2024-08-17T02:25:49.488 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.483+0000 7fd2b5a6c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd2b015a500 0x7fd2b00ae830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.488 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.483+0000 7fd2b5a6c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd2b015a8d0 0x7fd2b00686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.488 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.483+0000 7fd2b5a6c700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2b00b1540 con 0x7fd2b00b2250 2024-08-17T02:25:49.488 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.483+0000 7fd2b5a6c700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2b006ed10 con 0x7fd2b015a500 2024-08-17T02:25:49.488 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.483+0000 7fd2b5a6c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2b00b1dc0 con 0x7fd2b015a8d0 2024-08-17T02:25:49.488 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.483+0000 7fd2aeffd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd2b015a8d0 0x7fd2b00686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.488 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.483+0000 7fd2aeffd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd2b015a8d0 0x7fd2b00686a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:43798/0 (socket says 172.21.15.174:43798) 2024-08-17T02:25:49.488 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.483+0000 7fd2aeffd700 1 -- 172.21.15.174:0/3725405184 learned_addr learned my addr 172.21.15.174:0/3725405184 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-08-17T02:25:49.488 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.483+0000 7fd2af7fe700 1 --2- 172.21.15.174:0/3725405184 >> v2:172.21.15.153:3300/0 conn(0x7fd2b015a500 0x7fd2b00ae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.488 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.483+0000 7fd2aeffd700 1 -- 172.21.15.174:0/3725405184 >> v2:172.21.15.153:3300/0 conn(0x7fd2b015a500 msgr2=0x7fd2b00ae830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:49.488 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.483+0000 7fd2aeffd700 1 --2- 172.21.15.174:0/3725405184 >> v2:172.21.15.153:3300/0 conn(0x7fd2b015a500 0x7fd2b00ae830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.489 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.483+0000 7fd2aeffd700 1 -- 172.21.15.174:0/3725405184 >> v1:172.21.15.153:6789/0 conn(0x7fd2b00b2250 legacy=0x7fd2b00699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.489 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.483+0000 7fd2aeffd700 1 -- 172.21.15.174:0/3725405184 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b006ea30 con 0x7fd2b015a8d0 2024-08-17T02:25:49.489 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.483+0000 7fd2aeffd700 1 --2- 172.21.15.174:0/3725405184 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2b015a8d0 0x7fd2b00686a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd2b006d6e0 tx=0x7fd2a4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=564c08ed5a8d7c45 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:49.489 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.483+0000 7fd2ae7fc700 1 -- 172.21.15.174:0/3725405184 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a400b860 con 0x7fd2b015a8d0 2024-08-17T02:25:49.489 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.483+0000 7fd2ae7fc700 1 -- 172.21.15.174:0/3725405184 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a400b9c0 con 0x7fd2b015a8d0 2024-08-17T02:25:49.489 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.483+0000 7fd2ae7fc700 1 -- 172.21.15.174:0/3725405184 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a400bd60 con 0x7fd2b015a8d0 2024-08-17T02:25:49.490 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.483+0000 7fd2b5a6c700 1 -- 172.21.15.174:0/3725405184 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2b015a8d0 msgr2=0x7fd2b00686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.490 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.483+0000 7fd2b5a6c700 1 --2- 172.21.15.174:0/3725405184 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2b015a8d0 0x7fd2b00686a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd2b006d6e0 tx=0x7fd2a4009250 comp rx=0 tx=0).stop 2024-08-17T02:25:49.490 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.483+0000 7fd2b5a6c700 1 -- 172.21.15.174:0/3725405184 shutdown_connections 2024-08-17T02:25:49.490 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.483+0000 7fd2b5a6c700 1 --2- 172.21.15.174:0/3725405184 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2b015a8d0 0x7fd2b00686a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.490 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.483+0000 7fd2b5a6c700 1 --2- 172.21.15.174:0/3725405184 >> v2:172.21.15.153:3300/0 conn(0x7fd2b015a500 0x7fd2b00ae830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.490 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.483+0000 7fd2b5a6c700 1 -- 172.21.15.174:0/3725405184 >> 172.21.15.174:0/3725405184 conn(0x7fd2b00c9bf0 msgr2=0x7fd2b006d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:49.490 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.487+0000 7fd2b5a6c700 1 -- 172.21.15.174:0/3725405184 shutdown_connections 2024-08-17T02:25:49.490 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.487+0000 7fd2b5a6c700 1 -- 172.21.15.174:0/3725405184 wait complete. 2024-08-17T02:25:49.491 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.487+0000 7fd2b5a6c700 1 Processor -- start 2024-08-17T02:25:49.491 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.487+0000 7fd2b5a6c700 1 -- start start 2024-08-17T02:25:49.494 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.487+0000 7fd2b5a6c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2b00b2250 0x7fd2b01595d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.494 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.491+0000 7fd2b5a6c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2b015a500 0x7fd2b0169ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.494 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.491+0000 7fd2b5a6c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2b015a8d0 0x7fd2b00acc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.494 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.491+0000 7fd2b5a6c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b00ae320 con 0x7fd2b00b2250 2024-08-17T02:25:49.495 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.491+0000 7fd2b5a6c700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b0159b10 con 0x7fd2b015a8d0 2024-08-17T02:25:49.495 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.491+0000 7fd2b5a6c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b00adb10 con 0x7fd2b015a500 2024-08-17T02:25:49.495 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.491+0000 7fd2aeffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2b015a500 0x7fd2b0169ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.495 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.491+0000 7fd2affff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2b015a8d0 0x7fd2b00acc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.495 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.491+0000 7fd2aeffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2b015a500 0x7fd2b0169ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:47556/0 (socket says 172.21.15.174:47556) 2024-08-17T02:25:49.495 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.491+0000 7fd2aeffd700 1 -- 172.21.15.174:0/3269226570 learned_addr learned my addr 172.21.15.174:0/3269226570 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-08-17T02:25:49.495 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.491+0000 7fd2af7fe700 1 --2- 172.21.15.174:0/3269226570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2b00b2250 0x7fd2b01595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.495 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.491+0000 7fd2aeffd700 1 -- 172.21.15.174:0/3269226570 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2b015a8d0 msgr2=0x7fd2b00acc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.495 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.491+0000 7fd2aeffd700 1 --2- 172.21.15.174:0/3269226570 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2b015a8d0 0x7fd2b00acc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.495 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.491+0000 7fd2aeffd700 1 -- 172.21.15.174:0/3269226570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2b00b2250 msgr2=0x7fd2b01595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.495 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.491+0000 7fd2aeffd700 1 --2- 172.21.15.174:0/3269226570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2b00b2250 0x7fd2b01595d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.495 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.491+0000 7fd2aeffd700 1 -- 172.21.15.174:0/3269226570 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a40094f0 con 0x7fd2b015a500 2024-08-17T02:25:49.495 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.491+0000 7fd2af7fe700 1 --2- 172.21.15.174:0/3269226570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2b00b2250 0x7fd2b01595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:49.496 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.491+0000 7fd2aeffd700 1 --2- 172.21.15.174:0/3269226570 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2b015a500 0x7fd2b0169ea0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4006fd0 tx=0x7fd2a4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:49.496 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.491+0000 7fd2977fe700 1 -- 172.21.15.174:0/3269226570 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4024440 con 0x7fd2b015a500 2024-08-17T02:25:49.496 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.491+0000 7fd2977fe700 1 -- 172.21.15.174:0/3269226570 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a40245a0 con 0x7fd2b015a500 2024-08-17T02:25:49.496 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.491+0000 7fd2b5a6c700 1 -- 172.21.15.174:0/3269226570 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2b016a3e0 con 0x7fd2b015a500 2024-08-17T02:25:49.496 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.491+0000 7fd2977fe700 1 -- 172.21.15.174:0/3269226570 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4024960 con 0x7fd2b015a500 2024-08-17T02:25:49.496 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.491+0000 7fd2b5a6c700 1 -- 172.21.15.174:0/3269226570 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2b00ae040 con 0x7fd2b015a500 2024-08-17T02:25:49.496 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.491+0000 7fd2977fe700 1 -- 172.21.15.174:0/3269226570 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fd2a401a420 con 0x7fd2b015a500 2024-08-17T02:25:49.497 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.491+0000 7fd2977fe700 1 -- 172.21.15.174:0/3269226570 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7fd2a40239e0 con 0x7fd2b015a500 2024-08-17T02:25:49.497 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.491+0000 7fd2b5a6c700 1 -- 172.21.15.174:0/3269226570 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2b00645c0 con 0x7fd2b015a500 2024-08-17T02:25:49.498 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.495+0000 7fd2977fe700 1 -- 172.21.15.174:0/3269226570 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fd2a4015020 con 0x7fd2b015a500 2024-08-17T02:25:49.507 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-08-17T02:25:49.503+0000 7f51463a9000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:25:49.571 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.567+0000 7fd2b5a6c700 1 -- 172.21.15.174:0/3269226570 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2d8e0715-254f-442c-9625-50721d0bc858", "id": 6} v 0) v1 -- 0x7fd2b00ca580 con 0x7fd2b015a500 2024-08-17T02:25:49.581 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.575+0000 7fd2977fe700 1 -- 172.21.15.174:0/3269226570 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2d8e0715-254f-442c-9625-50721d0bc858", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd2a4023c70 con 0x7fd2b015a500 2024-08-17T02:25:49.581 INFO:teuthology.orchestra.run.smithi174.stdout:6 2024-08-17T02:25:49.582 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.579+0000 7fd2b5a6c700 1 -- 172.21.15.174:0/3269226570 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2b015a500 msgr2=0x7fd2b0169ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.583 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.579+0000 7fd2b5a6c700 1 --2- 172.21.15.174:0/3269226570 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2b015a500 0x7fd2b0169ea0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4006fd0 tx=0x7fd2a4017000 comp rx=0 tx=0).stop 2024-08-17T02:25:49.583 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.579+0000 7fd2b5a6c700 1 -- 172.21.15.174:0/3269226570 shutdown_connections 2024-08-17T02:25:49.583 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.579+0000 7fd2b5a6c700 1 --2- 172.21.15.174:0/3269226570 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2b015a8d0 0x7fd2b00acc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.583 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.579+0000 7fd2b5a6c700 1 --2- 172.21.15.174:0/3269226570 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2b015a500 0x7fd2b0169ea0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.583 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.579+0000 7fd2b5a6c700 1 --2- 172.21.15.174:0/3269226570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2b00b2250 0x7fd2b01595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.583 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.579+0000 7fd2b5a6c700 1 -- 172.21.15.174:0/3269226570 >> 172.21.15.174:0/3269226570 conn(0x7fd2b00c9bf0 msgr2=0x7fd2b0156410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:49.583 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.579+0000 7fd2b5a6c700 1 -- 172.21.15.174:0/3269226570 shutdown_connections 2024-08-17T02:25:49.583 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.579+0000 7fd2b5a6c700 1 -- 172.21.15.174:0/3269226570 wait complete. 2024-08-17T02:25:49.595 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new dffda25a-4601-4ddb-9a27-b0be1cadde27 7 2024-08-17T02:25:49.700 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.695+0000 7fbe2bfff700 1 Processor -- start 2024-08-17T02:25:49.700 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.695+0000 7fbe2bfff700 1 -- start start 2024-08-17T02:25:49.701 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.695+0000 7fbe2bfff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbe2c0afd50 0x7fbe2c0a9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.701 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.695+0000 7fbe2bfff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe2c0aae50 con 0x7fbe2c0a9da0 2024-08-17T02:25:49.701 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.695+0000 7fbe2bfff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe2c1594c0 con 0x7fbe2c0c9930 2024-08-17T02:25:49.701 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.695+0000 7fbe2bfff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe2c0aa240 con 0x7fbe2c0afd50 2024-08-17T02:25:49.701 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.699+0000 7fbe2b7fe700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fbe2c0c9930 0x7fbe2c0b0120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:34462/0 (socket says 172.21.15.174:34462) 2024-08-17T02:25:49.701 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.699+0000 7fbe2b7fe700 1 -- 172.21.15.174:0/3543266370 learned_addr learned my addr 172.21.15.174:0/3543266370 (peer_addr_for_me v1:172.21.15.174:0/0) 2024-08-17T02:25:49.701 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.699+0000 7fbe2affd700 1 --2- 172.21.15.174:0/3543266370 >> v2:172.21.15.174:3300/0 conn(0x7fbe2c0afd50 0x7fbe2c0a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.703 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.699+0000 7fbe29ffb700 1 -- 172.21.15.174:0/3543266370 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 336059232 0 0) 0x7fbe2c1594c0 con 0x7fbe2c0c9930 2024-08-17T02:25:49.703 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.699+0000 7fbe29ffb700 1 -- 172.21.15.174:0/3543266370 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe14003570 con 0x7fbe2c0c9930 2024-08-17T02:25:49.703 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.699+0000 7fbe2affd700 1 -- 172.21.15.174:0/3543266370 >> v1:172.21.15.174:6789/0 conn(0x7fbe2c0c9930 legacy=0x7fbe2c0b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.704 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.699+0000 7fbe2affd700 1 -- 172.21.15.174:0/3543266370 >> v1:172.21.15.153:6789/0 conn(0x7fbe2c0a9da0 legacy=0x7fbe2c0ab2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.704 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.699+0000 7fbe2affd700 1 -- 172.21.15.174:0/3543266370 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe2c0aa520 con 0x7fbe2c0afd50 2024-08-17T02:25:49.704 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.699+0000 7fbe2affd700 1 --2- 172.21.15.174:0/3543266370 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe2c0afd50 0x7fbe2c0a9860 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbe24009e60 tx=0x7fbe24009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abe622ad74478c2b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:49.704 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.699+0000 7fbe29ffb700 1 -- 172.21.15.174:0/3543266370 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2400e070 con 0x7fbe2c0afd50 2024-08-17T02:25:49.704 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.699+0000 7fbe29ffb700 1 -- 172.21.15.174:0/3543266370 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe2400bb60 con 0x7fbe2c0afd50 2024-08-17T02:25:49.704 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.699+0000 7fbe29ffb700 1 -- 172.21.15.174:0/3543266370 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe24012430 con 0x7fbe2c0afd50 2024-08-17T02:25:49.704 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.699+0000 7fbe2bfff700 1 -- 172.21.15.174:0/3543266370 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe2c0afd50 msgr2=0x7fbe2c0a9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.704 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.699+0000 7fbe2bfff700 1 --2- 172.21.15.174:0/3543266370 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe2c0afd50 0x7fbe2c0a9860 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbe24009e60 tx=0x7fbe24009780 comp rx=0 tx=0).stop 2024-08-17T02:25:49.704 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.699+0000 7fbe2bfff700 1 -- 172.21.15.174:0/3543266370 shutdown_connections 2024-08-17T02:25:49.704 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.699+0000 7fbe2bfff700 1 --2- 172.21.15.174:0/3543266370 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe2c0afd50 0x7fbe2c0a9860 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.704 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.699+0000 7fbe2bfff700 1 -- 172.21.15.174:0/3543266370 >> 172.21.15.174:0/3543266370 conn(0x7fbe2c06e170 msgr2=0x7fbe2c06e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:49.704 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.699+0000 7fbe2bfff700 1 -- 172.21.15.174:0/3543266370 shutdown_connections 2024-08-17T02:25:49.704 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.699+0000 7fbe2bfff700 1 -- 172.21.15.174:0/3543266370 wait complete. 2024-08-17T02:25:49.705 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.699+0000 7fbe2bfff700 1 Processor -- start 2024-08-17T02:25:49.705 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.699+0000 7fbe2bfff700 1 -- start start 2024-08-17T02:25:49.707 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.703+0000 7fbe2bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe2c0a9da0 0x7fbe2c15e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.707 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.703+0000 7fbe2bfff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe2c0afd50 0x7fbe2c0af090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.707 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.703+0000 7fbe2bfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe2c0c9930 0x7fbe2c16c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.708 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.703+0000 7fbe2bfff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c15ed40 con 0x7fbe2c0a9da0 2024-08-17T02:25:49.708 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.703+0000 7fbe2bfff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c14ee60 con 0x7fbe2c0afd50 2024-08-17T02:25:49.708 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.703+0000 7fbe2bfff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c14f140 con 0x7fbe2c0c9930 2024-08-17T02:25:49.708 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.703+0000 7fbe2b7fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe2c0c9930 0x7fbe2c16c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.708 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.703+0000 7fbe2a7fc700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe2c0afd50 0x7fbe2c0af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.708 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.703+0000 7fbe2b7fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe2c0c9930 0x7fbe2c16c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:47570/0 (socket says 172.21.15.174:47570) 2024-08-17T02:25:49.708 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.703+0000 7fbe2a7fc700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe2c0afd50 0x7fbe2c0af090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:43828/0 (socket says 172.21.15.174:43828) 2024-08-17T02:25:49.708 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.703+0000 7fbe2b7fe700 1 -- 172.21.15.174:0/2226920491 learned_addr learned my addr 172.21.15.174:0/2226920491 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-08-17T02:25:49.708 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.703+0000 7fbe2affd700 1 --2- 172.21.15.174:0/2226920491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe2c0a9da0 0x7fbe2c15e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.708 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.703+0000 7fbe2b7fe700 1 -- 172.21.15.174:0/2226920491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe2c0afd50 msgr2=0x7fbe2c0af090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.708 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.703+0000 7fbe2b7fe700 1 --2- 172.21.15.174:0/2226920491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe2c0afd50 0x7fbe2c0af090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.709 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.703+0000 7fbe2b7fe700 1 -- 172.21.15.174:0/2226920491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe2c0a9da0 msgr2=0x7fbe2c15e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.709 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.703+0000 7fbe2b7fe700 1 --2- 172.21.15.174:0/2226920491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe2c0a9da0 0x7fbe2c15e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.709 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.703+0000 7fbe2b7fe700 1 -- 172.21.15.174:0/2226920491 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe24009a20 con 0x7fbe2c0c9930 2024-08-17T02:25:49.709 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.703+0000 7fbe2a7fc700 1 --2- 172.21.15.174:0/2226920491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe2c0afd50 0x7fbe2c0af090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:49.709 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.703+0000 7fbe2b7fe700 1 --2- 172.21.15.174:0/2226920491 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe2c0c9930 0x7fbe2c16c880 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c0010e0 tx=0x7fbe1c007dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:49.709 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.703+0000 7fbe12ffd700 1 -- 172.21.15.174:0/2226920491 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c005c00 con 0x7fbe2c0c9930 2024-08-17T02:25:49.709 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.703+0000 7fbe12ffd700 1 -- 172.21.15.174:0/2226920491 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe1c005d60 con 0x7fbe2c0c9930 2024-08-17T02:25:49.709 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.703+0000 7fbe12ffd700 1 -- 172.21.15.174:0/2226920491 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c0072e0 con 0x7fbe2c0c9930 2024-08-17T02:25:49.709 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.703+0000 7fbe2bfff700 1 -- 172.21.15.174:0/2226920491 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe2c15e000 con 0x7fbe2c0c9930 2024-08-17T02:25:49.709 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.703+0000 7fbe2bfff700 1 -- 172.21.15.174:0/2226920491 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe2c15dd90 con 0x7fbe2c0c9930 2024-08-17T02:25:49.709 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.703+0000 7fbe12ffd700 1 -- 172.21.15.174:0/2226920491 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fbe1c01c440 con 0x7fbe2c0c9930 2024-08-17T02:25:49.709 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.703+0000 7fbe12ffd700 1 -- 172.21.15.174:0/2226920491 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7fbe1c0076d0 con 0x7fbe2c0c9930 2024-08-17T02:25:49.710 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.703+0000 7fbe2bfff700 1 -- 172.21.15.174:0/2226920491 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe2c0638f0 con 0x7fbe2c0c9930 2024-08-17T02:25:49.711 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.707+0000 7fbe12ffd700 1 -- 172.21.15.174:0/2226920491 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fbe1c021060 con 0x7fbe2c0c9930 2024-08-17T02:25:49.807 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.803+0000 7fbe2bfff700 1 -- 172.21.15.174:0/2226920491 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd new", "uuid": "dffda25a-4601-4ddb-9a27-b0be1cadde27", "id": 7} v 0) v1 -- 0x7fbe2c15e4d0 con 0x7fbe2c0c9930 2024-08-17T02:25:49.817 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.815+0000 7fbe12ffd700 1 -- 172.21.15.174:0/2226920491 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dffda25a-4601-4ddb-9a27-b0be1cadde27", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbe1c017070 con 0x7fbe2c0c9930 2024-08-17T02:25:49.817 INFO:teuthology.orchestra.run.smithi174.stdout:7 2024-08-17T02:25:49.820 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.815+0000 7fbe2bfff700 1 -- 172.21.15.174:0/2226920491 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe2c0c9930 msgr2=0x7fbe2c16c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.820 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.815+0000 7fbe2bfff700 1 --2- 172.21.15.174:0/2226920491 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe2c0c9930 0x7fbe2c16c880 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c0010e0 tx=0x7fbe1c007dd0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.820 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.815+0000 7fbe2bfff700 1 -- 172.21.15.174:0/2226920491 shutdown_connections 2024-08-17T02:25:49.820 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.815+0000 7fbe2bfff700 1 --2- 172.21.15.174:0/2226920491 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe2c0c9930 0x7fbe2c16c880 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.820 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.815+0000 7fbe2bfff700 1 --2- 172.21.15.174:0/2226920491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe2c0afd50 0x7fbe2c0af090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.820 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.815+0000 7fbe2bfff700 1 --2- 172.21.15.174:0/2226920491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe2c0a9da0 0x7fbe2c15e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.820 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.815+0000 7fbe2bfff700 1 -- 172.21.15.174:0/2226920491 >> 172.21.15.174:0/2226920491 conn(0x7fbe2c06e170 msgr2=0x7fbe2c15b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:49.820 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.815+0000 7fbe2bfff700 1 -- 172.21.15.174:0/2226920491 shutdown_connections 2024-08-17T02:25:49.820 INFO:teuthology.orchestra.run.smithi174.stderr:2024-08-17T02:25:49.815+0000 7fbe2bfff700 1 -- 172.21.15.174:0/2226920491 wait complete. 2024-08-17T02:25:49.834 INFO:tasks.ceph.osd.0:Restarting daemon 2024-08-17T02:25:49.834 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-08-17T02:25:49.836 INFO:tasks.ceph.osd.0:Started 2024-08-17T02:25:49.837 INFO:tasks.ceph.osd.1:Restarting daemon 2024-08-17T02:25:49.837 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-08-17T02:25:49.839 INFO:tasks.ceph.osd.1:Started 2024-08-17T02:25:49.839 INFO:tasks.ceph.osd.2:Restarting daemon 2024-08-17T02:25:49.839 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-08-17T02:25:49.841 INFO:tasks.ceph.osd.2:Started 2024-08-17T02:25:49.841 INFO:tasks.ceph.osd.3:Restarting daemon 2024-08-17T02:25:49.841 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-08-17T02:25:49.844 INFO:tasks.ceph.osd.3:Started 2024-08-17T02:25:49.844 INFO:tasks.ceph.osd.4:Restarting daemon 2024-08-17T02:25:49.844 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-08-17T02:25:49.846 INFO:tasks.ceph.osd.4:Started 2024-08-17T02:25:49.846 INFO:tasks.ceph.osd.5:Restarting daemon 2024-08-17T02:25:49.846 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-08-17T02:25:49.848 INFO:tasks.ceph.osd.5:Started 2024-08-17T02:25:49.848 INFO:tasks.ceph.osd.6:Restarting daemon 2024-08-17T02:25:49.848 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-08-17T02:25:49.850 INFO:tasks.ceph.osd.6:Started 2024-08-17T02:25:49.850 INFO:tasks.ceph.osd.7:Restarting daemon 2024-08-17T02:25:49.850 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-08-17T02:25:49.852 INFO:tasks.ceph.osd.7:Started 2024-08-17T02:25:49.852 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:49.909 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-08-17T02:25:49.905+0000 7f19132dd000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:25:49.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.957+0000 7f1d7dd42700 1 Processor -- start 2024-08-17T02:25:49.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.957+0000 7f1d7dd42700 1 -- start start 2024-08-17T02:25:49.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.957+0000 7f1d7dd42700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1d781593d0 0x7f1d780af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.957+0000 7f1d7dd42700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d780afc70 con 0x7f1d780ad0c0 2024-08-17T02:25:49.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.957+0000 7f1d7dd42700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d780b11d0 con 0x7f1d7806d240 2024-08-17T02:25:49.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.957+0000 7f1d7dd42700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d780aa6e0 con 0x7f1d781593d0 2024-08-17T02:25:49.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.957+0000 7f1d777fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1d781593d0 0x7f1d780af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.957+0000 7f1d77fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f1d780ad0c0 0x7f1d780a9fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:47150/0 (socket says 172.21.15.153:47150) 2024-08-17T02:25:49.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.957+0000 7f1d77fff700 1 -- 172.21.15.153:0/3011086443 learned_addr learned my addr 172.21.15.153:0/3011086443 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:25:49.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.957+0000 7f1d777fe700 1 -- 172.21.15.153:0/3011086443 >> v1:172.21.15.174:6789/0 conn(0x7f1d7806d240 legacy=0x7f1d780a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:49.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.957+0000 7f1d777fe700 1 -- 172.21.15.153:0/3011086443 >> v1:172.21.15.153:6789/0 conn(0x7f1d780ad0c0 legacy=0x7f1d780a9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.957+0000 7f1d777fe700 1 -- 172.21.15.153:0/3011086443 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d780b05c0 con 0x7f1d781593d0 2024-08-17T02:25:49.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.957+0000 7f1d767fc700 1 -- 172.21.15.153:0/3011086443 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2798099555 0 0) 0x7f1d780afc70 con 0x7f1d780ad0c0 2024-08-17T02:25:49.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.961+0000 7f1d777fe700 1 --2- 172.21.15.153:0/3011086443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d781593d0 0x7f1d780af730 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1d70009e60 tx=0x7f1d70009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1867e010b5afd29a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:49.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.961+0000 7f1d767fc700 1 -- 172.21.15.153:0/3011086443 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7000e070 con 0x7f1d781593d0 2024-08-17T02:25:49.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.961+0000 7f1d767fc700 1 -- 172.21.15.153:0/3011086443 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7000bbf0 con 0x7f1d781593d0 2024-08-17T02:25:49.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.961+0000 7f1d767fc700 1 -- 172.21.15.153:0/3011086443 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d70012430 con 0x7f1d781593d0 2024-08-17T02:25:49.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.961+0000 7f1d7dd42700 1 -- 172.21.15.153:0/3011086443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d781593d0 msgr2=0x7f1d780af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.961+0000 7f1d7dd42700 1 --2- 172.21.15.153:0/3011086443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d781593d0 0x7f1d780af730 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1d70009e60 tx=0x7f1d70009780 comp rx=0 tx=0).stop 2024-08-17T02:25:49.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.961+0000 7f1d7dd42700 1 -- 172.21.15.153:0/3011086443 shutdown_connections 2024-08-17T02:25:49.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.961+0000 7f1d7dd42700 1 --2- 172.21.15.153:0/3011086443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d781593d0 0x7f1d780af730 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.961+0000 7f1d7dd42700 1 -- 172.21.15.153:0/3011086443 >> 172.21.15.153:0/3011086443 conn(0x7f1d780cc950 msgr2=0x7f1d78066e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:49.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.961+0000 7f1d7dd42700 1 -- 172.21.15.153:0/3011086443 shutdown_connections 2024-08-17T02:25:49.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.961+0000 7f1d7dd42700 1 -- 172.21.15.153:0/3011086443 wait complete. 2024-08-17T02:25:49.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.961+0000 7f1d7dd42700 1 Processor -- start 2024-08-17T02:25:49.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.961+0000 7f1d7dd42700 1 -- start start 2024-08-17T02:25:49.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.961+0000 7f1d7dd42700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d7806d240 0x7f1d780c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.961+0000 7f1d7dd42700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d780ad0c0 0x7f1d7816d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.961+0000 7f1d7dd42700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d781593d0 0x7f1d7814ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.961+0000 7f1d7dd42700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7816d6f0 con 0x7f1d781593d0 2024-08-17T02:25:49.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.961+0000 7f1d7dd42700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d780cb520 con 0x7f1d780ad0c0 2024-08-17T02:25:49.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.961+0000 7f1d7dd42700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d780c94a0 con 0x7f1d7806d240 2024-08-17T02:25:49.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.961+0000 7f1d77fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d781593d0 0x7f1d7814ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.961+0000 7f1d77fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d781593d0 0x7f1d7814ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38188/0 (socket says 172.21.15.153:38188) 2024-08-17T02:25:49.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.961+0000 7f1d77fff700 1 -- 172.21.15.153:0/1306642892 learned_addr learned my addr 172.21.15.153:0/1306642892 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:25:49.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.961+0000 7f1d777fe700 1 --2- 172.21.15.153:0/1306642892 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d7806d240 0x7f1d780c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.961+0000 7f1d76ffd700 1 --2- 172.21.15.153:0/1306642892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d780ad0c0 0x7f1d7816d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.961+0000 7f1d77fff700 1 -- 172.21.15.153:0/1306642892 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d7806d240 msgr2=0x7f1d780c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.961+0000 7f1d77fff700 1 --2- 172.21.15.153:0/1306642892 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d7806d240 0x7f1d780c8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.961+0000 7f1d77fff700 1 -- 172.21.15.153:0/1306642892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d780ad0c0 msgr2=0x7f1d7816d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.961+0000 7f1d77fff700 1 --2- 172.21.15.153:0/1306642892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d780ad0c0 0x7f1d7816d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.961+0000 7f1d77fff700 1 -- 172.21.15.153:0/1306642892 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d70009a20 con 0x7f1d781593d0 2024-08-17T02:25:49.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.961+0000 7f1d76ffd700 1 --2- 172.21.15.153:0/1306642892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d780ad0c0 0x7f1d7816d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:49.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.961+0000 7f1d77fff700 1 --2- 172.21.15.153:0/1306642892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d781593d0 0x7f1d7814ba70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c00c500 tx=0x7f1d6c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:49.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.961+0000 7f1d5f7fe700 1 -- 172.21.15.153:0/1306642892 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c005af0 con 0x7f1d781593d0 2024-08-17T02:25:49.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.961+0000 7f1d5f7fe700 1 -- 172.21.15.153:0/1306642892 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6c005c70 con 0x7f1d781593d0 2024-08-17T02:25:49.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.961+0000 7f1d7dd42700 1 -- 172.21.15.153:0/1306642892 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d780cabf0 con 0x7f1d781593d0 2024-08-17T02:25:49.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.965+0000 7f1d5f7fe700 1 -- 172.21.15.153:0/1306642892 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c0070d0 con 0x7f1d781593d0 2024-08-17T02:25:49.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.965+0000 7f1d7dd42700 1 -- 172.21.15.153:0/1306642892 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d780cb1b0 con 0x7f1d781593d0 2024-08-17T02:25:49.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.965+0000 7f1d5f7fe700 1 -- 172.21.15.153:0/1306642892 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f1d6c007500 con 0x7f1d781593d0 2024-08-17T02:25:49.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.965+0000 7f1d5f7fe700 1 -- 172.21.15.153:0/1306642892 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f1d6c01c440 con 0x7f1d781593d0 2024-08-17T02:25:49.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.965+0000 7f1d7dd42700 1 -- 172.21.15.153:0/1306642892 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d780645c0 con 0x7f1d781593d0 2024-08-17T02:25:49.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:49.969+0000 7f1d5f7fe700 1 -- 172.21.15.153:0/1306642892 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f1d6c017070 con 0x7f1d781593d0 2024-08-17T02:25:50.004 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-08-17T02:25:49.999+0000 7f51463a9000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:25:50.024 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-08-17T02:25:50.021+0000 7f19132dd000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:25:50.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:50.029+0000 7f1d7dd42700 1 -- 172.21.15.153:0/1306642892 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d780cb660 con 0x7f1d781593d0 2024-08-17T02:25:50.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:50.033+0000 7f1d5f7fe700 1 -- 172.21.15.153:0/1306642892 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f1d6c024410 con 0x7f1d781593d0 2024-08-17T02:25:50.036 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:25:50.036 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":10,"fsid":"56d41c33-b929-456d-96be-2aac4ecd299d","created":"2024-08-17T02:25:47.756085+0000","modified":"2024-08-17T02:25:49.809186+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:25:49.809186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"0736f8e6-818e-42e6-a0dc-8aaf813315d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"011762e9-6c2d-441a-aa56-68474639d72f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b562cd97-aa12-455e-b46a-e720a2ec9d3e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"222da52f-90c2-4132-a5d2-6f6cf83d4780","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a38a04cd-032b-4977-a260-1ef3567d0c46","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c7778084-e751-48da-87a1-ab8bbe85aa2d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2d8e0715-254f-442c-9625-50721d0bc858","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"dffda25a-4601-4ddb-9a27-b0be1cadde27","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:50.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:50.033+0000 7f1d7dd42700 1 -- 172.21.15.153:0/1306642892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d781593d0 msgr2=0x7f1d7814ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:50.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:50.033+0000 7f1d7dd42700 1 --2- 172.21.15.153:0/1306642892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d781593d0 0x7f1d7814ba70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c00c500 tx=0x7f1d6c007f60 comp rx=0 tx=0).stop 2024-08-17T02:25:50.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:50.033+0000 7f1d7dd42700 1 -- 172.21.15.153:0/1306642892 shutdown_connections 2024-08-17T02:25:50.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:50.033+0000 7f1d7dd42700 1 --2- 172.21.15.153:0/1306642892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d781593d0 0x7f1d7814ba70 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:50.033+0000 7f1d7dd42700 1 --2- 172.21.15.153:0/1306642892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d780ad0c0 0x7f1d7816d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:50.033+0000 7f1d7dd42700 1 --2- 172.21.15.153:0/1306642892 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d7806d240 0x7f1d780c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:50.033+0000 7f1d7dd42700 1 -- 172.21.15.153:0/1306642892 >> 172.21.15.153:0/1306642892 conn(0x7f1d780cc950 msgr2=0x7f1d780a8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:50.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:50.033+0000 7f1d7dd42700 1 -- 172.21.15.153:0/1306642892 shutdown_connections 2024-08-17T02:25:50.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:25:50.033+0000 7f1d7dd42700 1 -- 172.21.15.153:0/1306642892 wait complete. 2024-08-17T02:25:50.048 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-08-17T02:25:50.048 INFO:tasks.ceph:Waiting for OSDs to come up 2024-08-17T02:25:50.126 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-08-17T02:25:50.123+0000 7f51463a9000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:25:50.197 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-08-17T02:25:50.193+0000 7f47a10403c0 -1 Falling back to public interface 2024-08-17T02:25:50.197 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-08-17T02:25:50.193+0000 7f86e143b3c0 -1 Falling back to public interface 2024-08-17T02:25:50.207 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-08-17T02:25:50.205+0000 7fad2e49a3c0 -1 Falling back to public interface 2024-08-17T02:25:50.215 INFO:tasks.ceph.osd.3.smithi153.stderr:2024-08-17T02:25:50.213+0000 7f41b4c1f3c0 -1 Falling back to public interface 2024-08-17T02:25:50.243 INFO:tasks.ceph.osd.6.smithi174.stderr:2024-08-17T02:25:50.239+0000 7fad894743c0 -1 Falling back to public interface 2024-08-17T02:25:50.325 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-08-17T02:25:50.321+0000 7f19132dd000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:25:50.439 INFO:tasks.ceph.osd.4.smithi174.stderr:2024-08-17T02:25:50.435+0000 7f22fa3af3c0 -1 Falling back to public interface 2024-08-17T02:25:50.448 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-08-17T02:25:50.443+0000 7f51463a9000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:25:50.471 INFO:tasks.ceph.osd.7.smithi174.stderr:2024-08-17T02:25:50.467+0000 7f06ccf603c0 -1 Falling back to public interface 2024-08-17T02:25:50.486 INFO:tasks.ceph.osd.5.smithi174.stderr:2024-08-17T02:25:50.483+0000 7fb25beb33c0 -1 Falling back to public interface 2024-08-17T02:25:50.489 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-08-17T02:25:50.485+0000 7f19132dd000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:25:50.560 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-08-17T02:25:50.557+0000 7f19132dd000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:25:50.613 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-08-17T02:25:50.609+0000 7f19132dd000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:25:50.616 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-08-17T02:25:50.611+0000 7f51463a9000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:25:50.669 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-08-17T02:25:50.665+0000 7f19132dd000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:25:50.682 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-08-17T02:25:50.679+0000 7f51463a9000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:25:50.742 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-08-17T02:25:50.739+0000 7f51463a9000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:25:50.802 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-08-17T02:25:50.799+0000 7f51463a9000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:25:50.831 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-08-17T02:25:50.829+0000 7f19132dd000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:25:50.851 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:50.952 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.949+0000 7fe765c37700 1 Processor -- start 2024-08-17T02:25:50.952 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.949+0000 7fe765c37700 1 -- start start 2024-08-17T02:25:50.953 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.949+0000 7fe765c37700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe760159150 0x7fe7600afea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:50.953 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.949+0000 7fe765c37700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe76006c7a0 0x7fe7600a9940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:50.954 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.949+0000 7fe765c37700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7600ae810 con 0x7fe760159520 2024-08-17T02:25:50.954 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.949+0000 7fe765c37700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe760159980 con 0x7fe76006c7a0 2024-08-17T02:25:50.954 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.949+0000 7fe765c37700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7600adc40 con 0x7fe760159150 2024-08-17T02:25:50.954 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.949+0000 7fe765436700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe76006c7a0 0x7fe7600a9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:50.954 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.949+0000 7fe765436700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe76006c7a0 0x7fe7600a9940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38198/0 (socket says 172.21.15.153:38198) 2024-08-17T02:25:50.954 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.949+0000 7fe765436700 1 -- 172.21.15.153:0/3053551293 learned_addr learned my addr 172.21.15.153:0/3053551293 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:25:50.954 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.949+0000 7fe764c35700 1 --2- 172.21.15.153:0/3053551293 >> v2:172.21.15.174:3300/0 conn(0x7fe760159150 0x7fe7600afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:50.954 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.949+0000 7fe765436700 1 -- 172.21.15.153:0/3053551293 >> v2:172.21.15.174:3300/0 conn(0x7fe760159150 msgr2=0x7fe7600afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:50.954 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.949+0000 7fe765436700 1 --2- 172.21.15.153:0/3053551293 >> v2:172.21.15.174:3300/0 conn(0x7fe760159150 0x7fe7600afea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.954 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.949+0000 7fe765436700 1 -- 172.21.15.153:0/3053551293 >> v1:172.21.15.174:6789/0 conn(0x7fe760159520 legacy=0x7fe76006c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:50.954 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.949+0000 7fe765436700 1 -- 172.21.15.153:0/3053551293 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7600adee0 con 0x7fe76006c7a0 2024-08-17T02:25:50.954 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.949+0000 7fe765436700 1 --2- 172.21.15.153:0/3053551293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe76006c7a0 0x7fe7600a9940 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe76006f040 tx=0x7fe754009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=261c04b6da836aa4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:50.955 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.949+0000 7fe75f7fe700 1 -- 172.21.15.153:0/3053551293 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe754009e70 con 0x7fe76006c7a0 2024-08-17T02:25:50.956 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.949+0000 7fe75f7fe700 1 -- 172.21.15.153:0/3053551293 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75400b860 con 0x7fe76006c7a0 2024-08-17T02:25:50.956 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.949+0000 7fe75f7fe700 1 -- 172.21.15.153:0/3053551293 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75400bc00 con 0x7fe76006c7a0 2024-08-17T02:25:50.956 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.953+0000 7fe765c37700 1 -- 172.21.15.153:0/3053551293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe76006c7a0 msgr2=0x7fe7600a9940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:50.956 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.953+0000 7fe765c37700 1 --2- 172.21.15.153:0/3053551293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe76006c7a0 0x7fe7600a9940 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe76006f040 tx=0x7fe754009250 comp rx=0 tx=0).stop 2024-08-17T02:25:50.956 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.953+0000 7fe765c37700 1 -- 172.21.15.153:0/3053551293 shutdown_connections 2024-08-17T02:25:50.956 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.953+0000 7fe765c37700 1 --2- 172.21.15.153:0/3053551293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe76006c7a0 0x7fe7600a9940 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.956 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.953+0000 7fe765c37700 1 --2- 172.21.15.153:0/3053551293 >> v2:172.21.15.174:3300/0 conn(0x7fe760159150 0x7fe7600afea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.956 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.953+0000 7fe765c37700 1 -- 172.21.15.153:0/3053551293 >> 172.21.15.153:0/3053551293 conn(0x7fe7600cceb0 msgr2=0x7fe7600cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:50.956 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.953+0000 7fe765c37700 1 -- 172.21.15.153:0/3053551293 shutdown_connections 2024-08-17T02:25:50.956 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.953+0000 7fe765c37700 1 -- 172.21.15.153:0/3053551293 wait complete. 2024-08-17T02:25:50.957 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.953+0000 7fe765c37700 1 Processor -- start 2024-08-17T02:25:50.957 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.953+0000 7fe765c37700 1 -- start start 2024-08-17T02:25:50.960 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.953+0000 7fe765c37700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe76006c7a0 0x7fe76014ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:50.960 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.953+0000 7fe765c37700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe760159150 0x7fe7600c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:50.960 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.953+0000 7fe765c37700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe760159520 0x7fe7600c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:50.960 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.953+0000 7fe765c37700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76015aeb0 con 0x7fe76006c7a0 2024-08-17T02:25:50.960 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.953+0000 7fe765c37700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76015a2a0 con 0x7fe760159150 2024-08-17T02:25:50.960 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.953+0000 7fe765c37700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76015a580 con 0x7fe760159520 2024-08-17T02:25:50.960 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.953+0000 7fe764c35700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe76006c7a0 0x7fe76014ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:50.960 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.957+0000 7fe75ffff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe760159150 0x7fe7600c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:50.960 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.957+0000 7fe764c35700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe76006c7a0 0x7fe76014ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38200/0 (socket says 172.21.15.153:38200) 2024-08-17T02:25:50.960 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.957+0000 7fe764c35700 1 -- 172.21.15.153:0/3214010271 learned_addr learned my addr 172.21.15.153:0/3214010271 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:25:50.960 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.957+0000 7fe765436700 1 --2- 172.21.15.153:0/3214010271 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe760159520 0x7fe7600c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:50.961 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.957+0000 7fe764c35700 1 -- 172.21.15.153:0/3214010271 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe760159520 msgr2=0x7fe7600c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:50.961 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.957+0000 7fe764c35700 1 --2- 172.21.15.153:0/3214010271 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe760159520 0x7fe7600c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.961 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.957+0000 7fe764c35700 1 -- 172.21.15.153:0/3214010271 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe760159150 msgr2=0x7fe7600c96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:50.961 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.957+0000 7fe764c35700 1 --2- 172.21.15.153:0/3214010271 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe760159150 0x7fe7600c96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.961 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.957+0000 7fe764c35700 1 -- 172.21.15.153:0/3214010271 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7540094f0 con 0x7fe76006c7a0 2024-08-17T02:25:50.961 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.957+0000 7fe765436700 1 --2- 172.21.15.153:0/3214010271 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe760159520 0x7fe7600c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:50.961 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.957+0000 7fe764c35700 1 --2- 172.21.15.153:0/3214010271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe76006c7a0 0x7fe76014ec70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe758009ef0 tx=0x7fe75800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:50.961 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.957+0000 7fe75cff9700 1 -- 172.21.15.153:0/3214010271 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75800cc20 con 0x7fe76006c7a0 2024-08-17T02:25:50.961 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.957+0000 7fe75cff9700 1 -- 172.21.15.153:0/3214010271 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75800f040 con 0x7fe76006c7a0 2024-08-17T02:25:50.961 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.957+0000 7fe765c37700 1 -- 172.21.15.153:0/3214010271 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe76015a860 con 0x7fe76006c7a0 2024-08-17T02:25:50.961 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.957+0000 7fe75cff9700 1 -- 172.21.15.153:0/3214010271 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe758014480 con 0x7fe76006c7a0 2024-08-17T02:25:50.961 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.957+0000 7fe765c37700 1 -- 172.21.15.153:0/3214010271 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe760159cf0 con 0x7fe76006c7a0 2024-08-17T02:25:50.962 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.957+0000 7fe75cff9700 1 -- 172.21.15.153:0/3214010271 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fe758014a80 con 0x7fe76006c7a0 2024-08-17T02:25:50.962 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.957+0000 7fe75cff9700 1 -- 172.21.15.153:0/3214010271 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fe75801d400 con 0x7fe76006c7a0 2024-08-17T02:25:50.962 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.957+0000 7fe765c37700 1 -- 172.21.15.153:0/3214010271 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe760064ba0 con 0x7fe76006c7a0 2024-08-17T02:25:50.965 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:50.961+0000 7fe75cff9700 1 -- 172.21.15.153:0/3214010271 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fe75803b7a0 con 0x7fe76006c7a0 2024-08-17T02:25:50.979 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-08-17T02:25:50.975+0000 7f51463a9000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:25:50.998 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-08-17T02:25:50.993+0000 7f19132dd000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:25:51.030 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:51.025+0000 7fe765c37700 1 -- 172.21.15.153:0/3214010271 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7600c9490 con 0x7fe76006c7a0 2024-08-17T02:25:51.031 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:51.029+0000 7fe75cff9700 1 -- 172.21.15.153:0/3214010271 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fe75802a070 con 0x7fe76006c7a0 2024-08-17T02:25:51.031 INFO:teuthology.misc.health.smithi153.stdout: 2024-08-17T02:25:51.031 INFO:teuthology.misc.health.smithi153.stdout:{"epoch":10,"fsid":"56d41c33-b929-456d-96be-2aac4ecd299d","created":"2024-08-17T02:25:47.756085+0000","modified":"2024-08-17T02:25:49.809186+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:25:49.809186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"0736f8e6-818e-42e6-a0dc-8aaf813315d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"011762e9-6c2d-441a-aa56-68474639d72f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b562cd97-aa12-455e-b46a-e720a2ec9d3e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"222da52f-90c2-4132-a5d2-6f6cf83d4780","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a38a04cd-032b-4977-a260-1ef3567d0c46","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c7778084-e751-48da-87a1-ab8bbe85aa2d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2d8e0715-254f-442c-9625-50721d0bc858","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"dffda25a-4601-4ddb-9a27-b0be1cadde27","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:51.032 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:51.029+0000 7fe765c37700 1 -- 172.21.15.153:0/3214010271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe76006c7a0 msgr2=0x7fe76014ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:51.033 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:51.029+0000 7fe765c37700 1 --2- 172.21.15.153:0/3214010271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe76006c7a0 0x7fe76014ec70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe758009ef0 tx=0x7fe75800b040 comp rx=0 tx=0).stop 2024-08-17T02:25:51.033 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:51.029+0000 7fe765c37700 1 -- 172.21.15.153:0/3214010271 shutdown_connections 2024-08-17T02:25:51.033 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:51.029+0000 7fe765c37700 1 --2- 172.21.15.153:0/3214010271 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe760159520 0x7fe7600c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.033 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:51.029+0000 7fe765c37700 1 --2- 172.21.15.153:0/3214010271 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe760159150 0x7fe7600c96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.033 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:51.029+0000 7fe765c37700 1 --2- 172.21.15.153:0/3214010271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe76006c7a0 0x7fe76014ec70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.033 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:51.029+0000 7fe765c37700 1 -- 172.21.15.153:0/3214010271 >> 172.21.15.153:0/3214010271 conn(0x7fe7600cceb0 msgr2=0x7fe7600aeba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:51.033 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:51.029+0000 7fe765c37700 1 -- 172.21.15.153:0/3214010271 shutdown_connections 2024-08-17T02:25:51.033 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:51.029+0000 7fe765c37700 1 -- 172.21.15.153:0/3214010271 wait complete. 2024-08-17T02:25:51.042 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-08-17T02:25:51.063 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-08-17T02:25:51.061+0000 7f19132dd000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:25:51.163 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-08-17T02:25:51.159+0000 7f51463a9000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:25:51.219 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-08-17T02:25:51.217+0000 7f19132dd000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:25:51.234 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-08-17T02:25:51.231+0000 7f51463a9000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:25:51.288 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-08-17T02:25:51.285+0000 7f19132dd000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:25:51.410 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-08-17T02:25:51.407+0000 7f51463a9000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:25:51.477 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-08-17T02:25:51.471+0000 7f51463a9000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:25:51.999 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-08-17T02:25:51.993+0000 7f19132dd000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:25:52.209 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-08-17T02:25:52.203+0000 7f51463a9000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:25:53.045 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-08-17T02:25:53.041+0000 7f18fc355700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-08-17T02:25:53.045 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-08-17T02:25:53.041+0000 7f18fc355700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-08-17T02:25:53.750 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-08-17T02:25:53.745+0000 7f86e143b3c0 -1 osd.2 0 log_to_monitors true 2024-08-17T02:25:54.011 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-08-17T02:25:54.009+0000 7fad2e49a3c0 -1 osd.0 0 log_to_monitors true 2024-08-17T02:25:54.031 INFO:tasks.ceph.osd.4.smithi174.stderr:2024-08-17T02:25:54.027+0000 7f22fa3af3c0 -1 osd.4 0 log_to_monitors true 2024-08-17T02:25:54.055 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-08-17T02:25:54.053+0000 7f47a10403c0 -1 osd.1 0 log_to_monitors true 2024-08-17T02:25:54.075 INFO:tasks.ceph.osd.3.smithi153.stderr:2024-08-17T02:25:54.073+0000 7f41b4c1f3c0 -1 osd.3 0 log_to_monitors true 2024-08-17T02:25:54.087 INFO:tasks.ceph.osd.6.smithi174.stderr:2024-08-17T02:25:54.083+0000 7fad894743c0 -1 osd.6 0 log_to_monitors true 2024-08-17T02:25:54.265 INFO:tasks.ceph.osd.7.smithi174.stderr:2024-08-17T02:25:54.259+0000 7f06ccf603c0 -1 osd.7 0 log_to_monitors true 2024-08-17T02:25:54.355 INFO:tasks.ceph.osd.5.smithi174.stderr:2024-08-17T02:25:54.351+0000 7fb25beb33c0 -1 osd.5 0 log_to_monitors true 2024-08-17T02:25:56.795 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-08-17T02:25:56.793+0000 7fad2b45f700 -1 osd.0 0 waiting for initial osdmap 2024-08-17T02:25:56.830 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-08-17T02:25:56.829+0000 7fad229dd700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:25:56.867 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-08-17T02:25:56.865+0000 7f86de400700 -1 osd.2 0 waiting for initial osdmap 2024-08-17T02:25:56.887 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-08-17T02:25:56.885+0000 7f86d597e700 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:25:57.632 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-08-17T02:25:57.629+0000 7f479e005700 -1 osd.1 0 waiting for initial osdmap 2024-08-17T02:25:57.635 INFO:tasks.ceph.osd.3.smithi153.stderr:2024-08-17T02:25:57.633+0000 7f41b1be4700 -1 osd.3 0 waiting for initial osdmap 2024-08-17T02:25:57.642 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-08-17T02:25:57.637+0000 7f4795583700 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:25:57.644 INFO:tasks.ceph.osd.3.smithi153.stderr:2024-08-17T02:25:57.641+0000 7f41a9162700 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:25:57.848 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:57.951 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.949+0000 7f8e0fb0b700 1 Processor -- start 2024-08-17T02:25:57.951 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.949+0000 7f8e0fb0b700 1 -- start start 2024-08-17T02:25:57.952 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.949+0000 7f8e0fb0b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e0806e2f0 0x7f8e0806e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:57.952 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.949+0000 7f8e0fb0b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e080c9900 con 0x7f8e080c8dc0 2024-08-17T02:25:57.952 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.949+0000 7f8e0fb0b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e080ca740 con 0x7f8e0815d3a0 2024-08-17T02:25:57.952 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.949+0000 7f8e0fb0b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0806ec80 con 0x7f8e0806e2f0 2024-08-17T02:25:57.952 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.949+0000 7f8e0e0a8700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f8e080c8dc0 0x7f8e080c91f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:37164/0 (socket says 172.21.15.153:37164) 2024-08-17T02:25:57.952 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.949+0000 7f8e0e0a8700 1 -- 172.21.15.153:0/115160054 learned_addr learned my addr 172.21.15.153:0/115160054 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:25:57.953 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.949+0000 7f8e0d0a6700 1 --2- 172.21.15.153:0/115160054 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e0806e2f0 0x7f8e0806e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:57.954 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.949+0000 7f8e0d0a6700 1 -- 172.21.15.153:0/115160054 >> v1:172.21.15.174:6789/0 conn(0x7f8e0815d3a0 legacy=0x7f8e080cabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:57.954 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.949+0000 7f8e0d0a6700 1 -- 172.21.15.153:0/115160054 >> v1:172.21.15.153:6789/0 conn(0x7f8e080c8dc0 legacy=0x7f8e080c91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:57.954 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.949+0000 7f8e0d0a6700 1 -- 172.21.15.153:0/115160054 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e0815e780 con 0x7f8e0806e2f0 2024-08-17T02:25:57.954 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.949+0000 7f8e0c8a5700 1 -- 172.21.15.153:0/115160054 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3318391454 0 0) 0x7f8e080ca740 con 0x7f8e0815d3a0 2024-08-17T02:25:57.955 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.949+0000 7f8e0d0a6700 1 --2- 172.21.15.153:0/115160054 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e0806e2f0 0x7f8e0806e740 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8e00009e90 tx=0x7f8e00009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c2a9776cfd408b8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:57.955 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.949+0000 7f8e0c8a5700 1 -- 172.21.15.153:0/115160054 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0000e070 con 0x7f8e0806e2f0 2024-08-17T02:25:57.955 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.949+0000 7f8e0c8a5700 1 -- 172.21.15.153:0/115160054 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0000bb30 con 0x7f8e0806e2f0 2024-08-17T02:25:57.955 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.949+0000 7f8e0c8a5700 1 -- 172.21.15.153:0/115160054 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e00012430 con 0x7f8e0806e2f0 2024-08-17T02:25:57.955 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.949+0000 7f8e0fb0b700 1 -- 172.21.15.153:0/115160054 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e0806e2f0 msgr2=0x7f8e0806e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:57.955 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.949+0000 7f8e0fb0b700 1 --2- 172.21.15.153:0/115160054 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e0806e2f0 0x7f8e0806e740 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8e00009e90 tx=0x7f8e00009780 comp rx=0 tx=0).stop 2024-08-17T02:25:57.955 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.949+0000 7f8e0fb0b700 1 -- 172.21.15.153:0/115160054 shutdown_connections 2024-08-17T02:25:57.955 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.949+0000 7f8e0fb0b700 1 --2- 172.21.15.153:0/115160054 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e0806e2f0 0x7f8e0806e740 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.955 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.949+0000 7f8e0fb0b700 1 -- 172.21.15.153:0/115160054 >> 172.21.15.153:0/115160054 conn(0x7f8e080700f0 msgr2=0x7f8e080704f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:57.955 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.949+0000 7f8e0fb0b700 1 -- 172.21.15.153:0/115160054 shutdown_connections 2024-08-17T02:25:57.955 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.949+0000 7f8e0fb0b700 1 -- 172.21.15.153:0/115160054 wait complete. 2024-08-17T02:25:57.956 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.953+0000 7f8e0fb0b700 1 Processor -- start 2024-08-17T02:25:57.956 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.953+0000 7f8e0fb0b700 1 -- start start 2024-08-17T02:25:57.957 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.953+0000 7f8e0fb0b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e0806e2f0 0x7f8e0814aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:57.958 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.953+0000 7f8e0fb0b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e080c8dc0 0x7f8e0814e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:57.958 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.953+0000 7f8e0fb0b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e0815d3a0 0x7f8e080c5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:57.958 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.953+0000 7f8e0fb0b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e080c6bc0 con 0x7f8e0815d3a0 2024-08-17T02:25:57.958 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.953+0000 7f8e0fb0b700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e080c5fb0 con 0x7f8e0806e2f0 2024-08-17T02:25:57.958 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.953+0000 7f8e0fb0b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e080c6290 con 0x7f8e080c8dc0 2024-08-17T02:25:57.958 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.953+0000 7f8e0e0a8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e0815d3a0 0x7f8e080c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:57.958 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.953+0000 7f8e0d0a6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e080c8dc0 0x7f8e0814e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:57.958 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.953+0000 7f8e0d0a6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e080c8dc0 0x7f8e0814e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.153:39906/0 (socket says 172.21.15.153:39906) 2024-08-17T02:25:57.958 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.953+0000 7f8e0d0a6700 1 -- 172.21.15.153:0/1940986224 learned_addr learned my addr 172.21.15.153:0/1940986224 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:25:57.958 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.953+0000 7f8e0d8a7700 1 --2- 172.21.15.153:0/1940986224 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e0806e2f0 0x7f8e0814aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:57.959 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.953+0000 7f8e0d0a6700 1 -- 172.21.15.153:0/1940986224 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e0806e2f0 msgr2=0x7f8e0814aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:57.959 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.953+0000 7f8e0d0a6700 1 --2- 172.21.15.153:0/1940986224 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e0806e2f0 0x7f8e0814aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.959 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.953+0000 7f8e0d0a6700 1 -- 172.21.15.153:0/1940986224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e0815d3a0 msgr2=0x7f8e080c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:57.960 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.953+0000 7f8e0d0a6700 1 --2- 172.21.15.153:0/1940986224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e0815d3a0 0x7f8e080c5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.960 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.953+0000 7f8e0d0a6700 1 -- 172.21.15.153:0/1940986224 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e00009a20 con 0x7f8e080c8dc0 2024-08-17T02:25:57.960 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.957+0000 7f8e0d0a6700 1 --2- 172.21.15.153:0/1940986224 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e080c8dc0 0x7f8e0814e5c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8e000097c0 tx=0x7f8e00018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:57.960 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.957+0000 7f8dfdffb700 1 -- 172.21.15.153:0/1940986224 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e00023070 con 0x7f8e080c8dc0 2024-08-17T02:25:57.960 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.957+0000 7f8dfdffb700 1 -- 172.21.15.153:0/1940986224 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e00001090 con 0x7f8e080c8dc0 2024-08-17T02:25:57.960 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.957+0000 7f8e0fb0b700 1 -- 172.21.15.153:0/1940986224 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e080c6570 con 0x7f8e080c8dc0 2024-08-17T02:25:57.960 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.957+0000 7f8dfdffb700 1 -- 172.21.15.153:0/1940986224 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0001e680 con 0x7f8e080c8dc0 2024-08-17T02:25:57.960 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.957+0000 7f8e0fb0b700 1 -- 172.21.15.153:0/1940986224 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e080c8110 con 0x7f8e080c8dc0 2024-08-17T02:25:57.960 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.957+0000 7f8e0fb0b700 1 -- 172.21.15.153:0/1940986224 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e08064c10 con 0x7f8e080c8dc0 2024-08-17T02:25:57.961 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.957+0000 7f8dfdffb700 1 -- 172.21.15.153:0/1940986224 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 4) v1 ==== 80087+0+0 (secure 0 0 0) 0x7f8e0001ea70 con 0x7f8e080c8dc0 2024-08-17T02:25:57.962 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.957+0000 7f8dfdffb700 1 --2- 172.21.15.153:0/1940986224 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8dec060850 0x7f8dec062d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:57.962 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.957+0000 7f8dfdffb700 1 -- 172.21.15.153:0/1940986224 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2787+0+0 (secure 0 0 0) 0x7f8e0007ddc0 con 0x7f8e080c8dc0 2024-08-17T02:25:57.962 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.957+0000 7f8e0d8a7700 1 --2- 172.21.15.153:0/1940986224 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8dec060850 0x7f8dec062d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:57.963 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.961+0000 7f8e0d8a7700 1 --2- 172.21.15.153:0/1940986224 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8dec060850 0x7f8dec062d00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8df8007fd0 tx=0x7f8df8007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:57.969 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:57.965+0000 7f8dfdffb700 1 -- 172.21.15.153:0/1940986224 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f8e0004edb0 con 0x7f8e080c8dc0 2024-08-17T02:25:58.139 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:58.137+0000 7f8e0fb0b700 1 -- 172.21.15.153:0/1940986224 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e080cae20 con 0x7f8e080c8dc0 2024-08-17T02:25:58.140 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:58.137+0000 7f8dfdffb700 1 -- 172.21.15.153:0/1940986224 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7888 (secure 0 0 0) 0x7f8e0001be60 con 0x7f8e080c8dc0 2024-08-17T02:25:58.141 INFO:teuthology.misc.health.smithi153.stdout: 2024-08-17T02:25:58.141 INFO:teuthology.misc.health.smithi153.stdout:{"epoch":14,"fsid":"56d41c33-b929-456d-96be-2aac4ecd299d","created":"2024-08-17T02:25:47.756085+0000","modified":"2024-08-17T02:25:57.073509+0000","last_up_change":"2024-08-17T02:25:57.073509+0000","last_in_change":"2024-08-17T02:25:49.809186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"0736f8e6-818e-42e6-a0dc-8aaf813315d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":24234},{"type":"v1","addr":"172.21.15.153:6817","nonce":24234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":24234},{"type":"v1","addr":"172.21.15.153:6819","nonce":24234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":24234},{"type":"v1","addr":"172.21.15.153:6823","nonce":24234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":24234},{"type":"v1","addr":"172.21.15.153:6821","nonce":24234}]},"public_addr":"172.21.15.153:6817/24234","cluster_addr":"172.21.15.153:6819/24234","heartbeat_back_addr":"172.21.15.153:6823/24234","heartbeat_front_addr":"172.21.15.153:6821/24234","state":["exists","up"]},{"osd":1,"uuid":"011762e9-6c2d-441a-aa56-68474639d72f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b562cd97-aa12-455e-b46a-e720a2ec9d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":24235},{"type":"v1","addr":"172.21.15.153:6808","nonce":24235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":24235},{"type":"v1","addr":"172.21.15.153:6811","nonce":24235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":24235},{"type":"v1","addr":"172.21.15.153:6815","nonce":24235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":24235},{"type":"v1","addr":"172.21.15.153:6813","nonce":24235}]},"public_addr":"172.21.15.153:6808/24235","cluster_addr":"172.21.15.153:6811/24235","heartbeat_back_addr":"172.21.15.153:6815/24235","heartbeat_front_addr":"172.21.15.153:6813/24235","state":["exists","up"]},{"osd":3,"uuid":"222da52f-90c2-4132-a5d2-6f6cf83d4780","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a38a04cd-032b-4977-a260-1ef3567d0c46","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c7778084-e751-48da-87a1-ab8bbe85aa2d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2d8e0715-254f-442c-9625-50721d0bc858","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"dffda25a-4601-4ddb-9a27-b0be1cadde27","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:58.145 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:58.141+0000 7f8e0fb0b700 1 -- 172.21.15.153:0/1940986224 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8dec060850 msgr2=0x7f8dec062d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:58.145 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:58.141+0000 7f8e0fb0b700 1 --2- 172.21.15.153:0/1940986224 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8dec060850 0x7f8dec062d00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8df8007fd0 tx=0x7f8df8007d30 comp rx=0 tx=0).stop 2024-08-17T02:25:58.145 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:58.141+0000 7f8e0fb0b700 1 -- 172.21.15.153:0/1940986224 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e080c8dc0 msgr2=0x7f8e0814e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:58.145 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:58.141+0000 7f8e0fb0b700 1 --2- 172.21.15.153:0/1940986224 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e080c8dc0 0x7f8e0814e5c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8e000097c0 tx=0x7f8e00018000 comp rx=0 tx=0).stop 2024-08-17T02:25:58.145 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:58.141+0000 7f8e0fb0b700 1 -- 172.21.15.153:0/1940986224 shutdown_connections 2024-08-17T02:25:58.145 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:58.141+0000 7f8e0fb0b700 1 --2- 172.21.15.153:0/1940986224 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8dec060850 0x7f8dec062d00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.145 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:58.141+0000 7f8e0fb0b700 1 --2- 172.21.15.153:0/1940986224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e0815d3a0 0x7f8e080c5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.146 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:58.141+0000 7f8e0fb0b700 1 --2- 172.21.15.153:0/1940986224 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e080c8dc0 0x7f8e0814e5c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.146 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:58.141+0000 7f8e0fb0b700 1 --2- 172.21.15.153:0/1940986224 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e0806e2f0 0x7f8e0814aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.146 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:58.141+0000 7f8e0fb0b700 1 -- 172.21.15.153:0/1940986224 >> 172.21.15.153:0/1940986224 conn(0x7f8e080700f0 msgr2=0x7f8e08069610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:58.146 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:58.141+0000 7f8e0fb0b700 1 -- 172.21.15.153:0/1940986224 shutdown_connections 2024-08-17T02:25:58.146 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:25:58.141+0000 7f8e0fb0b700 1 -- 172.21.15.153:0/1940986224 wait complete. 2024-08-17T02:25:58.157 DEBUG:teuthology.misc:2 of 8 OSDs are up 2024-08-17T02:25:58.252 INFO:tasks.ceph.osd.5.smithi174.stderr:2024-08-17T02:25:58.247+0000 7fb257653700 -1 osd.5 0 waiting for initial osdmap 2024-08-17T02:25:58.258 INFO:tasks.ceph.osd.5.smithi174.stderr:2024-08-17T02:25:58.255+0000 7fb2503f6700 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:25:58.292 INFO:tasks.ceph.osd.7.smithi174.stderr:2024-08-17T02:25:58.287+0000 7f06c8700700 -1 osd.7 0 waiting for initial osdmap 2024-08-17T02:25:58.298 INFO:tasks.ceph.osd.7.smithi174.stderr:2024-08-17T02:25:58.295+0000 7f06c14a3700 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:25:58.306 INFO:tasks.ceph.osd.4.smithi174.stderr:2024-08-17T02:25:58.303+0000 7f22f5b4f700 -1 osd.4 0 waiting for initial osdmap 2024-08-17T02:25:58.310 INFO:tasks.ceph.osd.4.smithi174.stderr:2024-08-17T02:25:58.307+0000 7f22ee8f2700 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:25:58.340 INFO:tasks.ceph.osd.6.smithi174.stderr:2024-08-17T02:25:58.335+0000 7fad86439700 -1 osd.6 0 waiting for initial osdmap 2024-08-17T02:25:58.345 INFO:tasks.ceph.osd.6.smithi174.stderr:2024-08-17T02:25:58.343+0000 7fad7d9b7700 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:25:59.226 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:59.229 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:04.965 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:05.071 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.069+0000 7f1b83205700 1 Processor -- start 2024-08-17T02:26:05.071 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.069+0000 7f1b83205700 1 -- start start 2024-08-17T02:26:05.072 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.069+0000 7f1b83205700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1b7c158090 0x7f1b7c0add10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.072 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.069+0000 7f1b83205700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b7c0cbba0 con 0x7f1b7c0ae250 2024-08-17T02:26:05.072 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.069+0000 7f1b83205700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b7c0cade0 con 0x7f1b7c15b650 2024-08-17T02:26:05.072 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.069+0000 7f1b83205700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b7c15bad0 con 0x7f1b7c158090 2024-08-17T02:26:05.072 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.069+0000 7f1b82203700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1b7c158090 0x7f1b7c0add10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.072 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.069+0000 7f1b82203700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1b7c158090 0x7f1b7c0add10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33142/0 (socket says 172.21.15.153:33142) 2024-08-17T02:26:05.072 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.069+0000 7f1b82203700 1 -- 172.21.15.153:0/994686958 learned_addr learned my addr 172.21.15.153:0/994686958 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:05.073 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.069+0000 7f1b82203700 1 -- 172.21.15.153:0/994686958 >> v1:172.21.15.174:6789/0 conn(0x7f1b7c15b650 legacy=0x7f1b7c0af6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:05.074 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.069+0000 7f1b82203700 1 -- 172.21.15.153:0/994686958 >> v1:172.21.15.153:6789/0 conn(0x7f1b7c0ae250 legacy=0x7f1b7c15af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.074 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.069+0000 7f1b81201700 1 -- 172.21.15.153:0/994686958 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1414071451 0 0) 0x7f1b7c0cbba0 con 0x7f1b7c0ae250 2024-08-17T02:26:05.074 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.069+0000 7f1b82203700 1 -- 172.21.15.153:0/994686958 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b7c0cb0c0 con 0x7f1b7c158090 2024-08-17T02:26:05.074 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.069+0000 7f1b82203700 1 --2- 172.21.15.153:0/994686958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b7c158090 0x7f1b7c0add10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1b780099b0 tx=0x7f1b78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13f097a96127e99a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.074 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.069+0000 7f1b81201700 1 -- 172.21.15.153:0/994686958 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7800b860 con 0x7f1b7c158090 2024-08-17T02:26:05.074 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.069+0000 7f1b81201700 1 -- 172.21.15.153:0/994686958 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7800b9c0 con 0x7f1b7c158090 2024-08-17T02:26:05.074 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.069+0000 7f1b81201700 1 -- 172.21.15.153:0/994686958 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7800bd80 con 0x7f1b7c158090 2024-08-17T02:26:05.075 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.069+0000 7f1b83205700 1 -- 172.21.15.153:0/994686958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b7c158090 msgr2=0x7f1b7c0add10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.075 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.069+0000 7f1b83205700 1 --2- 172.21.15.153:0/994686958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b7c158090 0x7f1b7c0add10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1b780099b0 tx=0x7f1b78009250 comp rx=0 tx=0).stop 2024-08-17T02:26:05.075 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.073+0000 7f1b83205700 1 -- 172.21.15.153:0/994686958 shutdown_connections 2024-08-17T02:26:05.075 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.073+0000 7f1b83205700 1 --2- 172.21.15.153:0/994686958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b7c158090 0x7f1b7c0add10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.075 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.073+0000 7f1b83205700 1 -- 172.21.15.153:0/994686958 >> 172.21.15.153:0/994686958 conn(0x7f1b7c066e10 msgr2=0x7f1b7c0700f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:05.075 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.073+0000 7f1b83205700 1 -- 172.21.15.153:0/994686958 shutdown_connections 2024-08-17T02:26:05.075 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.073+0000 7f1b83205700 1 -- 172.21.15.153:0/994686958 wait complete. 2024-08-17T02:26:05.076 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.073+0000 7f1b83205700 1 Processor -- start 2024-08-17T02:26:05.076 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.073+0000 7f1b83205700 1 -- start start 2024-08-17T02:26:05.078 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.073+0000 7f1b83205700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b7c0ae250 0x7f1b7c13ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.079 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.073+0000 7f1b83205700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b7c158090 0x7f1b7c0a7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.079 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.073+0000 7f1b83205700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b7c15b650 0x7f1b7c0a8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.079 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.073+0000 7f1b83205700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7c1542a0 con 0x7f1b7c158090 2024-08-17T02:26:05.079 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.073+0000 7f1b83205700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7c0aad70 con 0x7f1b7c15b650 2024-08-17T02:26:05.079 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.073+0000 7f1b83205700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7c0ab050 con 0x7f1b7c0ae250 2024-08-17T02:26:05.079 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.073+0000 7f1b81a02700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b7c158090 0x7f1b7c0a7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.079 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.073+0000 7f1b81a02700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b7c158090 0x7f1b7c0a7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33148/0 (socket says 172.21.15.153:33148) 2024-08-17T02:26:05.079 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.073+0000 7f1b82203700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b7c0ae250 0x7f1b7c13ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.079 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.073+0000 7f1b81a02700 1 -- 172.21.15.153:0/249046937 learned_addr learned my addr 172.21.15.153:0/249046937 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:05.079 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.073+0000 7f1b82a04700 1 --2- 172.21.15.153:0/249046937 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b7c15b650 0x7f1b7c0a8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.079 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.077+0000 7f1b81a02700 1 -- 172.21.15.153:0/249046937 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b7c0ae250 msgr2=0x7f1b7c13ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.079 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.077+0000 7f1b81a02700 1 --2- 172.21.15.153:0/249046937 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b7c0ae250 0x7f1b7c13ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.079 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.077+0000 7f1b81a02700 1 -- 172.21.15.153:0/249046937 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b7c15b650 msgr2=0x7f1b7c0a8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.080 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.077+0000 7f1b81a02700 1 --2- 172.21.15.153:0/249046937 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b7c15b650 0x7f1b7c0a8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.080 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.077+0000 7f1b81a02700 1 -- 172.21.15.153:0/249046937 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b780094f0 con 0x7f1b7c158090 2024-08-17T02:26:05.080 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.077+0000 7f1b82a04700 1 --2- 172.21.15.153:0/249046937 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b7c15b650 0x7f1b7c0a8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:05.080 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.077+0000 7f1b81a02700 1 --2- 172.21.15.153:0/249046937 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b7c158090 0x7f1b7c0a7d50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c00c7e0 tx=0x7f1b6c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.081 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.077+0000 7f1b727fc700 1 -- 172.21.15.153:0/249046937 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c011590 con 0x7f1b7c158090 2024-08-17T02:26:05.081 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.077+0000 7f1b727fc700 1 -- 172.21.15.153:0/249046937 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b6c011710 con 0x7f1b7c158090 2024-08-17T02:26:05.081 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.077+0000 7f1b83205700 1 -- 172.21.15.153:0/249046937 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b7c0ab330 con 0x7f1b7c158090 2024-08-17T02:26:05.081 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.077+0000 7f1b727fc700 1 -- 172.21.15.153:0/249046937 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c011ad0 con 0x7f1b7c158090 2024-08-17T02:26:05.081 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.077+0000 7f1b83205700 1 -- 172.21.15.153:0/249046937 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b7c0a9fd0 con 0x7f1b7c158090 2024-08-17T02:26:05.081 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.077+0000 7f1b83205700 1 -- 172.21.15.153:0/249046937 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b7c154450 con 0x7f1b7c158090 2024-08-17T02:26:05.081 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.077+0000 7f1b727fc700 1 -- 172.21.15.153:0/249046937 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1b6c01b3b0 con 0x7f1b7c158090 2024-08-17T02:26:05.082 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.077+0000 7f1b727fc700 1 --2- 172.21.15.153:0/249046937 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1b60060860 0x7f1b60062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.082 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.077+0000 7f1b82203700 1 --2- 172.21.15.153:0/249046937 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1b60060860 0x7f1b60062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.082 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.081+0000 7f1b727fc700 1 -- 172.21.15.153:0/249046937 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1b6c07bdb0 con 0x7f1b7c158090 2024-08-17T02:26:05.083 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.081+0000 7f1b82203700 1 --2- 172.21.15.153:0/249046937 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1b60060860 0x7f1b60062d10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1b780099b0 tx=0x7f1b78017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.089 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.085+0000 7f1b727fc700 1 -- 172.21.15.153:0/249046937 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1b7c154450 con 0x7f1b7c158090 2024-08-17T02:26:05.255 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.253+0000 7f1b83205700 1 -- 172.21.15.153:0/249046937 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b7c064ba0 con 0x7f1b7c158090 2024-08-17T02:26:05.257 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.253+0000 7f1b727fc700 1 -- 172.21.15.153:0/249046937 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12175 (secure 0 0 0) 0x7f1b6c017020 con 0x7f1b7c158090 2024-08-17T02:26:05.257 INFO:teuthology.misc.health.smithi153.stdout: 2024-08-17T02:26:05.257 INFO:teuthology.misc.health.smithi153.stdout:{"epoch":17,"fsid":"56d41c33-b929-456d-96be-2aac4ecd299d","created":"2024-08-17T02:25:47.756085+0000","modified":"2024-08-17T02:26:00.650916+0000","last_up_change":"2024-08-17T02:25:58.643690+0000","last_in_change":"2024-08-17T02:25:49.809186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:58.093273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"0736f8e6-818e-42e6-a0dc-8aaf813315d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":24234},{"type":"v1","addr":"172.21.15.153:6817","nonce":24234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":24234},{"type":"v1","addr":"172.21.15.153:6819","nonce":24234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":24234},{"type":"v1","addr":"172.21.15.153:6823","nonce":24234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":24234},{"type":"v1","addr":"172.21.15.153:6821","nonce":24234}]},"public_addr":"172.21.15.153:6817/24234","cluster_addr":"172.21.15.153:6819/24234","heartbeat_back_addr":"172.21.15.153:6823/24234","heartbeat_front_addr":"172.21.15.153:6821/24234","state":["exists","up"]},{"osd":1,"uuid":"011762e9-6c2d-441a-aa56-68474639d72f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":24232},{"type":"v1","addr":"172.21.15.153:6801","nonce":24232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":24232},{"type":"v1","addr":"172.21.15.153:6803","nonce":24232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":24232},{"type":"v1","addr":"172.21.15.153:6809","nonce":24232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":24232},{"type":"v1","addr":"172.21.15.153:6806","nonce":24232}]},"public_addr":"172.21.15.153:6801/24232","cluster_addr":"172.21.15.153:6803/24232","heartbeat_back_addr":"172.21.15.153:6809/24232","heartbeat_front_addr":"172.21.15.153:6806/24232","state":["exists","up"]},{"osd":2,"uuid":"b562cd97-aa12-455e-b46a-e720a2ec9d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":24235},{"type":"v1","addr":"172.21.15.153:6808","nonce":24235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":24235},{"type":"v1","addr":"172.21.15.153:6811","nonce":24235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":24235},{"type":"v1","addr":"172.21.15.153:6815","nonce":24235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":24235},{"type":"v1","addr":"172.21.15.153:6813","nonce":24235}]},"public_addr":"172.21.15.153:6808/24235","cluster_addr":"172.21.15.153:6811/24235","heartbeat_back_addr":"172.21.15.153:6815/24235","heartbeat_front_addr":"172.21.15.153:6813/24235","state":["exists","up"]},{"osd":3,"uuid":"222da52f-90c2-4132-a5d2-6f6cf83d4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":24236},{"type":"v1","addr":"172.21.15.153:6825","nonce":24236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":24236},{"type":"v1","addr":"172.21.15.153:6827","nonce":24236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":24236},{"type":"v1","addr":"172.21.15.153:6831","nonce":24236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":24236},{"type":"v1","addr":"172.21.15.153:6829","nonce":24236}]},"public_addr":"172.21.15.153:6825/24236","cluster_addr":"172.21.15.153:6827/24236","heartbeat_back_addr":"172.21.15.153:6831/24236","heartbeat_front_addr":"172.21.15.153:6829/24236","state":["exists","up"]},{"osd":4,"uuid":"a38a04cd-032b-4977-a260-1ef3567d0c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24456},{"type":"v1","addr":"172.21.15.174:6809","nonce":24456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24456},{"type":"v1","addr":"172.21.15.174:6811","nonce":24456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24456},{"type":"v1","addr":"172.21.15.174:6815","nonce":24456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24456},{"type":"v1","addr":"172.21.15.174:6813","nonce":24456}]},"public_addr":"172.21.15.174:6809/24456","cluster_addr":"172.21.15.174:6811/24456","heartbeat_back_addr":"172.21.15.174:6815/24456","heartbeat_front_addr":"172.21.15.174:6813/24456","state":["exists","up"]},{"osd":5,"uuid":"c7778084-e751-48da-87a1-ab8bbe85aa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24457},{"type":"v1","addr":"172.21.15.174:6825","nonce":24457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24457},{"type":"v1","addr":"172.21.15.174:6827","nonce":24457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24457},{"type":"v1","addr":"172.21.15.174:6831","nonce":24457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24457},{"type":"v1","addr":"172.21.15.174:6829","nonce":24457}]},"public_addr":"172.21.15.174:6825/24457","cluster_addr":"172.21.15.174:6827/24457","heartbeat_back_addr":"172.21.15.174:6831/24457","heartbeat_front_addr":"172.21.15.174:6829/24457","state":["exists","up"]},{"osd":6,"uuid":"2d8e0715-254f-442c-9625-50721d0bc858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24477},{"type":"v1","addr":"172.21.15.174:6801","nonce":24477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24477},{"type":"v1","addr":"172.21.15.174:6803","nonce":24477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24477},{"type":"v1","addr":"172.21.15.174:6807","nonce":24477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24477},{"type":"v1","addr":"172.21.15.174:6805","nonce":24477}]},"public_addr":"172.21.15.174:6801/24477","cluster_addr":"172.21.15.174:6803/24477","heartbeat_back_addr":"172.21.15.174:6807/24477","heartbeat_front_addr":"172.21.15.174:6805/24477","state":["exists","up"]},{"osd":7,"uuid":"dffda25a-4601-4ddb-9a27-b0be1cadde27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24455},{"type":"v1","addr":"172.21.15.174:6817","nonce":24455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24455},{"type":"v1","addr":"172.21.15.174:6819","nonce":24455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24455},{"type":"v1","addr":"172.21.15.174:6823","nonce":24455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24455},{"type":"v1","addr":"172.21.15.174:6821","nonce":24455}]},"public_addr":"172.21.15.174:6817/24455","cluster_addr":"172.21.15.174:6819/24455","heartbeat_back_addr":"172.21.15.174:6823/24455","heartbeat_front_addr":"172.21.15.174:6821/24455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.990117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.033862+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.748087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.112877+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.070448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.360961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.110940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.226377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:05.259 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.257+0000 7f1b83205700 1 -- 172.21.15.153:0/249046937 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1b60060860 msgr2=0x7f1b60062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.259 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.257+0000 7f1b83205700 1 --2- 172.21.15.153:0/249046937 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1b60060860 0x7f1b60062d10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1b780099b0 tx=0x7f1b78017000 comp rx=0 tx=0).stop 2024-08-17T02:26:05.259 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.257+0000 7f1b83205700 1 -- 172.21.15.153:0/249046937 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b7c158090 msgr2=0x7f1b7c0a7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.260 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.257+0000 7f1b83205700 1 --2- 172.21.15.153:0/249046937 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b7c158090 0x7f1b7c0a7d50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c00c7e0 tx=0x7f1b6c007df0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.260 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.257+0000 7f1b83205700 1 -- 172.21.15.153:0/249046937 shutdown_connections 2024-08-17T02:26:05.260 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.257+0000 7f1b83205700 1 --2- 172.21.15.153:0/249046937 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1b60060860 0x7f1b60062d10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.260 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.257+0000 7f1b83205700 1 --2- 172.21.15.153:0/249046937 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b7c15b650 0x7f1b7c0a8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.260 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.257+0000 7f1b83205700 1 --2- 172.21.15.153:0/249046937 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b7c158090 0x7f1b7c0a7d50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.260 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.257+0000 7f1b83205700 1 --2- 172.21.15.153:0/249046937 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b7c0ae250 0x7f1b7c13ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.260 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.257+0000 7f1b83205700 1 -- 172.21.15.153:0/249046937 >> 172.21.15.153:0/249046937 conn(0x7f1b7c066e10 msgr2=0x7f1b7c0b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:05.260 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.257+0000 7f1b83205700 1 -- 172.21.15.153:0/249046937 shutdown_connections 2024-08-17T02:26:05.260 INFO:teuthology.misc.health.smithi153.stderr:2024-08-17T02:26:05.257+0000 7f1b83205700 1 -- 172.21.15.153:0/249046937 wait complete. 2024-08-17T02:26:05.270 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-08-17T02:26:05.271 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-08-17T02:26:05.271 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:26:05.271 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:26:05.274 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:26:05.274 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:26:05.274 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:26:05.276 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:26:05.276 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:26:05.276 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:26:05.279 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:26:05.279 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:26:05.279 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:26:05.281 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:26:05.281 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-08-17T02:26:05.282 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:05.339 INFO:tasks.ceph.mds.c.smithi153.stdout:starting mds.c at 2024-08-17T02:26:05.344 INFO:tasks.ceph.mds.a.smithi153.stdout:starting mds.a at 2024-08-17T02:26:05.369 INFO:tasks.ceph.mds.d.smithi174.stdout:starting mds.d at 2024-08-17T02:26:05.374 INFO:tasks.ceph.mds.b.smithi174.stdout:starting mds.b at 2024-08-17T02:26:05.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.377+0000 7f9841222700 1 Processor -- start 2024-08-17T02:26:05.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.377+0000 7f9841222700 1 -- start start 2024-08-17T02:26:05.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.377+0000 7f9841222700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f983c15d540 0x7f983c0af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.377+0000 7f9841222700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f983c0a9430 0x7f983c0b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.377+0000 7f9841222700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f983c0b0270 con 0x7f983c06e830 2024-08-17T02:26:05.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.377+0000 7f9841222700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f983c0af660 con 0x7f983c0a9430 2024-08-17T02:26:05.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.377+0000 7f9841222700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f983c0af940 con 0x7f983c15d540 2024-08-17T02:26:05.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.377+0000 7f983ad9d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f983c15d540 0x7f983c0af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.377+0000 7f983ad9d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f983c15d540 0x7f983c0af030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.153:38612/0 (socket says 172.21.15.153:38612) 2024-08-17T02:26:05.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.377+0000 7f983ad9d700 1 -- 172.21.15.153:0/1747023830 learned_addr learned my addr 172.21.15.153:0/1747023830 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:05.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.377+0000 7f983b59e700 1 --2- 172.21.15.153:0/1747023830 >> v2:172.21.15.174:3300/0 conn(0x7f983c0a9430 0x7f983c0b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.377+0000 7f983ad9d700 1 -- 172.21.15.153:0/1747023830 >> v2:172.21.15.174:3300/0 conn(0x7f983c0a9430 msgr2=0x7f983c0b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:05.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.377+0000 7f983ad9d700 1 --2- 172.21.15.153:0/1747023830 >> v2:172.21.15.174:3300/0 conn(0x7f983c0a9430 0x7f983c0b0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.377+0000 7f983ad9d700 1 -- 172.21.15.153:0/1747023830 >> v1:172.21.15.153:6789/0 conn(0x7f983c06e830 legacy=0x7f983c0a8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.377+0000 7f983ad9d700 1 -- 172.21.15.153:0/1747023830 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f983c0afc20 con 0x7f983c15d540 2024-08-17T02:26:05.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.377+0000 7f983b59e700 1 --2- 172.21.15.153:0/1747023830 >> v2:172.21.15.174:3300/0 conn(0x7f983c0a9430 0x7f983c0b0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:05.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.377+0000 7f983ad9d700 1 --2- 172.21.15.153:0/1747023830 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f983c15d540 0x7f983c0af030 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f982c0099b0 tx=0x7f982c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e506eb943e9091d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.377+0000 7f983a59c700 1 -- 172.21.15.153:0/1747023830 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982c00b860 con 0x7f983c15d540 2024-08-17T02:26:05.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.377+0000 7f983a59c700 1 -- 172.21.15.153:0/1747023830 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982c00b9c0 con 0x7f983c15d540 2024-08-17T02:26:05.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.377+0000 7f983a59c700 1 -- 172.21.15.153:0/1747023830 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982c00bd60 con 0x7f983c15d540 2024-08-17T02:26:05.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.381+0000 7f9841222700 1 -- 172.21.15.153:0/1747023830 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f983c15d540 msgr2=0x7f983c0af030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.381+0000 7f9841222700 1 --2- 172.21.15.153:0/1747023830 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f983c15d540 0x7f983c0af030 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f982c0099b0 tx=0x7f982c009250 comp rx=0 tx=0).stop 2024-08-17T02:26:05.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.381+0000 7f9841222700 1 -- 172.21.15.153:0/1747023830 shutdown_connections 2024-08-17T02:26:05.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.381+0000 7f9841222700 1 --2- 172.21.15.153:0/1747023830 >> v2:172.21.15.174:3300/0 conn(0x7f983c0a9430 0x7f983c0b0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.381+0000 7f9841222700 1 --2- 172.21.15.153:0/1747023830 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f983c15d540 0x7f983c0af030 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.381+0000 7f9841222700 1 -- 172.21.15.153:0/1747023830 >> 172.21.15.153:0/1747023830 conn(0x7f983c066e00 msgr2=0x7f983c067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:05.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.381+0000 7f9841222700 1 -- 172.21.15.153:0/1747023830 shutdown_connections 2024-08-17T02:26:05.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.381+0000 7f9841222700 1 -- 172.21.15.153:0/1747023830 wait complete. 2024-08-17T02:26:05.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.381+0000 7f9841222700 1 Processor -- start 2024-08-17T02:26:05.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.381+0000 7f9841222700 1 -- start start 2024-08-17T02:26:05.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.385+0000 7f9841222700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f983c06e830 0x7f983c145020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.385+0000 7f9841222700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f983c0a9430 0x7f983c0ab590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.385+0000 7f9841222700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f983c15d540 0x7f983c0c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.385+0000 7f9841222700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983c0cab00 con 0x7f983c06e830 2024-08-17T02:26:05.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.385+0000 7f9841222700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983c0cade0 con 0x7f983c15d540 2024-08-17T02:26:05.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.385+0000 7f9841222700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f983c0cb0c0 con 0x7f983c0a9430 2024-08-17T02:26:05.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.385+0000 7f983ad9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f983c06e830 0x7f983c145020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.385+0000 7f983ad9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f983c06e830 0x7f983c145020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33182/0 (socket says 172.21.15.153:33182) 2024-08-17T02:26:05.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.385+0000 7f983ad9d700 1 -- 172.21.15.153:0/3565496531 learned_addr learned my addr 172.21.15.153:0/3565496531 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:05.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.385+0000 7f9833fff700 1 --2- 172.21.15.153:0/3565496531 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f983c0a9430 0x7f983c0ab590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.385+0000 7f983b59e700 1 --2- 172.21.15.153:0/3565496531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f983c15d540 0x7f983c0c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.385+0000 7f983ad9d700 1 -- 172.21.15.153:0/3565496531 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f983c0a9430 msgr2=0x7f983c0ab590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.385+0000 7f983ad9d700 1 --2- 172.21.15.153:0/3565496531 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f983c0a9430 0x7f983c0ab590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.385+0000 7f983ad9d700 1 -- 172.21.15.153:0/3565496531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f983c15d540 msgr2=0x7f983c0c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.385+0000 7f983ad9d700 1 --2- 172.21.15.153:0/3565496531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f983c15d540 0x7f983c0c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.385+0000 7f983ad9d700 1 -- 172.21.15.153:0/3565496531 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f982c0094f0 con 0x7f983c06e830 2024-08-17T02:26:05.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.385+0000 7f9833fff700 1 --2- 172.21.15.153:0/3565496531 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f983c0a9430 0x7f983c0ab590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:05.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.385+0000 7f983ad9d700 1 --2- 172.21.15.153:0/3565496531 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f983c06e830 0x7f983c145020 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f982c009290 tx=0x7f982c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.385+0000 7f9832ffd700 1 -- 172.21.15.153:0/3565496531 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982c011e00 con 0x7f983c06e830 2024-08-17T02:26:05.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.385+0000 7f9832ffd700 1 -- 172.21.15.153:0/3565496531 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982c01a450 con 0x7f983c06e830 2024-08-17T02:26:05.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.385+0000 7f9841222700 1 -- 172.21.15.153:0/3565496531 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f983c0cb3a0 con 0x7f983c06e830 2024-08-17T02:26:05.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.385+0000 7f9832ffd700 1 -- 172.21.15.153:0/3565496531 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982c01a810 con 0x7f983c06e830 2024-08-17T02:26:05.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.385+0000 7f9841222700 1 -- 172.21.15.153:0/3565496531 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f983c0abad0 con 0x7f983c06e830 2024-08-17T02:26:05.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.385+0000 7f9841222700 1 -- 172.21.15.153:0/3565496531 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f983c0645c0 con 0x7f983c06e830 2024-08-17T02:26:05.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.385+0000 7f9832ffd700 1 -- 172.21.15.153:0/3565496531 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f982c01abc0 con 0x7f983c06e830 2024-08-17T02:26:05.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.389+0000 7f9832ffd700 1 --2- 172.21.15.153:0/3565496531 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f981c060860 0x7f981c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.389+0000 7f9833fff700 1 --2- 172.21.15.153:0/3565496531 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f981c060860 0x7f981c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.389+0000 7f9832ffd700 1 -- 172.21.15.153:0/3565496531 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f982c07dda0 con 0x7f983c06e830 2024-08-17T02:26:05.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.389+0000 7f9833fff700 1 --2- 172.21.15.153:0/3565496531 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f981c060860 0x7f981c062d10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f983c0cb850 tx=0x7f9824009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.397+0000 7f9832ffd700 1 -- 172.21.15.153:0/3565496531 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f982c04e4a0 con 0x7f983c06e830 2024-08-17T02:26:05.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.561+0000 7f9841222700 1 -- 172.21.15.153:0/3565496531 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f983c06f360 con 0x7f983c06e830 2024-08-17T02:26:05.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.565+0000 7f9832ffd700 1 -- 172.21.15.153:0/3565496531 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12175 (secure 0 0 0) 0x7f982c015090 con 0x7f983c06e830 2024-08-17T02:26:05.566 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:05.567 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":17,"fsid":"56d41c33-b929-456d-96be-2aac4ecd299d","created":"2024-08-17T02:25:47.756085+0000","modified":"2024-08-17T02:26:00.650916+0000","last_up_change":"2024-08-17T02:25:58.643690+0000","last_in_change":"2024-08-17T02:25:49.809186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:58.093273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"0736f8e6-818e-42e6-a0dc-8aaf813315d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":24234},{"type":"v1","addr":"172.21.15.153:6817","nonce":24234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":24234},{"type":"v1","addr":"172.21.15.153:6819","nonce":24234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":24234},{"type":"v1","addr":"172.21.15.153:6823","nonce":24234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":24234},{"type":"v1","addr":"172.21.15.153:6821","nonce":24234}]},"public_addr":"172.21.15.153:6817/24234","cluster_addr":"172.21.15.153:6819/24234","heartbeat_back_addr":"172.21.15.153:6823/24234","heartbeat_front_addr":"172.21.15.153:6821/24234","state":["exists","up"]},{"osd":1,"uuid":"011762e9-6c2d-441a-aa56-68474639d72f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":24232},{"type":"v1","addr":"172.21.15.153:6801","nonce":24232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":24232},{"type":"v1","addr":"172.21.15.153:6803","nonce":24232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":24232},{"type":"v1","addr":"172.21.15.153:6809","nonce":24232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":24232},{"type":"v1","addr":"172.21.15.153:6806","nonce":24232}]},"public_addr":"172.21.15.153:6801/24232","cluster_addr":"172.21.15.153:6803/24232","heartbeat_back_addr":"172.21.15.153:6809/24232","heartbeat_front_addr":"172.21.15.153:6806/24232","state":["exists","up"]},{"osd":2,"uuid":"b562cd97-aa12-455e-b46a-e720a2ec9d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":24235},{"type":"v1","addr":"172.21.15.153:6808","nonce":24235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":24235},{"type":"v1","addr":"172.21.15.153:6811","nonce":24235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":24235},{"type":"v1","addr":"172.21.15.153:6815","nonce":24235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":24235},{"type":"v1","addr":"172.21.15.153:6813","nonce":24235}]},"public_addr":"172.21.15.153:6808/24235","cluster_addr":"172.21.15.153:6811/24235","heartbeat_back_addr":"172.21.15.153:6815/24235","heartbeat_front_addr":"172.21.15.153:6813/24235","state":["exists","up"]},{"osd":3,"uuid":"222da52f-90c2-4132-a5d2-6f6cf83d4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":24236},{"type":"v1","addr":"172.21.15.153:6825","nonce":24236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":24236},{"type":"v1","addr":"172.21.15.153:6827","nonce":24236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":24236},{"type":"v1","addr":"172.21.15.153:6831","nonce":24236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":24236},{"type":"v1","addr":"172.21.15.153:6829","nonce":24236}]},"public_addr":"172.21.15.153:6825/24236","cluster_addr":"172.21.15.153:6827/24236","heartbeat_back_addr":"172.21.15.153:6831/24236","heartbeat_front_addr":"172.21.15.153:6829/24236","state":["exists","up"]},{"osd":4,"uuid":"a38a04cd-032b-4977-a260-1ef3567d0c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24456},{"type":"v1","addr":"172.21.15.174:6809","nonce":24456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24456},{"type":"v1","addr":"172.21.15.174:6811","nonce":24456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24456},{"type":"v1","addr":"172.21.15.174:6815","nonce":24456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24456},{"type":"v1","addr":"172.21.15.174:6813","nonce":24456}]},"public_addr":"172.21.15.174:6809/24456","cluster_addr":"172.21.15.174:6811/24456","heartbeat_back_addr":"172.21.15.174:6815/24456","heartbeat_front_addr":"172.21.15.174:6813/24456","state":["exists","up"]},{"osd":5,"uuid":"c7778084-e751-48da-87a1-ab8bbe85aa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24457},{"type":"v1","addr":"172.21.15.174:6825","nonce":24457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24457},{"type":"v1","addr":"172.21.15.174:6827","nonce":24457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24457},{"type":"v1","addr":"172.21.15.174:6831","nonce":24457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24457},{"type":"v1","addr":"172.21.15.174:6829","nonce":24457}]},"public_addr":"172.21.15.174:6825/24457","cluster_addr":"172.21.15.174:6827/24457","heartbeat_back_addr":"172.21.15.174:6831/24457","heartbeat_front_addr":"172.21.15.174:6829/24457","state":["exists","up"]},{"osd":6,"uuid":"2d8e0715-254f-442c-9625-50721d0bc858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24477},{"type":"v1","addr":"172.21.15.174:6801","nonce":24477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24477},{"type":"v1","addr":"172.21.15.174:6803","nonce":24477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24477},{"type":"v1","addr":"172.21.15.174:6807","nonce":24477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24477},{"type":"v1","addr":"172.21.15.174:6805","nonce":24477}]},"public_addr":"172.21.15.174:6801/24477","cluster_addr":"172.21.15.174:6803/24477","heartbeat_back_addr":"172.21.15.174:6807/24477","heartbeat_front_addr":"172.21.15.174:6805/24477","state":["exists","up"]},{"osd":7,"uuid":"dffda25a-4601-4ddb-9a27-b0be1cadde27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24455},{"type":"v1","addr":"172.21.15.174:6817","nonce":24455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24455},{"type":"v1","addr":"172.21.15.174:6819","nonce":24455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24455},{"type":"v1","addr":"172.21.15.174:6823","nonce":24455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24455},{"type":"v1","addr":"172.21.15.174:6821","nonce":24455}]},"public_addr":"172.21.15.174:6817/24455","cluster_addr":"172.21.15.174:6819/24455","heartbeat_back_addr":"172.21.15.174:6823/24455","heartbeat_front_addr":"172.21.15.174:6821/24455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.990117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.033862+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.748087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.112877+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.070448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.360961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.110940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.226377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:05.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.565+0000 7f9841222700 1 -- 172.21.15.153:0/3565496531 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f981c060860 msgr2=0x7f981c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.565+0000 7f9841222700 1 --2- 172.21.15.153:0/3565496531 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f981c060860 0x7f981c062d10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f983c0cb850 tx=0x7f9824009040 comp rx=0 tx=0).stop 2024-08-17T02:26:05.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.565+0000 7f9841222700 1 -- 172.21.15.153:0/3565496531 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f983c06e830 msgr2=0x7f983c145020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.565+0000 7f9841222700 1 --2- 172.21.15.153:0/3565496531 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f983c06e830 0x7f983c145020 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f982c009290 tx=0x7f982c017000 comp rx=0 tx=0).stop 2024-08-17T02:26:05.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.565+0000 7f9841222700 1 -- 172.21.15.153:0/3565496531 shutdown_connections 2024-08-17T02:26:05.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.565+0000 7f9841222700 1 --2- 172.21.15.153:0/3565496531 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f981c060860 0x7f981c062d10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.565+0000 7f9841222700 1 --2- 172.21.15.153:0/3565496531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f983c15d540 0x7f983c0c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.565+0000 7f9841222700 1 --2- 172.21.15.153:0/3565496531 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f983c0a9430 0x7f983c0ab590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.565+0000 7f9841222700 1 --2- 172.21.15.153:0/3565496531 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f983c06e830 0x7f983c145020 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.565+0000 7f9841222700 1 -- 172.21.15.153:0/3565496531 >> 172.21.15.153:0/3565496531 conn(0x7f983c066e00 msgr2=0x7f983c15a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:05.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.565+0000 7f9841222700 1 -- 172.21.15.153:0/3565496531 shutdown_connections 2024-08-17T02:26:05.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.565+0000 7f9841222700 1 -- 172.21.15.153:0/3565496531 wait complete. 2024-08-17T02:26:05.587 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:58.093273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:26:05.587 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:05.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.693+0000 7f35a34ec700 1 Processor -- start 2024-08-17T02:26:05.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.693+0000 7f35a34ec700 1 -- start start 2024-08-17T02:26:05.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.697+0000 7f35a34ec700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f359c159300 0x7f359c0b2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.697+0000 7f35a34ec700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f359c1596d0 0x7f359c066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.697+0000 7f35a34ec700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f359c0cba90 con 0x7f359c15dbc0 2024-08-17T02:26:05.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.697+0000 7f35a34ec700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f359c0b2b60 con 0x7f359c159300 2024-08-17T02:26:05.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.697+0000 7f35a34ec700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359c0cb160 con 0x7f359c1596d0 2024-08-17T02:26:05.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.697+0000 7f35a1a89700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f359c15dbc0 0x7f359c0afe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:40408/0 (socket says 172.21.15.153:40408) 2024-08-17T02:26:05.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.697+0000 7f35a1a89700 1 -- 172.21.15.153:0/3775396721 learned_addr learned my addr 172.21.15.153:0/3775396721 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:05.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.697+0000 7f35a0a87700 1 --2- 172.21.15.153:0/3775396721 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f359c1596d0 0x7f359c066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.697+0000 7f35a1288700 1 --2- 172.21.15.153:0/3775396721 >> v2:172.21.15.174:3300/0 conn(0x7f359c159300 0x7f359c0b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.697+0000 7f3593fff700 1 -- 172.21.15.153:0/3775396721 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3368683810 0 0) 0x7f359c0cba90 con 0x7f359c15dbc0 2024-08-17T02:26:05.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.697+0000 7f3593fff700 1 -- 172.21.15.153:0/3775396721 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3588003570 con 0x7f359c15dbc0 2024-08-17T02:26:05.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.697+0000 7f35a0a87700 1 -- 172.21.15.153:0/3775396721 >> v2:172.21.15.174:3300/0 conn(0x7f359c159300 msgr2=0x7f359c0b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:05.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.697+0000 7f35a0a87700 1 --2- 172.21.15.153:0/3775396721 >> v2:172.21.15.174:3300/0 conn(0x7f359c159300 0x7f359c0b2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.697+0000 7f35a0a87700 1 -- 172.21.15.153:0/3775396721 >> v1:172.21.15.153:6789/0 conn(0x7f359c15dbc0 legacy=0x7f359c0afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.697+0000 7f35a0a87700 1 -- 172.21.15.153:0/3775396721 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359c0cb440 con 0x7f359c1596d0 2024-08-17T02:26:05.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.697+0000 7f35a0a87700 1 --2- 172.21.15.153:0/3775396721 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f359c1596d0 0x7f359c066e00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f358c0098e0 tx=0x7f358c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=798dce05b36c64aa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.697+0000 7f3593fff700 1 -- 172.21.15.153:0/3775396721 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c011630 con 0x7f359c1596d0 2024-08-17T02:26:05.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.697+0000 7f3593fff700 1 -- 172.21.15.153:0/3775396721 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358c011790 con 0x7f359c1596d0 2024-08-17T02:26:05.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.697+0000 7f3593fff700 1 -- 172.21.15.153:0/3775396721 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c011b30 con 0x7f359c1596d0 2024-08-17T02:26:05.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.697+0000 7f35a34ec700 1 -- 172.21.15.153:0/3775396721 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f359c1596d0 msgr2=0x7f359c066e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.697+0000 7f35a34ec700 1 --2- 172.21.15.153:0/3775396721 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f359c1596d0 0x7f359c066e00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f358c0098e0 tx=0x7f358c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.697+0000 7f35a34ec700 1 -- 172.21.15.153:0/3775396721 shutdown_connections 2024-08-17T02:26:05.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.697+0000 7f35a34ec700 1 --2- 172.21.15.153:0/3775396721 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f359c1596d0 0x7f359c066e00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.697+0000 7f35a34ec700 1 --2- 172.21.15.153:0/3775396721 >> v2:172.21.15.174:3300/0 conn(0x7f359c159300 0x7f359c0b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.697+0000 7f35a34ec700 1 -- 172.21.15.153:0/3775396721 >> 172.21.15.153:0/3775396721 conn(0x7f359c0682c0 msgr2=0x7f359c0686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:05.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.697+0000 7f35a34ec700 1 -- 172.21.15.153:0/3775396721 shutdown_connections 2024-08-17T02:26:05.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.697+0000 7f35a34ec700 1 -- 172.21.15.153:0/3775396721 wait complete. 2024-08-17T02:26:05.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.701+0000 7f35a34ec700 1 Processor -- start 2024-08-17T02:26:05.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.701+0000 7f35a34ec700 1 -- start start 2024-08-17T02:26:05.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.701+0000 7f35a34ec700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f359c159300 0x7f359c0c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.701+0000 7f35a34ec700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f359c1596d0 0x7f359c1540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.701+0000 7f35a34ec700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f359c15dbc0 0x7f359c0c6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.701+0000 7f35a34ec700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c159aa0 con 0x7f359c15dbc0 2024-08-17T02:26:05.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.701+0000 7f35a34ec700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c0c8c30 con 0x7f359c159300 2024-08-17T02:26:05.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.701+0000 7f35a34ec700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359c0c8060 con 0x7f359c1596d0 2024-08-17T02:26:05.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.701+0000 7f35a1a89700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f359c15dbc0 0x7f359c0c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.701+0000 7f35a1a89700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f359c15dbc0 0x7f359c0c6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33186/0 (socket says 172.21.15.153:33186) 2024-08-17T02:26:05.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.701+0000 7f35a1a89700 1 -- 172.21.15.153:0/1017087826 learned_addr learned my addr 172.21.15.153:0/1017087826 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:05.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.701+0000 7f35a1288700 1 --2- 172.21.15.153:0/1017087826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f359c159300 0x7f359c0c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.701+0000 7f35a0a87700 1 --2- 172.21.15.153:0/1017087826 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f359c1596d0 0x7f359c1540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.701+0000 7f35a1a89700 1 -- 172.21.15.153:0/1017087826 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f359c1596d0 msgr2=0x7f359c1540c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.701+0000 7f35a1a89700 1 --2- 172.21.15.153:0/1017087826 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f359c1596d0 0x7f359c1540c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.701+0000 7f35a1a89700 1 -- 172.21.15.153:0/1017087826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f359c159300 msgr2=0x7f359c0c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.701+0000 7f35a1a89700 1 --2- 172.21.15.153:0/1017087826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f359c159300 0x7f359c0c46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.701+0000 7f35a1a89700 1 -- 172.21.15.153:0/1017087826 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f358c009420 con 0x7f359c15dbc0 2024-08-17T02:26:05.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.701+0000 7f35a1a89700 1 --2- 172.21.15.153:0/1017087826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f359c15dbc0 0x7f359c0c6140 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3594001460 tx=0x7f3594001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.701+0000 7f35917fa700 1 -- 172.21.15.153:0/1017087826 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359400a890 con 0x7f359c15dbc0 2024-08-17T02:26:05.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.701+0000 7f35917fa700 1 -- 172.21.15.153:0/1017087826 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359400a9f0 con 0x7f359c15dbc0 2024-08-17T02:26:05.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.701+0000 7f35a34ec700 1 -- 172.21.15.153:0/1017087826 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f359c0c8360 con 0x7f359c15dbc0 2024-08-17T02:26:05.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.701+0000 7f35917fa700 1 -- 172.21.15.153:0/1017087826 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359400ad70 con 0x7f359c15dbc0 2024-08-17T02:26:05.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.701+0000 7f35a34ec700 1 -- 172.21.15.153:0/1017087826 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f359c0c4c00 con 0x7f359c15dbc0 2024-08-17T02:26:05.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.705+0000 7f35a34ec700 1 -- 172.21.15.153:0/1017087826 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f359c0c8da0 con 0x7f359c15dbc0 2024-08-17T02:26:05.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.705+0000 7f35917fa700 1 -- 172.21.15.153:0/1017087826 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f3594007300 con 0x7f359c15dbc0 2024-08-17T02:26:05.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.705+0000 7f35917fa700 1 --2- 172.21.15.153:0/1017087826 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3580060860 0x7f3580062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.705+0000 7f35917fa700 1 -- 172.21.15.153:0/1017087826 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f359407cc60 con 0x7f359c15dbc0 2024-08-17T02:26:05.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.705+0000 7f35a1288700 1 --2- 172.21.15.153:0/1017087826 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3580060860 0x7f3580062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.705+0000 7f35a1288700 1 --2- 172.21.15.153:0/1017087826 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3580060860 0x7f3580062d10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3598009d10 tx=0x7f35980091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.713+0000 7f35917fa700 1 -- 172.21.15.153:0/1017087826 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f359404d3e0 con 0x7f359c15dbc0 2024-08-17T02:26:05.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.873+0000 7f35a34ec700 1 -- 172.21.15.153:0/1017087826 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f359c0645c0 con 0x7f359c15dbc0 2024-08-17T02:26:05.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.877+0000 7f35917fa700 1 -- 172.21.15.153:0/1017087826 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3594050a00 con 0x7f359c15dbc0 2024-08-17T02:26:05.878 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2024-08-17T02:26:05.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.877+0000 7f35a34ec700 1 -- 172.21.15.153:0/1017087826 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3580060860 msgr2=0x7f3580062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.877+0000 7f35a34ec700 1 --2- 172.21.15.153:0/1017087826 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3580060860 0x7f3580062d10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3598009d10 tx=0x7f35980091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.877+0000 7f35a34ec700 1 -- 172.21.15.153:0/1017087826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f359c15dbc0 msgr2=0x7f359c0c6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.877+0000 7f35a34ec700 1 --2- 172.21.15.153:0/1017087826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f359c15dbc0 0x7f359c0c6140 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3594001460 tx=0x7f3594001ae0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.877+0000 7f35a34ec700 1 -- 172.21.15.153:0/1017087826 shutdown_connections 2024-08-17T02:26:05.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.877+0000 7f35a34ec700 1 --2- 172.21.15.153:0/1017087826 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3580060860 0x7f3580062d10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.877+0000 7f35a34ec700 1 --2- 172.21.15.153:0/1017087826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f359c15dbc0 0x7f359c0c6140 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.877+0000 7f35a34ec700 1 --2- 172.21.15.153:0/1017087826 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f359c1596d0 0x7f359c1540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.877+0000 7f35a34ec700 1 --2- 172.21.15.153:0/1017087826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f359c159300 0x7f359c0c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.877+0000 7f35a34ec700 1 -- 172.21.15.153:0/1017087826 >> 172.21.15.153:0/1017087826 conn(0x7f359c0682c0 msgr2=0x7f359c0d0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:05.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.881+0000 7f35a34ec700 1 -- 172.21.15.153:0/1017087826 shutdown_connections 2024-08-17T02:26:05.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:05.881+0000 7f35a34ec700 1 -- 172.21.15.153:0/1017087826 wait complete. 2024-08-17T02:26:05.897 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:06.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.001+0000 7f8ccffff700 1 Processor -- start 2024-08-17T02:26:06.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.001+0000 7f8ccffff700 1 -- start start 2024-08-17T02:26:06.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.001+0000 7f8ccffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8cd00d0010 0x7f8cd00d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.001+0000 7f8ccffff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8cd015cea0 0x7f8cd015d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.001+0000 7f8ccffff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd00cf190 con 0x7f8cd0159040 2024-08-17T02:26:06.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.001+0000 7f8ccffff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd00d09a0 con 0x7f8cd00d0010 2024-08-17T02:26:06.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.001+0000 7f8ccffff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd00ce5e0 con 0x7f8cd015cea0 2024-08-17T02:26:06.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.001+0000 7f8cce7fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8cd00d0010 0x7f8cd00d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.001+0000 7f8cce7fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8cd00d0010 0x7f8cd00d0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33196/0 (socket says 172.21.15.153:33196) 2024-08-17T02:26:06.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.001+0000 7f8cce7fc700 1 -- 172.21.15.153:0/2128099935 learned_addr learned my addr 172.21.15.153:0/2128099935 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:06.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.005+0000 7f8ccf7fe700 1 --2- 172.21.15.153:0/2128099935 >> v2:172.21.15.174:3300/0 conn(0x7f8cd015cea0 0x7f8cd015d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.005+0000 7f8cce7fc700 1 -- 172.21.15.153:0/2128099935 >> v2:172.21.15.174:3300/0 conn(0x7f8cd015cea0 msgr2=0x7f8cd015d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:06.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.005+0000 7f8cce7fc700 1 --2- 172.21.15.153:0/2128099935 >> v2:172.21.15.174:3300/0 conn(0x7f8cd015cea0 0x7f8cd015d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.005+0000 7f8cce7fc700 1 -- 172.21.15.153:0/2128099935 >> v1:172.21.15.174:6789/0 conn(0x7f8cd0159040 legacy=0x7f8cd00cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:06.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.005+0000 7f8cce7fc700 1 -- 172.21.15.153:0/2128099935 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd00ce860 con 0x7f8cd00d0010 2024-08-17T02:26:06.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.005+0000 7f8ccf7fe700 1 --2- 172.21.15.153:0/2128099935 >> v2:172.21.15.174:3300/0 conn(0x7f8cd015cea0 0x7f8cd015d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:06.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.005+0000 7f8cce7fc700 1 --2- 172.21.15.153:0/2128099935 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8cd00d0010 0x7f8cd00d0460 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8cd00b6050 tx=0x7f8cc0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f0452f2edb3172e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:06.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.005+0000 7f8ccdffb700 1 -- 172.21.15.153:0/2128099935 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc000b820 con 0x7f8cd00d0010 2024-08-17T02:26:06.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.005+0000 7f8ccdffb700 1 -- 172.21.15.153:0/2128099935 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc000b980 con 0x7f8cd00d0010 2024-08-17T02:26:06.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.005+0000 7f8ccdffb700 1 -- 172.21.15.153:0/2128099935 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc000bd40 con 0x7f8cd00d0010 2024-08-17T02:26:06.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.005+0000 7f8ccffff700 1 -- 172.21.15.153:0/2128099935 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8cd00d0010 msgr2=0x7f8cd00d0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.005+0000 7f8ccffff700 1 --2- 172.21.15.153:0/2128099935 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8cd00d0010 0x7f8cd00d0460 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8cd00b6050 tx=0x7f8cc0009250 comp rx=0 tx=0).stop 2024-08-17T02:26:06.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.005+0000 7f8ccffff700 1 -- 172.21.15.153:0/2128099935 shutdown_connections 2024-08-17T02:26:06.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.005+0000 7f8ccffff700 1 --2- 172.21.15.153:0/2128099935 >> v2:172.21.15.174:3300/0 conn(0x7f8cd015cea0 0x7f8cd015d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.005+0000 7f8ccffff700 1 --2- 172.21.15.153:0/2128099935 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8cd00d0010 0x7f8cd00d0460 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.005+0000 7f8ccffff700 1 -- 172.21.15.153:0/2128099935 >> 172.21.15.153:0/2128099935 conn(0x7f8cd0068250 msgr2=0x7f8cd0068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:06.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.005+0000 7f8ccffff700 1 -- 172.21.15.153:0/2128099935 shutdown_connections 2024-08-17T02:26:06.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.005+0000 7f8ccffff700 1 -- 172.21.15.153:0/2128099935 wait complete. 2024-08-17T02:26:06.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.005+0000 7f8ccffff700 1 Processor -- start 2024-08-17T02:26:06.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.005+0000 7f8ccffff700 1 -- start start 2024-08-17T02:26:06.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.009+0000 7f8ccffff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8cd00d0010 0x7f8cd00c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.009+0000 7f8ccffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8cd0159040 0x7f8cd016a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.009+0000 7f8ccffff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8cd015cea0 0x7f8cd0167450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.009+0000 7f8ccffff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd016be00 con 0x7f8cd0159040 2024-08-17T02:26:06.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.009+0000 7f8ccffff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd016af20 con 0x7f8cd00d0010 2024-08-17T02:26:06.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.009+0000 7f8ccffff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd016b1f0 con 0x7f8cd015cea0 2024-08-17T02:26:06.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.009+0000 7f8cce7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8cd0159040 0x7f8cd016a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.009+0000 7f8cce7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8cd0159040 0x7f8cd016a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33202/0 (socket says 172.21.15.153:33202) 2024-08-17T02:26:06.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.009+0000 7f8cce7fc700 1 -- 172.21.15.153:0/3254022571 learned_addr learned my addr 172.21.15.153:0/3254022571 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:06.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.009+0000 7f8ccf7fe700 1 --2- 172.21.15.153:0/3254022571 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8cd015cea0 0x7f8cd0167450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.009+0000 7f8cceffd700 1 --2- 172.21.15.153:0/3254022571 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8cd00d0010 0x7f8cd00c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.009+0000 7f8cce7fc700 1 -- 172.21.15.153:0/3254022571 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8cd015cea0 msgr2=0x7f8cd0167450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.009+0000 7f8cce7fc700 1 --2- 172.21.15.153:0/3254022571 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8cd015cea0 0x7f8cd0167450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.009+0000 7f8cce7fc700 1 -- 172.21.15.153:0/3254022571 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8cd00d0010 msgr2=0x7f8cd00c63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.009+0000 7f8cce7fc700 1 --2- 172.21.15.153:0/3254022571 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8cd00d0010 0x7f8cd00c63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.009+0000 7f8cce7fc700 1 -- 172.21.15.153:0/3254022571 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc00094f0 con 0x7f8cd0159040 2024-08-17T02:26:06.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.009+0000 7f8cce7fc700 1 --2- 172.21.15.153:0/3254022571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8cd0159040 0x7f8cd016a9e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0088ef0 tx=0x7f8cc0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:06.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.009+0000 7f8cb6ffd700 1 -- 172.21.15.153:0/3254022571 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc000b820 con 0x7f8cd0159040 2024-08-17T02:26:06.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.009+0000 7f8cb6ffd700 1 -- 172.21.15.153:0/3254022571 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc0020070 con 0x7f8cd0159040 2024-08-17T02:26:06.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.009+0000 7f8ccffff700 1 -- 172.21.15.153:0/3254022571 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd016b4d0 con 0x7f8cd0159040 2024-08-17T02:26:06.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.009+0000 7f8cb6ffd700 1 -- 172.21.15.153:0/3254022571 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc000bd00 con 0x7f8cd0159040 2024-08-17T02:26:06.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.009+0000 7f8ccffff700 1 -- 172.21.15.153:0/3254022571 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd016ba90 con 0x7f8cd0159040 2024-08-17T02:26:06.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.009+0000 7f8cb6ffd700 1 -- 172.21.15.153:0/3254022571 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8cc0022030 con 0x7f8cd0159040 2024-08-17T02:26:06.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.009+0000 7f8ccffff700 1 -- 172.21.15.153:0/3254022571 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd016bfb0 con 0x7f8cd0159040 2024-08-17T02:26:06.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.013+0000 7f8cb6ffd700 1 --2- 172.21.15.153:0/3254022571 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8cbc060860 0x7f8cbc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.013+0000 7f8cb6ffd700 1 -- 172.21.15.153:0/3254022571 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8cc007e540 con 0x7f8cd0159040 2024-08-17T02:26:06.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.013+0000 7f8cceffd700 1 --2- 172.21.15.153:0/3254022571 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8cbc060860 0x7f8cbc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.013+0000 7f8cceffd700 1 --2- 172.21.15.153:0/3254022571 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8cbc060860 0x7f8cbc062d10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8cd00b2b20 tx=0x7f8cc4009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:06.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.017+0000 7f8cb6ffd700 1 -- 172.21.15.153:0/3254022571 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f8cd016bfb0 con 0x7f8cd0159040 2024-08-17T02:26:06.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.221+0000 7f8ccffff700 1 -- 172.21.15.153:0/3254022571 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8cd00643a0 con 0x7f8cd0159040 2024-08-17T02:26:06.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.221+0000 7f8cb6ffd700 1 -- 172.21.15.153:0/3254022571 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1259 (secure 0 0 0) 0x7f8cc004ec40 con 0x7f8cd0159040 2024-08-17T02:26:06.226 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:06.226 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/3521472122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3521472122},{"type":"v1","addr":"172.21.15.153:6837","nonce":3521472122}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-08-17T02:26:06.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.225+0000 7f8ccffff700 1 -- 172.21.15.153:0/3254022571 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8cbc060860 msgr2=0x7f8cbc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.225+0000 7f8ccffff700 1 --2- 172.21.15.153:0/3254022571 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8cbc060860 0x7f8cbc062d10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8cd00b2b20 tx=0x7f8cc4009060 comp rx=0 tx=0).stop 2024-08-17T02:26:06.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.225+0000 7f8ccffff700 1 -- 172.21.15.153:0/3254022571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8cd0159040 msgr2=0x7f8cd016a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.225+0000 7f8ccffff700 1 --2- 172.21.15.153:0/3254022571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8cd0159040 0x7f8cd016a9e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0088ef0 tx=0x7f8cc0016000 comp rx=0 tx=0).stop 2024-08-17T02:26:06.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.225+0000 7f8ccffff700 1 -- 172.21.15.153:0/3254022571 shutdown_connections 2024-08-17T02:26:06.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.225+0000 7f8ccffff700 1 --2- 172.21.15.153:0/3254022571 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8cbc060860 0x7f8cbc062d10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.225+0000 7f8ccffff700 1 --2- 172.21.15.153:0/3254022571 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8cd015cea0 0x7f8cd0167450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.225+0000 7f8ccffff700 1 --2- 172.21.15.153:0/3254022571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8cd0159040 0x7f8cd016a9e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.225+0000 7f8ccffff700 1 --2- 172.21.15.153:0/3254022571 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8cd00d0010 0x7f8cd00c63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.225+0000 7f8ccffff700 1 -- 172.21.15.153:0/3254022571 >> 172.21.15.153:0/3254022571 conn(0x7f8cd0068250 msgr2=0x7f8cd00cf620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:06.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.225+0000 7f8ccffff700 1 -- 172.21.15.153:0/3254022571 shutdown_connections 2024-08-17T02:26:06.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:06.225+0000 7f8ccffff700 1 -- 172.21.15.153:0/3254022571 wait complete. 2024-08-17T02:26:06.230 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 2 2024-08-17T02:26:08.240 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:08.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.353+0000 7f1cda7ce700 1 Processor -- start 2024-08-17T02:26:08.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.353+0000 7f1cda7ce700 1 -- start start 2024-08-17T02:26:08.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.353+0000 7f1cda7ce700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1cd40cddc0 0x7f1cd40ad3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.353+0000 7f1cda7ce700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1cd40cb240 0x7f1cd40cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.353+0000 7f1cda7ce700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cd40cef40 con 0x7f1cd4159340 2024-08-17T02:26:08.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.353+0000 7f1cda7ce700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd40ad930 con 0x7f1cd40cb240 2024-08-17T02:26:08.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.353+0000 7f1cda7ce700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd40af770 con 0x7f1cd40cddc0 2024-08-17T02:26:08.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.353+0000 7f1cd3fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f1cd4159340 0x7f1cd40cd510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:40424/0 (socket says 172.21.15.153:40424) 2024-08-17T02:26:08.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.353+0000 7f1cd3fff700 1 -- 172.21.15.153:0/556659983 learned_addr learned my addr 172.21.15.153:0/556659983 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:08.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.353+0000 7f1cd37fe700 1 --2- 172.21.15.153:0/556659983 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1cd40cddc0 0x7f1cd40ad3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.353+0000 7f1cd8d6b700 1 --2- 172.21.15.153:0/556659983 >> v2:172.21.15.174:3300/0 conn(0x7f1cd40cb240 0x7f1cd40cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.353+0000 7f1cd2ffd700 1 -- 172.21.15.153:0/556659983 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2333172006 0 0) 0x7f1cd40cef40 con 0x7f1cd4159340 2024-08-17T02:26:08.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.353+0000 7f1cd2ffd700 1 -- 172.21.15.153:0/556659983 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cc0003570 con 0x7f1cd4159340 2024-08-17T02:26:08.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.353+0000 7f1cd37fe700 1 -- 172.21.15.153:0/556659983 >> v2:172.21.15.174:3300/0 conn(0x7f1cd40cb240 msgr2=0x7f1cd40cb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:08.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.353+0000 7f1cd37fe700 1 --2- 172.21.15.153:0/556659983 >> v2:172.21.15.174:3300/0 conn(0x7f1cd40cb240 0x7f1cd40cb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.353+0000 7f1cd37fe700 1 -- 172.21.15.153:0/556659983 >> v1:172.21.15.153:6789/0 conn(0x7f1cd4159340 legacy=0x7f1cd40cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.353+0000 7f1cd37fe700 1 -- 172.21.15.153:0/556659983 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd40ce330 con 0x7f1cd40cddc0 2024-08-17T02:26:08.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.353+0000 7f1cd8d6b700 1 --2- 172.21.15.153:0/556659983 >> v2:172.21.15.174:3300/0 conn(0x7f1cd40cb240 0x7f1cd40cb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:08.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.353+0000 7f1cd37fe700 1 --2- 172.21.15.153:0/556659983 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1cd40cddc0 0x7f1cd40ad3f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1cc40098e0 tx=0x7f1cc40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef744c243a983629 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:08.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.357+0000 7f1cd2ffd700 1 -- 172.21.15.153:0/556659983 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc4011630 con 0x7f1cd40cddc0 2024-08-17T02:26:08.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.357+0000 7f1cd2ffd700 1 -- 172.21.15.153:0/556659983 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc4011790 con 0x7f1cd40cddc0 2024-08-17T02:26:08.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.357+0000 7f1cd2ffd700 1 -- 172.21.15.153:0/556659983 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc4011b10 con 0x7f1cd40cddc0 2024-08-17T02:26:08.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.357+0000 7f1cda7ce700 1 -- 172.21.15.153:0/556659983 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1cd40cddc0 msgr2=0x7f1cd40ad3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.357+0000 7f1cda7ce700 1 --2- 172.21.15.153:0/556659983 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1cd40cddc0 0x7f1cd40ad3f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1cc40098e0 tx=0x7f1cc40091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.357+0000 7f1cda7ce700 1 -- 172.21.15.153:0/556659983 shutdown_connections 2024-08-17T02:26:08.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.357+0000 7f1cda7ce700 1 --2- 172.21.15.153:0/556659983 >> v2:172.21.15.174:3300/0 conn(0x7f1cd40cb240 0x7f1cd40cb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.357+0000 7f1cda7ce700 1 --2- 172.21.15.153:0/556659983 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1cd40cddc0 0x7f1cd40ad3f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.357+0000 7f1cda7ce700 1 -- 172.21.15.153:0/556659983 >> 172.21.15.153:0/556659983 conn(0x7f1cd40994e0 msgr2=0x7f1cd40675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:08.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.357+0000 7f1cda7ce700 1 -- 172.21.15.153:0/556659983 shutdown_connections 2024-08-17T02:26:08.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.357+0000 7f1cda7ce700 1 -- 172.21.15.153:0/556659983 wait complete. 2024-08-17T02:26:08.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.357+0000 7f1cda7ce700 1 Processor -- start 2024-08-17T02:26:08.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.357+0000 7f1cda7ce700 1 -- start start 2024-08-17T02:26:08.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.361+0000 7f1cda7ce700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1cd40cb240 0x7f1cd40c8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.361+0000 7f1cda7ce700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1cd40cddc0 0x7f1cd41508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.361+0000 7f1cda7ce700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1cd4159340 0x7f1cd416cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.361+0000 7f1cda7ce700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd414f820 con 0x7f1cd40cb240 2024-08-17T02:26:08.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.361+0000 7f1cda7ce700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd414fb00 con 0x7f1cd4159340 2024-08-17T02:26:08.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.361+0000 7f1cda7ce700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd414fde0 con 0x7f1cd40cddc0 2024-08-17T02:26:08.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.361+0000 7f1cd3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1cd40cb240 0x7f1cd40c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.361+0000 7f1cd3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1cd40cb240 0x7f1cd40c8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33214/0 (socket says 172.21.15.153:33214) 2024-08-17T02:26:08.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.361+0000 7f1cd3fff700 1 -- 172.21.15.153:0/2211414469 learned_addr learned my addr 172.21.15.153:0/2211414469 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:08.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.361+0000 7f1cd37fe700 1 --2- 172.21.15.153:0/2211414469 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1cd40cddc0 0x7f1cd41508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.361+0000 7f1cd8d6b700 1 --2- 172.21.15.153:0/2211414469 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1cd4159340 0x7f1cd416cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.361+0000 7f1cd3fff700 1 -- 172.21.15.153:0/2211414469 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1cd40cddc0 msgr2=0x7f1cd41508c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.361+0000 7f1cd3fff700 1 --2- 172.21.15.153:0/2211414469 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1cd40cddc0 0x7f1cd41508c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.361+0000 7f1cd3fff700 1 -- 172.21.15.153:0/2211414469 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1cd4159340 msgr2=0x7f1cd416cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.361+0000 7f1cd3fff700 1 --2- 172.21.15.153:0/2211414469 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1cd4159340 0x7f1cd416cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.361+0000 7f1cd3fff700 1 -- 172.21.15.153:0/2211414469 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ccc009420 con 0x7f1cd40cb240 2024-08-17T02:26:08.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.361+0000 7f1cd3fff700 1 --2- 172.21.15.153:0/2211414469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1cd40cb240 0x7f1cd40c8160 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00cc40 tx=0x7f1cbc001a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:08.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.361+0000 7f1ccbfff700 1 -- 172.21.15.153:0/2211414469 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc00a8d0 con 0x7f1cd40cb240 2024-08-17T02:26:08.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.361+0000 7f1ccbfff700 1 -- 172.21.15.153:0/2211414469 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cbc00aa30 con 0x7f1cd40cb240 2024-08-17T02:26:08.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.361+0000 7f1cda7ce700 1 -- 172.21.15.153:0/2211414469 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc4009420 con 0x7f1cd40cb240 2024-08-17T02:26:08.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.361+0000 7f1ccbfff700 1 -- 172.21.15.153:0/2211414469 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc00add0 con 0x7f1cd40cb240 2024-08-17T02:26:08.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.361+0000 7f1cda7ce700 1 -- 172.21.15.153:0/2211414469 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cd41503a0 con 0x7f1cd40cb240 2024-08-17T02:26:08.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.361+0000 7f1cda7ce700 1 -- 172.21.15.153:0/2211414469 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cd41505c0 con 0x7f1cd40cb240 2024-08-17T02:26:08.367 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.365+0000 7f1ccbfff700 1 -- 172.21.15.153:0/2211414469 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1cbc007300 con 0x7f1cd40cb240 2024-08-17T02:26:08.367 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.365+0000 7f1ccbfff700 1 --2- 172.21.15.153:0/2211414469 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1cb4060860 0x7f1cb4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.365+0000 7f1ccbfff700 1 -- 172.21.15.153:0/2211414469 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1cbc07cb70 con 0x7f1cd40cb240 2024-08-17T02:26:08.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.365+0000 7f1cd37fe700 1 --2- 172.21.15.153:0/2211414469 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1cb4060860 0x7f1cb4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.365+0000 7f1cd37fe700 1 --2- 172.21.15.153:0/2211414469 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1cb4060860 0x7f1cb4062d10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1cd41517c0 tx=0x7f1cc4017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:08.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.369+0000 7f1ccbfff700 1 -- 172.21.15.153:0/2211414469 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1cbc04d3d0 con 0x7f1cd40cb240 2024-08-17T02:26:08.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.573+0000 7f1cda7ce700 1 -- 172.21.15.153:0/2211414469 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1cd40645c0 con 0x7f1cd40cb240 2024-08-17T02:26:08.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.573+0000 7f1ccbfff700 1 -- 172.21.15.153:0/2211414469 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7f1cbc0509f0 con 0x7f1cd40cb240 2024-08-17T02:26:08.576 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:08.576 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/610991976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":610991976},{"type":"v1","addr":"172.21.15.153:6835","nonce":610991976}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/3521472122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3521472122},{"type":"v1","addr":"172.21.15.153:6837","nonce":3521472122}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1184225885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1184225885},{"type":"v1","addr":"172.21.15.174:6833","nonce":1184225885}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/477398839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":477398839},{"type":"v1","addr":"172.21.15.174:6835","nonce":477398839}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-08-17T02:26:08.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.573+0000 7f1cda7ce700 1 -- 172.21.15.153:0/2211414469 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1cb4060860 msgr2=0x7f1cb4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.573+0000 7f1cda7ce700 1 --2- 172.21.15.153:0/2211414469 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1cb4060860 0x7f1cb4062d10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1cd41517c0 tx=0x7f1cc4017000 comp rx=0 tx=0).stop 2024-08-17T02:26:08.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.573+0000 7f1cda7ce700 1 -- 172.21.15.153:0/2211414469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1cd40cb240 msgr2=0x7f1cd40c8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.573+0000 7f1cda7ce700 1 --2- 172.21.15.153:0/2211414469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1cd40cb240 0x7f1cd40c8160 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00cc40 tx=0x7f1cbc001a60 comp rx=0 tx=0).stop 2024-08-17T02:26:08.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.577+0000 7f1cda7ce700 1 -- 172.21.15.153:0/2211414469 shutdown_connections 2024-08-17T02:26:08.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.577+0000 7f1cda7ce700 1 --2- 172.21.15.153:0/2211414469 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1cb4060860 0x7f1cb4062d10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.577+0000 7f1cda7ce700 1 --2- 172.21.15.153:0/2211414469 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1cd4159340 0x7f1cd416cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.577+0000 7f1cda7ce700 1 --2- 172.21.15.153:0/2211414469 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1cd40cddc0 0x7f1cd41508c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.577+0000 7f1cda7ce700 1 --2- 172.21.15.153:0/2211414469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1cd40cb240 0x7f1cd40c8160 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.577+0000 7f1cda7ce700 1 -- 172.21.15.153:0/2211414469 >> 172.21.15.153:0/2211414469 conn(0x7f1cd40994e0 msgr2=0x7f1cd4151920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:08.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.577+0000 7f1cda7ce700 1 -- 172.21.15.153:0/2211414469 shutdown_connections 2024-08-17T02:26:08.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.577+0000 7f1cda7ce700 1 -- 172.21.15.153:0/2211414469 wait complete. 2024-08-17T02:26:08.582 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 3 2024-08-17T02:26:08.591 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:08.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.697+0000 7f2b3abe5700 1 Processor -- start 2024-08-17T02:26:08.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.697+0000 7f2b3abe5700 1 -- start start 2024-08-17T02:26:08.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b3abe5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b340c6c80 0x7f2b340af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b3abe5700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b340c7dc0 con 0x7f2b34159240 2024-08-17T02:26:08.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b3abe5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b340c71b0 con 0x7f2b34159610 2024-08-17T02:26:08.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b3abe5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3406c170 con 0x7f2b340c6c80 2024-08-17T02:26:08.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b38981700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f2b34159240 0x7f2b3406ba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:40436/0 (socket says 172.21.15.153:40436) 2024-08-17T02:26:08.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b38981700 1 -- 172.21.15.153:0/3875265084 learned_addr learned my addr 172.21.15.153:0/3875265084 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:08.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b33fff700 1 --2- 172.21.15.153:0/3875265084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b340c6c80 0x7f2b340af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b337fe700 1 -- 172.21.15.153:0/3875265084 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 37781981 0 0) 0x7f2b340c7dc0 con 0x7f2b34159240 2024-08-17T02:26:08.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b337fe700 1 -- 172.21.15.153:0/3875265084 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b1c003570 con 0x7f2b34159240 2024-08-17T02:26:08.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b337fe700 1 -- 172.21.15.153:0/3875265084 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1440069120 0 0) 0x7f2b1c003570 con 0x7f2b34159240 2024-08-17T02:26:08.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b337fe700 1 -- 172.21.15.153:0/3875265084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b340c6c80 msgr2=0x7f2b340af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:08.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b337fe700 1 --2- 172.21.15.153:0/3875265084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b340c6c80 0x7f2b340af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b337fe700 1 -- 172.21.15.153:0/3875265084 >> v1:172.21.15.174:6789/0 conn(0x7f2b34159610 legacy=0x7f2b340686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b337fe700 1 -- 172.21.15.153:0/3875265084 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b340c7490 con 0x7f2b34159240 2024-08-17T02:26:08.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b337fe700 1 -- 172.21.15.153:0/3875265084 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3701463666 0 0) 0x7f2b2c0017f0 con 0x7f2b34159240 2024-08-17T02:26:08.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b337fe700 1 -- 172.21.15.153:0/3875265084 >> v1:172.21.15.153:6789/0 conn(0x7f2b34159240 legacy=0x7f2b3406ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b337fe700 1 --2- 172.21.15.153:0/3875265084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b340c6c80 0x7f2b1c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b337fe700 1 --2- 172.21.15.153:0/3875265084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b1c004010 0x7f2b1c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b337fe700 1 --2- 172.21.15.153:0/3875265084 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b1c004d50 0x7f2b1c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b337fe700 1 -- 172.21.15.153:0/3875265084 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3406c170 con 0x7f2b1c004010 2024-08-17T02:26:08.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b337fe700 1 -- 172.21.15.153:0/3875265084 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c00bbf0 con 0x7f2b1c004d50 2024-08-17T02:26:08.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b337fe700 1 -- 172.21.15.153:0/3875265084 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c00bdb0 con 0x7f2b340c6c80 2024-08-17T02:26:08.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b33fff700 1 --2- 172.21.15.153:0/3875265084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b1c004010 0x7f2b1c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b38981700 1 --2- 172.21.15.153:0/3875265084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b340c6c80 0x7f2b1c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b39182700 1 --2- 172.21.15.153:0/3875265084 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b1c004d50 0x7f2b1c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b33fff700 1 -- 172.21.15.153:0/3875265084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b340c6c80 msgr2=0x7f2b1c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:08.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b33fff700 1 --2- 172.21.15.153:0/3875265084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b340c6c80 0x7f2b1c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b33fff700 1 -- 172.21.15.153:0/3875265084 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b1c004d50 msgr2=0x7f2b1c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:08.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b33fff700 1 --2- 172.21.15.153:0/3875265084 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b1c004d50 0x7f2b1c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b33fff700 1 -- 172.21.15.153:0/3875265084 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b1c003570 con 0x7f2b1c004010 2024-08-17T02:26:08.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b33fff700 1 --2- 172.21.15.153:0/3875265084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b1c004010 0x7f2b1c004810 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2b24006f00 tx=0x7f2b240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d451e71648f0ba48 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:08.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b337fe700 1 -- 172.21.15.153:0/3875265084 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2400e710 con 0x7f2b1c004010 2024-08-17T02:26:08.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b337fe700 1 -- 172.21.15.153:0/3875265084 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2400e870 con 0x7f2b1c004010 2024-08-17T02:26:08.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b337fe700 1 -- 172.21.15.153:0/3875265084 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2400ec30 con 0x7f2b1c004010 2024-08-17T02:26:08.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b3abe5700 1 -- 172.21.15.153:0/3875265084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b1c004010 msgr2=0x7f2b1c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b3abe5700 1 --2- 172.21.15.153:0/3875265084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b1c004010 0x7f2b1c004810 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2b24006f00 tx=0x7f2b240091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b39182700 1 -- 172.21.15.153:0/3875265084 reap_dead start 2024-08-17T02:26:08.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b3abe5700 1 -- 172.21.15.153:0/3875265084 shutdown_connections 2024-08-17T02:26:08.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b3abe5700 1 -- 172.21.15.153:0/3875265084 >> 172.21.15.153:0/3875265084 conn(0x7f2b340c9c20 msgr2=0x7f2b3406d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:08.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b3abe5700 1 -- 172.21.15.153:0/3875265084 shutdown_connections 2024-08-17T02:26:08.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.701+0000 7f2b3abe5700 1 -- 172.21.15.153:0/3875265084 wait complete. 2024-08-17T02:26:08.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.705+0000 7f2b3abe5700 1 Processor -- start 2024-08-17T02:26:08.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.705+0000 7f2b3abe5700 1 -- start start 2024-08-17T02:26:08.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.705+0000 7f2b3abe5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b340aa090 0x7f2b340aa460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.705+0000 7f2b3abe5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b3416aa00 0x7f2b34169540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.705+0000 7f2b3abe5700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b340ca210 0x7f2b340ca680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.705+0000 7f2b3abe5700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b340cabc0 con 0x7f2b3416aa00 2024-08-17T02:26:08.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.705+0000 7f2b3abe5700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b340aa9a0 con 0x7f2b340ca210 2024-08-17T02:26:08.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.705+0000 7f2b3abe5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b340c4ea0 con 0x7f2b340aa090 2024-08-17T02:26:08.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.705+0000 7f2b33fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b3416aa00 0x7f2b34169540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.705+0000 7f2b33fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b3416aa00 0x7f2b34169540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33228/0 (socket says 172.21.15.153:33228) 2024-08-17T02:26:08.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.705+0000 7f2b33fff700 1 -- 172.21.15.153:0/3260400093 learned_addr learned my addr 172.21.15.153:0/3260400093 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:08.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.705+0000 7f2b38981700 1 --2- 172.21.15.153:0/3260400093 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b340aa090 0x7f2b340aa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.705+0000 7f2b39182700 1 --2- 172.21.15.153:0/3260400093 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b340ca210 0x7f2b340ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.705+0000 7f2b33fff700 1 -- 172.21.15.153:0/3260400093 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b340aa090 msgr2=0x7f2b340aa460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.705+0000 7f2b33fff700 1 --2- 172.21.15.153:0/3260400093 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b340aa090 0x7f2b340aa460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.705+0000 7f2b33fff700 1 -- 172.21.15.153:0/3260400093 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b340ca210 msgr2=0x7f2b340ca680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.705+0000 7f2b33fff700 1 --2- 172.21.15.153:0/3260400093 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b340ca210 0x7f2b340ca680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.705+0000 7f2b33fff700 1 -- 172.21.15.153:0/3260400093 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b34169dc0 con 0x7f2b3416aa00 2024-08-17T02:26:08.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.705+0000 7f2b33fff700 1 --2- 172.21.15.153:0/3260400093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b3416aa00 0x7f2b34169540 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2b24016000 tx=0x7f2b2401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:08.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.705+0000 7f2b30ff9700 1 -- 172.21.15.153:0/3260400093 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2402a070 con 0x7f2b3416aa00 2024-08-17T02:26:08.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.705+0000 7f2b30ff9700 1 -- 172.21.15.153:0/3260400093 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b24000bc0 con 0x7f2b3416aa00 2024-08-17T02:26:08.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.705+0000 7f2b3abe5700 1 -- 172.21.15.153:0/3260400093 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b3416a0a0 con 0x7f2b3416aa00 2024-08-17T02:26:08.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.705+0000 7f2b30ff9700 1 -- 172.21.15.153:0/3260400093 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2400e710 con 0x7f2b3416aa00 2024-08-17T02:26:08.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.705+0000 7f2b3abe5700 1 -- 172.21.15.153:0/3260400093 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b3416a660 con 0x7f2b3416aa00 2024-08-17T02:26:08.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.709+0000 7f2b3abe5700 1 -- 172.21.15.153:0/3260400093 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b340645c0 con 0x7f2b3416aa00 2024-08-17T02:26:08.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.709+0000 7f2b30ff9700 1 -- 172.21.15.153:0/3260400093 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2b2402e070 con 0x7f2b3416aa00 2024-08-17T02:26:08.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.709+0000 7f2b30ff9700 1 --2- 172.21.15.153:0/3260400093 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2b20060890 0x7f2b20062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.709+0000 7f2b30ff9700 1 -- 172.21.15.153:0/3260400093 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2b24086b80 con 0x7f2b3416aa00 2024-08-17T02:26:08.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.709+0000 7f2b38981700 1 --2- 172.21.15.153:0/3260400093 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2b20060890 0x7f2b20062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.709+0000 7f2b38981700 1 --2- 172.21.15.153:0/3260400093 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2b20060890 0x7f2b20062d40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c004c10 tx=0x7f2b2c006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:08.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.717+0000 7f2b30ff9700 1 -- 172.21.15.153:0/3260400093 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f2b24057320 con 0x7f2b3416aa00 2024-08-17T02:26:08.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.885+0000 7f2b3abe5700 1 -- 172.21.15.153:0/3260400093 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b340c4fe0 con 0x7f2b3416aa00 2024-08-17T02:26:08.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.885+0000 7f2b30ff9700 1 -- 172.21.15.153:0/3260400093 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12175 (secure 0 0 0) 0x7f2b2405a940 con 0x7f2b3416aa00 2024-08-17T02:26:08.891 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:08.891 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":17,"fsid":"56d41c33-b929-456d-96be-2aac4ecd299d","created":"2024-08-17T02:25:47.756085+0000","modified":"2024-08-17T02:26:00.650916+0000","last_up_change":"2024-08-17T02:25:58.643690+0000","last_in_change":"2024-08-17T02:25:49.809186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:58.093273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"0736f8e6-818e-42e6-a0dc-8aaf813315d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":24234},{"type":"v1","addr":"172.21.15.153:6817","nonce":24234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":24234},{"type":"v1","addr":"172.21.15.153:6819","nonce":24234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":24234},{"type":"v1","addr":"172.21.15.153:6823","nonce":24234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":24234},{"type":"v1","addr":"172.21.15.153:6821","nonce":24234}]},"public_addr":"172.21.15.153:6817/24234","cluster_addr":"172.21.15.153:6819/24234","heartbeat_back_addr":"172.21.15.153:6823/24234","heartbeat_front_addr":"172.21.15.153:6821/24234","state":["exists","up"]},{"osd":1,"uuid":"011762e9-6c2d-441a-aa56-68474639d72f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":24232},{"type":"v1","addr":"172.21.15.153:6801","nonce":24232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":24232},{"type":"v1","addr":"172.21.15.153:6803","nonce":24232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":24232},{"type":"v1","addr":"172.21.15.153:6809","nonce":24232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":24232},{"type":"v1","addr":"172.21.15.153:6806","nonce":24232}]},"public_addr":"172.21.15.153:6801/24232","cluster_addr":"172.21.15.153:6803/24232","heartbeat_back_addr":"172.21.15.153:6809/24232","heartbeat_front_addr":"172.21.15.153:6806/24232","state":["exists","up"]},{"osd":2,"uuid":"b562cd97-aa12-455e-b46a-e720a2ec9d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":24235},{"type":"v1","addr":"172.21.15.153:6808","nonce":24235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":24235},{"type":"v1","addr":"172.21.15.153:6811","nonce":24235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":24235},{"type":"v1","addr":"172.21.15.153:6815","nonce":24235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":24235},{"type":"v1","addr":"172.21.15.153:6813","nonce":24235}]},"public_addr":"172.21.15.153:6808/24235","cluster_addr":"172.21.15.153:6811/24235","heartbeat_back_addr":"172.21.15.153:6815/24235","heartbeat_front_addr":"172.21.15.153:6813/24235","state":["exists","up"]},{"osd":3,"uuid":"222da52f-90c2-4132-a5d2-6f6cf83d4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":24236},{"type":"v1","addr":"172.21.15.153:6825","nonce":24236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":24236},{"type":"v1","addr":"172.21.15.153:6827","nonce":24236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":24236},{"type":"v1","addr":"172.21.15.153:6831","nonce":24236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":24236},{"type":"v1","addr":"172.21.15.153:6829","nonce":24236}]},"public_addr":"172.21.15.153:6825/24236","cluster_addr":"172.21.15.153:6827/24236","heartbeat_back_addr":"172.21.15.153:6831/24236","heartbeat_front_addr":"172.21.15.153:6829/24236","state":["exists","up"]},{"osd":4,"uuid":"a38a04cd-032b-4977-a260-1ef3567d0c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24456},{"type":"v1","addr":"172.21.15.174:6809","nonce":24456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24456},{"type":"v1","addr":"172.21.15.174:6811","nonce":24456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24456},{"type":"v1","addr":"172.21.15.174:6815","nonce":24456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24456},{"type":"v1","addr":"172.21.15.174:6813","nonce":24456}]},"public_addr":"172.21.15.174:6809/24456","cluster_addr":"172.21.15.174:6811/24456","heartbeat_back_addr":"172.21.15.174:6815/24456","heartbeat_front_addr":"172.21.15.174:6813/24456","state":["exists","up"]},{"osd":5,"uuid":"c7778084-e751-48da-87a1-ab8bbe85aa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24457},{"type":"v1","addr":"172.21.15.174:6825","nonce":24457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24457},{"type":"v1","addr":"172.21.15.174:6827","nonce":24457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24457},{"type":"v1","addr":"172.21.15.174:6831","nonce":24457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24457},{"type":"v1","addr":"172.21.15.174:6829","nonce":24457}]},"public_addr":"172.21.15.174:6825/24457","cluster_addr":"172.21.15.174:6827/24457","heartbeat_back_addr":"172.21.15.174:6831/24457","heartbeat_front_addr":"172.21.15.174:6829/24457","state":["exists","up"]},{"osd":6,"uuid":"2d8e0715-254f-442c-9625-50721d0bc858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24477},{"type":"v1","addr":"172.21.15.174:6801","nonce":24477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24477},{"type":"v1","addr":"172.21.15.174:6803","nonce":24477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24477},{"type":"v1","addr":"172.21.15.174:6807","nonce":24477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24477},{"type":"v1","addr":"172.21.15.174:6805","nonce":24477}]},"public_addr":"172.21.15.174:6801/24477","cluster_addr":"172.21.15.174:6803/24477","heartbeat_back_addr":"172.21.15.174:6807/24477","heartbeat_front_addr":"172.21.15.174:6805/24477","state":["exists","up"]},{"osd":7,"uuid":"dffda25a-4601-4ddb-9a27-b0be1cadde27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24455},{"type":"v1","addr":"172.21.15.174:6817","nonce":24455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24455},{"type":"v1","addr":"172.21.15.174:6819","nonce":24455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24455},{"type":"v1","addr":"172.21.15.174:6823","nonce":24455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24455},{"type":"v1","addr":"172.21.15.174:6821","nonce":24455}]},"public_addr":"172.21.15.174:6817/24455","cluster_addr":"172.21.15.174:6819/24455","heartbeat_back_addr":"172.21.15.174:6823/24455","heartbeat_front_addr":"172.21.15.174:6821/24455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.990117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.033862+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.748087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.112877+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.070448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.360961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.110940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.226377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:08.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.889+0000 7f2b3abe5700 1 -- 172.21.15.153:0/3260400093 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2b20060890 msgr2=0x7f2b20062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.889+0000 7f2b3abe5700 1 --2- 172.21.15.153:0/3260400093 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2b20060890 0x7f2b20062d40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c004c10 tx=0x7f2b2c006040 comp rx=0 tx=0).stop 2024-08-17T02:26:08.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.889+0000 7f2b3abe5700 1 -- 172.21.15.153:0/3260400093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b3416aa00 msgr2=0x7f2b34169540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.889+0000 7f2b3abe5700 1 --2- 172.21.15.153:0/3260400093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b3416aa00 0x7f2b34169540 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2b24016000 tx=0x7f2b2401a000 comp rx=0 tx=0).stop 2024-08-17T02:26:08.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.889+0000 7f2b3abe5700 1 -- 172.21.15.153:0/3260400093 shutdown_connections 2024-08-17T02:26:08.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.889+0000 7f2b3abe5700 1 --2- 172.21.15.153:0/3260400093 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2b20060890 0x7f2b20062d40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.889+0000 7f2b3abe5700 1 --2- 172.21.15.153:0/3260400093 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b340ca210 0x7f2b340ca680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.889+0000 7f2b3abe5700 1 --2- 172.21.15.153:0/3260400093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b3416aa00 0x7f2b34169540 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.889+0000 7f2b3abe5700 1 --2- 172.21.15.153:0/3260400093 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b340aa090 0x7f2b340aa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.889+0000 7f2b3abe5700 1 -- 172.21.15.153:0/3260400093 >> 172.21.15.153:0/3260400093 conn(0x7f2b340c9c20 msgr2=0x7f2b340c24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:08.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.889+0000 7f2b3abe5700 1 -- 172.21.15.153:0/3260400093 shutdown_connections 2024-08-17T02:26:08.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:08.889+0000 7f2b3abe5700 1 -- 172.21.15.153:0/3260400093 wait complete. 2024-08-17T02:26:08.904 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:58.093273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:26:08.904 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:09.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.013+0000 7fb2742fa700 1 Processor -- start 2024-08-17T02:26:09.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.013+0000 7fb2742fa700 1 -- start start 2024-08-17T02:26:09.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.013+0000 7fb2742fa700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb26c15d540 0x7fb26c15d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.013+0000 7fb2742fa700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb26c0cd970 0x7fb26c0c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.013+0000 7fb2742fa700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb26c0cddf0 con 0x7fb26c0c8b20 2024-08-17T02:26:09.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.013+0000 7fb2742fa700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb26c0cd4e0 con 0x7fb26c0cd970 2024-08-17T02:26:09.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.013+0000 7fb2742fa700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb26c0cc8d0 con 0x7fb26c15d540 2024-08-17T02:26:09.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.013+0000 7fb272897700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb26c0c8b20 0x7fb26c0ad9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:40444/0 (socket says 172.21.15.153:40444) 2024-08-17T02:26:09.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.013+0000 7fb272897700 1 -- 172.21.15.153:0/968278415 learned_addr learned my addr 172.21.15.153:0/968278415 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:09.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.013+0000 7fb271895700 1 --2- 172.21.15.153:0/968278415 >> v2:172.21.15.153:3300/0 conn(0x7fb26c0cd970 0x7fb26c0c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.013+0000 7fb272096700 1 --2- 172.21.15.153:0/968278415 >> v2:172.21.15.174:3300/0 conn(0x7fb26c15d540 0x7fb26c15d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.013+0000 7fb271094700 1 -- 172.21.15.153:0/968278415 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2039167508 0 0) 0x7fb264001490 con 0x7fb26c0c8b20 2024-08-17T02:26:09.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.013+0000 7fb271094700 1 -- 172.21.15.153:0/968278415 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb258003570 con 0x7fb26c0c8b20 2024-08-17T02:26:09.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.013+0000 7fb271895700 1 -- 172.21.15.153:0/968278415 >> v2:172.21.15.174:3300/0 conn(0x7fb26c15d540 msgr2=0x7fb26c15d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:09.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.013+0000 7fb271895700 1 --2- 172.21.15.153:0/968278415 >> v2:172.21.15.174:3300/0 conn(0x7fb26c15d540 0x7fb26c15d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.013+0000 7fb271895700 1 -- 172.21.15.153:0/968278415 >> v1:172.21.15.153:6789/0 conn(0x7fb26c0c8b20 legacy=0x7fb26c0ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.013+0000 7fb271895700 1 -- 172.21.15.153:0/968278415 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb26c0ccbb0 con 0x7fb26c0cd970 2024-08-17T02:26:09.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.013+0000 7fb271895700 1 --2- 172.21.15.153:0/968278415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb26c0cd970 0x7fb26c0c85e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0700f0 tx=0x7fb2680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b74df181df41f87 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.013+0000 7fb271094700 1 -- 172.21.15.153:0/968278415 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb268011630 con 0x7fb26c0cd970 2024-08-17T02:26:09.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.013+0000 7fb271094700 1 -- 172.21.15.153:0/968278415 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2680117b0 con 0x7fb26c0cd970 2024-08-17T02:26:09.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.013+0000 7fb271094700 1 -- 172.21.15.153:0/968278415 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb268011b70 con 0x7fb26c0cd970 2024-08-17T02:26:09.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.017+0000 7fb2742fa700 1 -- 172.21.15.153:0/968278415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb26c0cd970 msgr2=0x7fb26c0c85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.017+0000 7fb2742fa700 1 --2- 172.21.15.153:0/968278415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb26c0cd970 0x7fb26c0c85e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0700f0 tx=0x7fb2680091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.017+0000 7fb2742fa700 1 -- 172.21.15.153:0/968278415 shutdown_connections 2024-08-17T02:26:09.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.017+0000 7fb2742fa700 1 --2- 172.21.15.153:0/968278415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb26c0cd970 0x7fb26c0c85e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.017+0000 7fb2742fa700 1 --2- 172.21.15.153:0/968278415 >> v2:172.21.15.174:3300/0 conn(0x7fb26c15d540 0x7fb26c15d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.017+0000 7fb2742fa700 1 -- 172.21.15.153:0/968278415 >> 172.21.15.153:0/968278415 conn(0x7fb26c0caab0 msgr2=0x7fb26c0caeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:09.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.017+0000 7fb2742fa700 1 -- 172.21.15.153:0/968278415 shutdown_connections 2024-08-17T02:26:09.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.017+0000 7fb2742fa700 1 -- 172.21.15.153:0/968278415 wait complete. 2024-08-17T02:26:09.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.017+0000 7fb2742fa700 1 Processor -- start 2024-08-17T02:26:09.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.017+0000 7fb2742fa700 1 -- start start 2024-08-17T02:26:09.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.017+0000 7fb2742fa700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb26c0c8b20 0x7fb26c164010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.017+0000 7fb2742fa700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb26c0cd970 0x7fb26c0c3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.017+0000 7fb2742fa700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb26c15d540 0x7fb26c0c5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.017+0000 7fb2742fa700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c162150 con 0x7fb26c15d540 2024-08-17T02:26:09.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.017+0000 7fb2742fa700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c161e20 con 0x7fb26c0c8b20 2024-08-17T02:26:09.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.017+0000 7fb2742fa700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c0c3d80 con 0x7fb26c0cd970 2024-08-17T02:26:09.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.017+0000 7fb272897700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb26c15d540 0x7fb26c0c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.017+0000 7fb272897700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb26c15d540 0x7fb26c0c5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33246/0 (socket says 172.21.15.153:33246) 2024-08-17T02:26:09.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.017+0000 7fb272897700 1 -- 172.21.15.153:0/3451182752 learned_addr learned my addr 172.21.15.153:0/3451182752 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:09.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.017+0000 7fb271895700 1 --2- 172.21.15.153:0/3451182752 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb26c0cd970 0x7fb26c0c3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.017+0000 7fb272096700 1 --2- 172.21.15.153:0/3451182752 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb26c0c8b20 0x7fb26c164010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.017+0000 7fb272897700 1 -- 172.21.15.153:0/3451182752 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb26c0cd970 msgr2=0x7fb26c0c3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.017+0000 7fb272897700 1 --2- 172.21.15.153:0/3451182752 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb26c0cd970 0x7fb26c0c3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.017+0000 7fb272897700 1 -- 172.21.15.153:0/3451182752 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb26c0c8b20 msgr2=0x7fb26c164010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.017+0000 7fb272897700 1 --2- 172.21.15.153:0/3451182752 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb26c0c8b20 0x7fb26c164010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.017+0000 7fb272897700 1 -- 172.21.15.153:0/3451182752 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb268009420 con 0x7fb26c15d540 2024-08-17T02:26:09.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.017+0000 7fb271895700 1 --2- 172.21.15.153:0/3451182752 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb26c0cd970 0x7fb26c0c3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:09.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.017+0000 7fb272096700 1 --2- 172.21.15.153:0/3451182752 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb26c0c8b20 0x7fb26c164010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:09.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.017+0000 7fb272897700 1 --2- 172.21.15.153:0/3451182752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb26c15d540 0x7fb26c0c5050 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb26400cd00 tx=0x7fb264001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.017+0000 7fb25e7fc700 1 -- 172.21.15.153:0/3451182752 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26400ab70 con 0x7fb26c15d540 2024-08-17T02:26:09.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.017+0000 7fb2742fa700 1 -- 172.21.15.153:0/3451182752 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb26c0c4060 con 0x7fb26c15d540 2024-08-17T02:26:09.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.017+0000 7fb25e7fc700 1 -- 172.21.15.153:0/3451182752 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26400acd0 con 0x7fb26c15d540 2024-08-17T02:26:09.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.017+0000 7fb25e7fc700 1 -- 172.21.15.153:0/3451182752 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb264007300 con 0x7fb26c15d540 2024-08-17T02:26:09.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.017+0000 7fb2742fa700 1 -- 172.21.15.153:0/3451182752 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb26c0c4340 con 0x7fb26c15d540 2024-08-17T02:26:09.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.021+0000 7fb2742fa700 1 -- 172.21.15.153:0/3451182752 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb26c1622c0 con 0x7fb26c15d540 2024-08-17T02:26:09.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.021+0000 7fb25e7fc700 1 -- 172.21.15.153:0/3451182752 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb2640076f0 con 0x7fb26c15d540 2024-08-17T02:26:09.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.021+0000 7fb25e7fc700 1 --2- 172.21.15.153:0/3451182752 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb250060860 0x7fb250062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.021+0000 7fb25e7fc700 1 -- 172.21.15.153:0/3451182752 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb26407cd30 con 0x7fb26c15d540 2024-08-17T02:26:09.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.021+0000 7fb272096700 1 --2- 172.21.15.153:0/3451182752 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb250060860 0x7fb250062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.021+0000 7fb272096700 1 --2- 172.21.15.153:0/3451182752 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb250060860 0x7fb250062d10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb260006f00 tx=0x7fb260008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.029+0000 7fb25e7fc700 1 -- 172.21.15.153:0/3451182752 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb26404d3a0 con 0x7fb26c15d540 2024-08-17T02:26:09.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.197+0000 7fb2742fa700 1 -- 172.21.15.153:0/3451182752 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb26c0645c0 con 0x7fb26c15d540 2024-08-17T02:26:09.200 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.197+0000 7fb25e7fc700 1 -- 172.21.15.153:0/3451182752 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb2640509c0 con 0x7fb26c15d540 2024-08-17T02:26:09.200 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2024-08-17T02:26:09.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.201+0000 7fb2742fa700 1 -- 172.21.15.153:0/3451182752 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb250060860 msgr2=0x7fb250062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.201+0000 7fb2742fa700 1 --2- 172.21.15.153:0/3451182752 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb250060860 0x7fb250062d10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb260006f00 tx=0x7fb260008040 comp rx=0 tx=0).stop 2024-08-17T02:26:09.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.201+0000 7fb2742fa700 1 -- 172.21.15.153:0/3451182752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb26c15d540 msgr2=0x7fb26c0c5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.201+0000 7fb2742fa700 1 --2- 172.21.15.153:0/3451182752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb26c15d540 0x7fb26c0c5050 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb26400cd00 tx=0x7fb264001ad0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.201+0000 7fb2742fa700 1 -- 172.21.15.153:0/3451182752 shutdown_connections 2024-08-17T02:26:09.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.201+0000 7fb2742fa700 1 --2- 172.21.15.153:0/3451182752 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb250060860 0x7fb250062d10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.201+0000 7fb2742fa700 1 --2- 172.21.15.153:0/3451182752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb26c15d540 0x7fb26c0c5050 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.201+0000 7fb2742fa700 1 --2- 172.21.15.153:0/3451182752 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb26c0cd970 0x7fb26c0c3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.201+0000 7fb2742fa700 1 --2- 172.21.15.153:0/3451182752 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb26c0c8b20 0x7fb26c164010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.201+0000 7fb2742fa700 1 -- 172.21.15.153:0/3451182752 >> 172.21.15.153:0/3451182752 conn(0x7fb26c0caab0 msgr2=0x7fb26c0b1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:09.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.201+0000 7fb2742fa700 1 -- 172.21.15.153:0/3451182752 shutdown_connections 2024-08-17T02:26:09.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.201+0000 7fb2742fa700 1 -- 172.21.15.153:0/3451182752 wait complete. 2024-08-17T02:26:09.220 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:26:09.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.321+0000 7f7f76d6e700 1 Processor -- start 2024-08-17T02:26:09.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.321+0000 7f7f76d6e700 1 -- start start 2024-08-17T02:26:09.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.325+0000 7f7f76d6e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7f700d0010 0x7f7f700d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.325+0000 7f7f76d6e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f7015cea0 0x7f7f7015d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.325+0000 7f7f76d6e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f700cf190 con 0x7f7f70159040 2024-08-17T02:26:09.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.325+0000 7f7f76d6e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f700d09a0 con 0x7f7f700d0010 2024-08-17T02:26:09.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.325+0000 7f7f76d6e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f700ce5e0 con 0x7f7f7015cea0 2024-08-17T02:26:09.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.325+0000 7f7f7556b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7f700d0010 0x7f7f700d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.325+0000 7f7f7556b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7f700d0010 0x7f7f700d0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33254/0 (socket says 172.21.15.153:33254) 2024-08-17T02:26:09.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.325+0000 7f7f7556b700 1 -- 172.21.15.153:0/2192059063 learned_addr learned my addr 172.21.15.153:0/2192059063 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:09.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.325+0000 7f7f7656d700 1 --2- 172.21.15.153:0/2192059063 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f7015cea0 0x7f7f7015d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.325+0000 7f7f7556b700 1 -- 172.21.15.153:0/2192059063 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f7015cea0 msgr2=0x7f7f7015d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:09.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.325+0000 7f7f74d6a700 1 -- 172.21.15.153:0/2192059063 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1393494350 0 0) 0x7f7f700cf190 con 0x7f7f70159040 2024-08-17T02:26:09.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.325+0000 7f7f7556b700 1 --2- 172.21.15.153:0/2192059063 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f7015cea0 0x7f7f7015d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.325+0000 7f7f7556b700 1 -- 172.21.15.153:0/2192059063 >> v1:172.21.15.174:6789/0 conn(0x7f7f70159040 legacy=0x7f7f700cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.325+0000 7f7f7556b700 1 -- 172.21.15.153:0/2192059063 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f700ce860 con 0x7f7f700d0010 2024-08-17T02:26:09.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.325+0000 7f7f7556b700 1 --2- 172.21.15.153:0/2192059063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f700d0010 0x7f7f700d0460 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7f600099b0 tx=0x7f7f60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b45cb61d940b06d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.325+0000 7f7f74d6a700 1 -- 172.21.15.153:0/2192059063 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f60009ea0 con 0x7f7f700d0010 2024-08-17T02:26:09.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.325+0000 7f7f74d6a700 1 -- 172.21.15.153:0/2192059063 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6000b860 con 0x7f7f700d0010 2024-08-17T02:26:09.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.325+0000 7f7f74d6a700 1 -- 172.21.15.153:0/2192059063 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6000bc20 con 0x7f7f700d0010 2024-08-17T02:26:09.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.325+0000 7f7f76d6e700 1 -- 172.21.15.153:0/2192059063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f700d0010 msgr2=0x7f7f700d0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.325+0000 7f7f76d6e700 1 --2- 172.21.15.153:0/2192059063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f700d0010 0x7f7f700d0460 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7f600099b0 tx=0x7f7f60009250 comp rx=0 tx=0).stop 2024-08-17T02:26:09.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.325+0000 7f7f76d6e700 1 -- 172.21.15.153:0/2192059063 shutdown_connections 2024-08-17T02:26:09.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.325+0000 7f7f76d6e700 1 --2- 172.21.15.153:0/2192059063 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f7015cea0 0x7f7f7015d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.325+0000 7f7f76d6e700 1 --2- 172.21.15.153:0/2192059063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f700d0010 0x7f7f700d0460 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.325+0000 7f7f76d6e700 1 -- 172.21.15.153:0/2192059063 >> 172.21.15.153:0/2192059063 conn(0x7f7f70068250 msgr2=0x7f7f70068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:09.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.325+0000 7f7f76d6e700 1 -- 172.21.15.153:0/2192059063 shutdown_connections 2024-08-17T02:26:09.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.325+0000 7f7f76d6e700 1 -- 172.21.15.153:0/2192059063 wait complete. 2024-08-17T02:26:09.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.329+0000 7f7f76d6e700 1 Processor -- start 2024-08-17T02:26:09.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.329+0000 7f7f76d6e700 1 -- start start 2024-08-17T02:26:09.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.329+0000 7f7f76d6e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f700d0010 0x7f7f700ae4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.329+0000 7f7f76d6e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f70159040 0x7f7f700a69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.329+0000 7f7f76d6e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f7015cea0 0x7f7f70151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.329+0000 7f7f76d6e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f700a6ef0 con 0x7f7f700d0010 2024-08-17T02:26:09.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.329+0000 7f7f76d6e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f70169d60 con 0x7f7f7015cea0 2024-08-17T02:26:09.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.329+0000 7f7f76d6e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7016a040 con 0x7f7f70159040 2024-08-17T02:26:09.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.329+0000 7f7f75d6c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f700d0010 0x7f7f700ae4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.329+0000 7f7f75d6c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f700d0010 0x7f7f700ae4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33256/0 (socket says 172.21.15.153:33256) 2024-08-17T02:26:09.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.329+0000 7f7f75d6c700 1 -- 172.21.15.153:0/2238139207 learned_addr learned my addr 172.21.15.153:0/2238139207 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:09.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.329+0000 7f7f7556b700 1 --2- 172.21.15.153:0/2238139207 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f70159040 0x7f7f700a69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.329+0000 7f7f7656d700 1 --2- 172.21.15.153:0/2238139207 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f7015cea0 0x7f7f70151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.329+0000 7f7f75d6c700 1 -- 172.21.15.153:0/2238139207 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f70159040 msgr2=0x7f7f700a69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.329+0000 7f7f75d6c700 1 --2- 172.21.15.153:0/2238139207 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f70159040 0x7f7f700a69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.329+0000 7f7f75d6c700 1 -- 172.21.15.153:0/2238139207 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f7015cea0 msgr2=0x7f7f70151c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.329+0000 7f7f75d6c700 1 --2- 172.21.15.153:0/2238139207 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f7015cea0 0x7f7f70151c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.329+0000 7f7f75d6c700 1 -- 172.21.15.153:0/2238139207 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f600094f0 con 0x7f7f700d0010 2024-08-17T02:26:09.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.329+0000 7f7f7656d700 1 --2- 172.21.15.153:0/2238139207 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f7015cea0 0x7f7f70151c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:09.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.329+0000 7f7f75d6c700 1 --2- 172.21.15.153:0/2238139207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f700d0010 0x7f7f700ae4b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c00c530 tx=0x7f7f6c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.329+0000 7f7f65ffb700 1 -- 172.21.15.153:0/2238139207 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c011590 con 0x7f7f700d0010 2024-08-17T02:26:09.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.329+0000 7f7f65ffb700 1 -- 172.21.15.153:0/2238139207 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6c0116f0 con 0x7f7f700d0010 2024-08-17T02:26:09.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.329+0000 7f7f76d6e700 1 -- 172.21.15.153:0/2238139207 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f7016a320 con 0x7f7f700d0010 2024-08-17T02:26:09.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.329+0000 7f7f65ffb700 1 -- 172.21.15.153:0/2238139207 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c011ab0 con 0x7f7f700d0010 2024-08-17T02:26:09.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.329+0000 7f7f76d6e700 1 -- 172.21.15.153:0/2238139207 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f70169a10 con 0x7f7f700d0010 2024-08-17T02:26:09.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.333+0000 7f7f76d6e700 1 -- 172.21.15.153:0/2238139207 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f700643a0 con 0x7f7f700d0010 2024-08-17T02:26:09.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.333+0000 7f7f65ffb700 1 -- 172.21.15.153:0/2238139207 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7f6c01b3b0 con 0x7f7f700d0010 2024-08-17T02:26:09.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.333+0000 7f7f65ffb700 1 --2- 172.21.15.153:0/2238139207 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7f54060860 0x7f7f54062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.333+0000 7f7f65ffb700 1 -- 172.21.15.153:0/2238139207 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7f6c07c1f0 con 0x7f7f700d0010 2024-08-17T02:26:09.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.333+0000 7f7f7556b700 1 --2- 172.21.15.153:0/2238139207 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7f54060860 0x7f7f54062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.337+0000 7f7f7556b700 1 --2- 172.21.15.153:0/2238139207 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7f54060860 0x7f7f54062d10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7f600099b0 tx=0x7f7f60017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.337+0000 7f7f65ffb700 1 -- 172.21.15.153:0/2238139207 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f7f6c04ca10 con 0x7f7f700d0010 2024-08-17T02:26:09.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.505+0000 7f7f76d6e700 1 -- 172.21.15.153:0/2238139207 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7f700b3480 con 0x7f7f700d0010 2024-08-17T02:26:09.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.505+0000 7f7f65ffb700 1 -- 172.21.15.153:0/2238139207 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f7f6c017090 con 0x7f7f700d0010 2024-08-17T02:26:09.509 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:09.509 INFO:teuthology.orchestra.run.smithi153.stdout:[ 2024-08-17T02:26:09.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-08-17T02:26:09.509 INFO:teuthology.orchestra.run.smithi153.stdout: "poolnum": 1, 2024-08-17T02:26:09.509 INFO:teuthology.orchestra.run.smithi153.stdout: "poolname": ".mgr" 2024-08-17T02:26:09.509 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-17T02:26:09.510 INFO:teuthology.orchestra.run.smithi153.stdout:] 2024-08-17T02:26:09.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.509+0000 7f7f76d6e700 1 -- 172.21.15.153:0/2238139207 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7f54060860 msgr2=0x7f7f54062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.509+0000 7f7f76d6e700 1 --2- 172.21.15.153:0/2238139207 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7f54060860 0x7f7f54062d10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7f600099b0 tx=0x7f7f60017000 comp rx=0 tx=0).stop 2024-08-17T02:26:09.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.509+0000 7f7f76d6e700 1 -- 172.21.15.153:0/2238139207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f700d0010 msgr2=0x7f7f700ae4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.509+0000 7f7f76d6e700 1 --2- 172.21.15.153:0/2238139207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f700d0010 0x7f7f700ae4b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c00c530 tx=0x7f7f6c00c8f0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.509+0000 7f7f76d6e700 1 -- 172.21.15.153:0/2238139207 shutdown_connections 2024-08-17T02:26:09.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.509+0000 7f7f76d6e700 1 --2- 172.21.15.153:0/2238139207 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7f54060860 0x7f7f54062d10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.509+0000 7f7f76d6e700 1 --2- 172.21.15.153:0/2238139207 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f7015cea0 0x7f7f70151c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.509+0000 7f7f76d6e700 1 --2- 172.21.15.153:0/2238139207 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f70159040 0x7f7f700a69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.509+0000 7f7f76d6e700 1 --2- 172.21.15.153:0/2238139207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f700d0010 0x7f7f700ae4b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.509+0000 7f7f76d6e700 1 -- 172.21.15.153:0/2238139207 >> 172.21.15.153:0/2238139207 conn(0x7f7f70068250 msgr2=0x7f7f701535a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:09.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.509+0000 7f7f76d6e700 1 -- 172.21.15.153:0/2238139207 shutdown_connections 2024-08-17T02:26:09.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.509+0000 7f7f76d6e700 1 -- 172.21.15.153:0/2238139207 wait complete. 2024-08-17T02:26:09.523 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:26:09.523 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:26:09.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.629+0000 7f8af8b75700 1 Processor -- start 2024-08-17T02:26:09.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.629+0000 7f8af8b75700 1 -- start start 2024-08-17T02:26:09.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.633+0000 7f8af8b75700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8af4068db0 0x7f8af40b1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.633+0000 7f8af8b75700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8af40cbf40 0x7f8af40ca170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.633+0000 7f8af8b75700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8af40b1680 con 0x7f8af40cbb70 2024-08-17T02:26:09.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.633+0000 7f8af8b75700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af40b0710 con 0x7f8af4068db0 2024-08-17T02:26:09.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.633+0000 7f8af8b75700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af40afb00 con 0x7f8af40cbf40 2024-08-17T02:26:09.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.633+0000 7f8af37fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f8af40cbb70 0x7f8af40686a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:40456/0 (socket says 172.21.15.153:40456) 2024-08-17T02:26:09.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.633+0000 7f8af37fe700 1 -- 172.21.15.153:0/4074093397 learned_addr learned my addr 172.21.15.153:0/4074093397 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:09.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.633+0000 7f8af3fff700 1 --2- 172.21.15.153:0/4074093397 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8af40cbf40 0x7f8af40ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.633+0000 7f8aeaffd700 1 --2- 172.21.15.153:0/4074093397 >> v2:172.21.15.174:3300/0 conn(0x7f8af4068db0 0x7f8af40b1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.633+0000 7f8af2ffd700 1 -- 172.21.15.153:0/4074093397 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3684385240 0 0) 0x7f8ae4001110 con 0x7f8af40cbb70 2024-08-17T02:26:09.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.633+0000 7f8af2ffd700 1 -- 172.21.15.153:0/4074093397 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ad4003570 con 0x7f8af40cbb70 2024-08-17T02:26:09.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.633+0000 7f8aeaffd700 1 -- 172.21.15.153:0/4074093397 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8af40cbf40 msgr2=0x7f8af40ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:09.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.633+0000 7f8aeaffd700 1 --2- 172.21.15.153:0/4074093397 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8af40cbf40 0x7f8af40ca170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.633+0000 7f8aeaffd700 1 -- 172.21.15.153:0/4074093397 >> v1:172.21.15.153:6789/0 conn(0x7f8af40cbb70 legacy=0x7f8af40686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.633+0000 7f8aeaffd700 1 -- 172.21.15.153:0/4074093397 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af40afde0 con 0x7f8af4068db0 2024-08-17T02:26:09.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.633+0000 7f8aeaffd700 1 --2- 172.21.15.153:0/4074093397 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8af4068db0 0x7f8af40b1140 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8adc0098e0 tx=0x7f8adc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b207aa786275b423 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.633+0000 7f8af2ffd700 1 -- 172.21.15.153:0/4074093397 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc011630 con 0x7f8af4068db0 2024-08-17T02:26:09.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.633+0000 7f8af2ffd700 1 -- 172.21.15.153:0/4074093397 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8adc011790 con 0x7f8af4068db0 2024-08-17T02:26:09.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.633+0000 7f8af2ffd700 1 -- 172.21.15.153:0/4074093397 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc011b10 con 0x7f8af4068db0 2024-08-17T02:26:09.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.637+0000 7f8af8b75700 1 -- 172.21.15.153:0/4074093397 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8af4068db0 msgr2=0x7f8af40b1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.637+0000 7f8af8b75700 1 --2- 172.21.15.153:0/4074093397 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8af4068db0 0x7f8af40b1140 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8adc0098e0 tx=0x7f8adc0091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.637+0000 7f8af8b75700 1 -- 172.21.15.153:0/4074093397 shutdown_connections 2024-08-17T02:26:09.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.637+0000 7f8af8b75700 1 --2- 172.21.15.153:0/4074093397 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8af40cbf40 0x7f8af40ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.637+0000 7f8af8b75700 1 --2- 172.21.15.153:0/4074093397 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8af4068db0 0x7f8af40b1140 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.637+0000 7f8af8b75700 1 -- 172.21.15.153:0/4074093397 >> 172.21.15.153:0/4074093397 conn(0x7f8af40ccfe0 msgr2=0x7f8af406d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:09.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.637+0000 7f8af8b75700 1 -- 172.21.15.153:0/4074093397 shutdown_connections 2024-08-17T02:26:09.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.637+0000 7f8af8b75700 1 -- 172.21.15.153:0/4074093397 wait complete. 2024-08-17T02:26:09.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.637+0000 7f8af8b75700 1 Processor -- start 2024-08-17T02:26:09.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.637+0000 7f8af8b75700 1 -- start start 2024-08-17T02:26:09.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.641+0000 7f8af8b75700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8af4068db0 0x7f8af4143040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.641+0000 7f8af8b75700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8af40cbb70 0x7f8af40c15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.641+0000 7f8af8b75700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8af40cbf40 0x7f8af4067a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.641+0000 7f8af8b75700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af4143580 con 0x7f8af40cbb70 2024-08-17T02:26:09.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.641+0000 7f8af8b75700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af4150500 con 0x7f8af40cbf40 2024-08-17T02:26:09.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.641+0000 7f8af8b75700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af4155f30 con 0x7f8af4068db0 2024-08-17T02:26:09.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.641+0000 7f8aeaffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8af40cbb70 0x7f8af40c15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.641+0000 7f8aeaffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8af40cbb70 0x7f8af40c15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33258/0 (socket says 172.21.15.153:33258) 2024-08-17T02:26:09.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.641+0000 7f8aeaffd700 1 -- 172.21.15.153:0/1199933521 learned_addr learned my addr 172.21.15.153:0/1199933521 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:09.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.641+0000 7f8af37fe700 1 --2- 172.21.15.153:0/1199933521 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8af4068db0 0x7f8af4143040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.641+0000 7f8af3fff700 1 --2- 172.21.15.153:0/1199933521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8af40cbf40 0x7f8af4067a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.641+0000 7f8aeaffd700 1 -- 172.21.15.153:0/1199933521 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8af4068db0 msgr2=0x7f8af4143040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.641+0000 7f8aeaffd700 1 --2- 172.21.15.153:0/1199933521 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8af4068db0 0x7f8af4143040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.641+0000 7f8aeaffd700 1 -- 172.21.15.153:0/1199933521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8af40cbf40 msgr2=0x7f8af4067a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.641+0000 7f8aeaffd700 1 --2- 172.21.15.153:0/1199933521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8af40cbf40 0x7f8af4067a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.641+0000 7f8aeaffd700 1 -- 172.21.15.153:0/1199933521 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8adc009420 con 0x7f8af40cbb70 2024-08-17T02:26:09.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.641+0000 7f8af37fe700 1 --2- 172.21.15.153:0/1199933521 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8af4068db0 0x7f8af4143040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:09.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.641+0000 7f8aeaffd700 1 --2- 172.21.15.153:0/1199933521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8af40cbb70 0x7f8af40c15a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8adc011f00 tx=0x7f8adc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.641+0000 7f8aebfff700 1 -- 172.21.15.153:0/1199933521 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc011b10 con 0x7f8af40cbb70 2024-08-17T02:26:09.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.641+0000 7f8aebfff700 1 -- 172.21.15.153:0/1199933521 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8adc000c90 con 0x7f8af40cbb70 2024-08-17T02:26:09.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.641+0000 7f8af8b75700 1 -- 172.21.15.153:0/1199933521 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af4150a20 con 0x7f8af40cbb70 2024-08-17T02:26:09.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.641+0000 7f8aebfff700 1 -- 172.21.15.153:0/1199933521 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc01a6a0 con 0x7f8af40cbb70 2024-08-17T02:26:09.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.641+0000 7f8af8b75700 1 -- 172.21.15.153:0/1199933521 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af4155970 con 0x7f8af40cbb70 2024-08-17T02:26:09.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.641+0000 7f8af8b75700 1 -- 172.21.15.153:0/1199933521 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8af4150bb0 con 0x7f8af40cbb70 2024-08-17T02:26:09.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.641+0000 7f8aebfff700 1 -- 172.21.15.153:0/1199933521 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8adc01aa10 con 0x7f8af40cbb70 2024-08-17T02:26:09.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.645+0000 7f8aebfff700 1 --2- 172.21.15.153:0/1199933521 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8ad8060860 0x7f8ad8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.645+0000 7f8aebfff700 1 -- 172.21.15.153:0/1199933521 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8adc07e080 con 0x7f8af40cbb70 2024-08-17T02:26:09.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.645+0000 7f8af37fe700 1 --2- 172.21.15.153:0/1199933521 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8ad8060860 0x7f8ad8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.645+0000 7f8af37fe700 1 --2- 172.21.15.153:0/1199933521 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8ad8060860 0x7f8ad8062d10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8ae4001270 tx=0x7f8ae4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.649+0000 7f8aebfff700 1 -- 172.21.15.153:0/1199933521 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f8adc04e820 con 0x7f8af40cbb70 2024-08-17T02:26:09.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:09.813+0000 7f8af8b75700 1 -- 172.21.15.153:0/1199933521 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8af40644b0 con 0x7f8af40cbb70 2024-08-17T02:26:10.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.717+0000 7f8aebfff700 1 -- 172.21.15.153:0/1199933521 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8adc051e40 con 0x7f8af40cbb70 2024-08-17T02:26:10.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.721+0000 7f8af8b75700 1 -- 172.21.15.153:0/1199933521 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8ad8060860 msgr2=0x7f8ad8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.721+0000 7f8af8b75700 1 --2- 172.21.15.153:0/1199933521 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8ad8060860 0x7f8ad8062d10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8ae4001270 tx=0x7f8ae4009040 comp rx=0 tx=0).stop 2024-08-17T02:26:10.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.721+0000 7f8af8b75700 1 -- 172.21.15.153:0/1199933521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8af40cbb70 msgr2=0x7f8af40c15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.721+0000 7f8af8b75700 1 --2- 172.21.15.153:0/1199933521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8af40cbb70 0x7f8af40c15a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8adc011f00 tx=0x7f8adc017000 comp rx=0 tx=0).stop 2024-08-17T02:26:10.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.721+0000 7f8af8b75700 1 -- 172.21.15.153:0/1199933521 shutdown_connections 2024-08-17T02:26:10.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.721+0000 7f8af8b75700 1 --2- 172.21.15.153:0/1199933521 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8ad8060860 0x7f8ad8062d10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.721+0000 7f8af8b75700 1 --2- 172.21.15.153:0/1199933521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8af40cbf40 0x7f8af4067a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.721+0000 7f8af8b75700 1 --2- 172.21.15.153:0/1199933521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8af40cbb70 0x7f8af40c15a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.721+0000 7f8af8b75700 1 --2- 172.21.15.153:0/1199933521 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8af4068db0 0x7f8af4143040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.721+0000 7f8af8b75700 1 -- 172.21.15.153:0/1199933521 >> 172.21.15.153:0/1199933521 conn(0x7f8af40ccfe0 msgr2=0x7f8af40ad6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:10.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.725+0000 7f8af8b75700 1 -- 172.21.15.153:0/1199933521 shutdown_connections 2024-08-17T02:26:10.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.725+0000 7f8af8b75700 1 -- 172.21.15.153:0/1199933521 wait complete. 2024-08-17T02:26:10.733 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' created 2024-08-17T02:26:10.744 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:26:10.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.857+0000 7f83bec9d700 1 Processor -- start 2024-08-17T02:26:10.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.857+0000 7f83bec9d700 1 -- start start 2024-08-17T02:26:10.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.857+0000 7f83bec9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f83b81534b0 0x7f83b80cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.857+0000 7f83bec9d700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83b80ce7f0 con 0x7f83b80b21d0 2024-08-17T02:26:10.863 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.857+0000 7f83bec9d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83b80cea90 con 0x7f83b8153880 2024-08-17T02:26:10.863 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.857+0000 7f83bec9d700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83b80ced70 con 0x7f83b81534b0 2024-08-17T02:26:10.863 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.857+0000 7f83bdc9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f83b81534b0 0x7f83b80cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.863 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.857+0000 7f83be49c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f83b80b21d0 0x7f83b80d0130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:40458/0 (socket says 172.21.15.153:40458) 2024-08-17T02:26:10.863 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.857+0000 7f83be49c700 1 -- 172.21.15.153:0/118129570 learned_addr learned my addr 172.21.15.153:0/118129570 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:10.863 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.857+0000 7f83bcc99700 1 -- 172.21.15.153:0/118129570 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 689395035 0 0) 0x7f83b80ce7f0 con 0x7f83b80b21d0 2024-08-17T02:26:10.863 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.861+0000 7f83bcc99700 1 -- 172.21.15.153:0/118129570 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83a4003570 con 0x7f83b80b21d0 2024-08-17T02:26:10.863 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.861+0000 7f83bdc9b700 1 -- 172.21.15.153:0/118129570 >> v1:172.21.15.174:6789/0 conn(0x7f83b8153880 legacy=0x7f83b80b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.863 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.861+0000 7f83bdc9b700 1 -- 172.21.15.153:0/118129570 >> v1:172.21.15.153:6789/0 conn(0x7f83b80b21d0 legacy=0x7f83b80d0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.863 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.861+0000 7f83bdc9b700 1 -- 172.21.15.153:0/118129570 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b80cf050 con 0x7f83b81534b0 2024-08-17T02:26:10.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.861+0000 7f83bdc9b700 1 --2- 172.21.15.153:0/118129570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83b81534b0 0x7f83b80cf570 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f83a80098e0 tx=0x7f83a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=669cdd8d6eb924e7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.861+0000 7f83bcc99700 1 -- 172.21.15.153:0/118129570 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a800b640 con 0x7f83b81534b0 2024-08-17T02:26:10.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.861+0000 7f83bcc99700 1 -- 172.21.15.153:0/118129570 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a800b7a0 con 0x7f83b81534b0 2024-08-17T02:26:10.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.861+0000 7f83bcc99700 1 -- 172.21.15.153:0/118129570 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a800bb40 con 0x7f83b81534b0 2024-08-17T02:26:10.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.861+0000 7f83bec9d700 1 -- 172.21.15.153:0/118129570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83b81534b0 msgr2=0x7f83b80cf570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.861+0000 7f83bec9d700 1 --2- 172.21.15.153:0/118129570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83b81534b0 0x7f83b80cf570 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f83a80098e0 tx=0x7f83a80091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.861+0000 7f83bec9d700 1 -- 172.21.15.153:0/118129570 shutdown_connections 2024-08-17T02:26:10.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.861+0000 7f83bec9d700 1 --2- 172.21.15.153:0/118129570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83b81534b0 0x7f83b80cf570 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.861+0000 7f83bec9d700 1 -- 172.21.15.153:0/118129570 >> 172.21.15.153:0/118129570 conn(0x7f83b8066e00 msgr2=0x7f83b8067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:10.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.861+0000 7f83bec9d700 1 -- 172.21.15.153:0/118129570 shutdown_connections 2024-08-17T02:26:10.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.861+0000 7f83bec9d700 1 -- 172.21.15.153:0/118129570 wait complete. 2024-08-17T02:26:10.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.861+0000 7f83bec9d700 1 Processor -- start 2024-08-17T02:26:10.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.861+0000 7f83bec9d700 1 -- start start 2024-08-17T02:26:10.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.861+0000 7f83bec9d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83b80b21d0 0x7f83b8157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.861+0000 7f83bec9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83b81534b0 0x7f83b816a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.861+0000 7f83bec9d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83b8153880 0x7f83b814da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.861+0000 7f83bec9d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b8157830 con 0x7f83b81534b0 2024-08-17T02:26:10.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.861+0000 7f83bec9d700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b8154ef0 con 0x7f83b8153880 2024-08-17T02:26:10.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.861+0000 7f83bec9d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b81551d0 con 0x7f83b80b21d0 2024-08-17T02:26:10.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.861+0000 7f83bd49a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83b81534b0 0x7f83b816a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.865+0000 7f83bd49a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83b81534b0 0x7f83b816a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33286/0 (socket says 172.21.15.153:33286) 2024-08-17T02:26:10.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.865+0000 7f83bd49a700 1 -- 172.21.15.153:0/2244132034 learned_addr learned my addr 172.21.15.153:0/2244132034 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:10.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.865+0000 7f83bdc9b700 1 --2- 172.21.15.153:0/2244132034 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83b80b21d0 0x7f83b8157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.865+0000 7f83be49c700 1 --2- 172.21.15.153:0/2244132034 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83b8153880 0x7f83b814da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.865+0000 7f83bd49a700 1 -- 172.21.15.153:0/2244132034 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83b80b21d0 msgr2=0x7f83b8157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.865+0000 7f83bd49a700 1 --2- 172.21.15.153:0/2244132034 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83b80b21d0 0x7f83b8157150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.865+0000 7f83bd49a700 1 -- 172.21.15.153:0/2244132034 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83b8153880 msgr2=0x7f83b814da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.865+0000 7f83bd49a700 1 --2- 172.21.15.153:0/2244132034 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83b8153880 0x7f83b814da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.865+0000 7f83bd49a700 1 -- 172.21.15.153:0/2244132034 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a8009420 con 0x7f83b81534b0 2024-08-17T02:26:10.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.865+0000 7f83bd49a700 1 --2- 172.21.15.153:0/2244132034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83b81534b0 0x7f83b816a310 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f83b400c4e0 tx=0x7f83b400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.865+0000 7f83adffb700 1 -- 172.21.15.153:0/2244132034 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b4011590 con 0x7f83b81534b0 2024-08-17T02:26:10.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.865+0000 7f83adffb700 1 -- 172.21.15.153:0/2244132034 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b4011710 con 0x7f83b81534b0 2024-08-17T02:26:10.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.865+0000 7f83bec9d700 1 -- 172.21.15.153:0/2244132034 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b81554b0 con 0x7f83b81534b0 2024-08-17T02:26:10.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.865+0000 7f83adffb700 1 -- 172.21.15.153:0/2244132034 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b4011ad0 con 0x7f83b81534b0 2024-08-17T02:26:10.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.865+0000 7f83bec9d700 1 -- 172.21.15.153:0/2244132034 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b814df80 con 0x7f83b81534b0 2024-08-17T02:26:10.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.865+0000 7f83bec9d700 1 -- 172.21.15.153:0/2244132034 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b81559b0 con 0x7f83b81534b0 2024-08-17T02:26:10.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.865+0000 7f83adffb700 1 -- 172.21.15.153:0/2244132034 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f83b401b3b0 con 0x7f83b81534b0 2024-08-17T02:26:10.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.869+0000 7f83adffb700 1 --2- 172.21.15.153:0/2244132034 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f839c060890 0x7f839c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.869+0000 7f83adffb700 1 -- 172.21.15.153:0/2244132034 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f83b407bdc0 con 0x7f83b81534b0 2024-08-17T02:26:10.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.869+0000 7f83bdc9b700 1 --2- 172.21.15.153:0/2244132034 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f839c060890 0x7f839c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.869+0000 7f83bdc9b700 1 --2- 172.21.15.153:0/2244132034 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f839c060890 0x7f839c062d40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f83a80093f0 tx=0x7f83a8017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:10.873+0000 7f83adffb700 1 -- 172.21.15.153:0/2244132034 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f83b404c3f0 con 0x7f83b81534b0 2024-08-17T02:26:11.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.041+0000 7f83bec9d700 1 -- 172.21.15.153:0/2244132034 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f83b8070d10 con 0x7f83b81534b0 2024-08-17T02:26:11.729 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.725+0000 7f83adffb700 1 -- 172.21.15.153:0/2244132034 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7f83b4017020 con 0x7f83b81534b0 2024-08-17T02:26:11.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.741+0000 7f83bec9d700 1 -- 172.21.15.153:0/2244132034 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f839c060890 msgr2=0x7f839c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.741+0000 7f83bec9d700 1 --2- 172.21.15.153:0/2244132034 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f839c060890 0x7f839c062d40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f83a80093f0 tx=0x7f83a8017000 comp rx=0 tx=0).stop 2024-08-17T02:26:11.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.741+0000 7f83bec9d700 1 -- 172.21.15.153:0/2244132034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83b81534b0 msgr2=0x7f83b816a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.741+0000 7f83bec9d700 1 --2- 172.21.15.153:0/2244132034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83b81534b0 0x7f83b816a310 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f83b400c4e0 tx=0x7f83b400c7f0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.741+0000 7f83bec9d700 1 -- 172.21.15.153:0/2244132034 shutdown_connections 2024-08-17T02:26:11.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.741+0000 7f83bec9d700 1 --2- 172.21.15.153:0/2244132034 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f839c060890 0x7f839c062d40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.741+0000 7f83bec9d700 1 --2- 172.21.15.153:0/2244132034 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83b8153880 0x7f83b814da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.741+0000 7f83bec9d700 1 --2- 172.21.15.153:0/2244132034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83b81534b0 0x7f83b816a310 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.741+0000 7f83bec9d700 1 --2- 172.21.15.153:0/2244132034 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83b80b21d0 0x7f83b8157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.741+0000 7f83bec9d700 1 -- 172.21.15.153:0/2244132034 >> 172.21.15.153:0/2244132034 conn(0x7f83b8066e00 msgr2=0x7f83b80b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:11.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.741+0000 7f83bec9d700 1 -- 172.21.15.153:0/2244132034 shutdown_connections 2024-08-17T02:26:11.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.741+0000 7f83bec9d700 1 -- 172.21.15.153:0/2244132034 wait complete. 2024-08-17T02:26:11.746 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' created 2024-08-17T02:26:11.761 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:26:11.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.861+0000 7efe3b59e700 1 Processor -- start 2024-08-17T02:26:11.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.861+0000 7efe3b59e700 1 -- start start 2024-08-17T02:26:11.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.861+0000 7efe3b59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efe3c13f680 0x7efe3c0aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.861+0000 7efe3b59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe3c13fa50 0x7efe3c0ad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.861+0000 7efe3b59e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe3c0afc70 con 0x7efe3c0b0100 2024-08-17T02:26:11.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.861+0000 7efe3b59e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe3c0adc00 con 0x7efe3c13f680 2024-08-17T02:26:11.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.861+0000 7efe3b59e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c0af060 con 0x7efe3c13fa50 2024-08-17T02:26:11.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.861+0000 7efe3a59c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efe3c13f680 0x7efe3c0aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.861+0000 7efe3a59c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efe3c13f680 0x7efe3c0aea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33298/0 (socket says 172.21.15.153:33298) 2024-08-17T02:26:11.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.861+0000 7efe3a59c700 1 -- 172.21.15.153:0/2845394152 learned_addr learned my addr 172.21.15.153:0/2845394152 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:11.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.861+0000 7efe39d9b700 1 --2- 172.21.15.153:0/2845394152 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe3c13fa50 0x7efe3c0ad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.861+0000 7efe3a59c700 1 -- 172.21.15.153:0/2845394152 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe3c13fa50 msgr2=0x7efe3c0ad6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:11.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.861+0000 7efe3a59c700 1 --2- 172.21.15.153:0/2845394152 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe3c13fa50 0x7efe3c0ad6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.861+0000 7efe3a59c700 1 -- 172.21.15.153:0/2845394152 >> v1:172.21.15.174:6789/0 conn(0x7efe3c0b0100 legacy=0x7efe3c06e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:11.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.861+0000 7efe3a59c700 1 -- 172.21.15.153:0/2845394152 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe3c0af340 con 0x7efe3c13f680 2024-08-17T02:26:11.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.861+0000 7efe39d9b700 1 --2- 172.21.15.153:0/2845394152 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe3c13fa50 0x7efe3c0ad6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:11.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.865+0000 7efe3a59c700 1 --2- 172.21.15.153:0/2845394152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe3c13f680 0x7efe3c0aea80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efe2c0099b0 tx=0x7efe2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d7e77dabde6a6c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:11.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.865+0000 7efe3959a700 1 -- 172.21.15.153:0/2845394152 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c00b820 con 0x7efe3c13f680 2024-08-17T02:26:11.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.865+0000 7efe3959a700 1 -- 172.21.15.153:0/2845394152 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2c00b980 con 0x7efe3c13f680 2024-08-17T02:26:11.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.865+0000 7efe3959a700 1 -- 172.21.15.153:0/2845394152 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c00bd20 con 0x7efe3c13f680 2024-08-17T02:26:11.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.865+0000 7efe3b59e700 1 -- 172.21.15.153:0/2845394152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe3c13f680 msgr2=0x7efe3c0aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.865+0000 7efe3b59e700 1 --2- 172.21.15.153:0/2845394152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe3c13f680 0x7efe3c0aea80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efe2c0099b0 tx=0x7efe2c009250 comp rx=0 tx=0).stop 2024-08-17T02:26:11.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.865+0000 7efe3b59e700 1 -- 172.21.15.153:0/2845394152 shutdown_connections 2024-08-17T02:26:11.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.865+0000 7efe3b59e700 1 --2- 172.21.15.153:0/2845394152 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe3c13fa50 0x7efe3c0ad6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.865+0000 7efe3b59e700 1 --2- 172.21.15.153:0/2845394152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe3c13f680 0x7efe3c0aea80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.865+0000 7efe3b59e700 1 -- 172.21.15.153:0/2845394152 >> 172.21.15.153:0/2845394152 conn(0x7efe3c0678a0 msgr2=0x7efe3c067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:11.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.865+0000 7efe3b59e700 1 -- 172.21.15.153:0/2845394152 shutdown_connections 2024-08-17T02:26:11.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.865+0000 7efe3b59e700 1 -- 172.21.15.153:0/2845394152 wait complete. 2024-08-17T02:26:11.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.869+0000 7efe3b59e700 1 Processor -- start 2024-08-17T02:26:11.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.869+0000 7efe3b59e700 1 -- start start 2024-08-17T02:26:11.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.869+0000 7efe3b59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe3c0b0100 0x7efe3c0aaa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.869+0000 7efe3b59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe3c13f680 0x7efe3c138590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.869+0000 7efe3b59e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe3c13fa50 0x7efe3c138ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.869+0000 7efe3b59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c1674b0 con 0x7efe3c0b0100 2024-08-17T02:26:11.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.869+0000 7efe3b59e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c167790 con 0x7efe3c13fa50 2024-08-17T02:26:11.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.869+0000 7efe3b59e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c167a70 con 0x7efe3c13f680 2024-08-17T02:26:11.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.869+0000 7efe3a59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe3c0b0100 0x7efe3c0aaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.869+0000 7efe3a59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe3c0b0100 0x7efe3c0aaa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33304/0 (socket says 172.21.15.153:33304) 2024-08-17T02:26:11.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.869+0000 7efe3a59c700 1 -- 172.21.15.153:0/988253540 learned_addr learned my addr 172.21.15.153:0/988253540 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:11.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.869+0000 7efe39d9b700 1 --2- 172.21.15.153:0/988253540 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe3c13f680 0x7efe3c138590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.869+0000 7efe3ad9d700 1 --2- 172.21.15.153:0/988253540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe3c13fa50 0x7efe3c138ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.869+0000 7efe3a59c700 1 -- 172.21.15.153:0/988253540 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe3c13f680 msgr2=0x7efe3c138590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.869+0000 7efe3a59c700 1 --2- 172.21.15.153:0/988253540 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe3c13f680 0x7efe3c138590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.869+0000 7efe3a59c700 1 -- 172.21.15.153:0/988253540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe3c13fa50 msgr2=0x7efe3c138ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.869+0000 7efe3a59c700 1 --2- 172.21.15.153:0/988253540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe3c13fa50 0x7efe3c138ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.869+0000 7efe3a59c700 1 -- 172.21.15.153:0/988253540 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2c0094f0 con 0x7efe3c0b0100 2024-08-17T02:26:11.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.873+0000 7efe3a59c700 1 --2- 172.21.15.153:0/988253540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe3c0b0100 0x7efe3c0aaa10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efe2c009290 tx=0x7efe2c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:11.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.873+0000 7efe2a7fc700 1 -- 172.21.15.153:0/988253540 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c011c10 con 0x7efe3c0b0100 2024-08-17T02:26:11.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.873+0000 7efe2a7fc700 1 -- 172.21.15.153:0/988253540 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2c020070 con 0x7efe3c0b0100 2024-08-17T02:26:11.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.873+0000 7efe3b59e700 1 -- 172.21.15.153:0/988253540 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe3c167d50 con 0x7efe3c0b0100 2024-08-17T02:26:11.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.873+0000 7efe2a7fc700 1 -- 172.21.15.153:0/988253540 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c01b450 con 0x7efe3c0b0100 2024-08-17T02:26:11.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.873+0000 7efe3b59e700 1 -- 172.21.15.153:0/988253540 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe3c0aaf50 con 0x7efe3c0b0100 2024-08-17T02:26:11.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.873+0000 7efe3b59e700 1 -- 172.21.15.153:0/988253540 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe3c064330 con 0x7efe3c0b0100 2024-08-17T02:26:11.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.873+0000 7efe2a7fc700 1 -- 172.21.15.153:0/988253540 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7efe2c022030 con 0x7efe3c0b0100 2024-08-17T02:26:11.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.873+0000 7efe2a7fc700 1 --2- 172.21.15.153:0/988253540 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7efe1c060860 0x7efe1c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.873+0000 7efe2a7fc700 1 -- 172.21.15.153:0/988253540 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5605+0+0 (secure 0 0 0) 0x7efe2c07ea70 con 0x7efe3c0b0100 2024-08-17T02:26:11.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.873+0000 7efe39d9b700 1 --2- 172.21.15.153:0/988253540 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7efe1c060860 0x7efe1c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.877+0000 7efe39d9b700 1 --2- 172.21.15.153:0/988253540 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7efe1c060860 0x7efe1c062d10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efe3c0cbc70 tx=0x7efe30008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:11.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:11.885+0000 7efe2a7fc700 1 -- 172.21.15.153:0/988253540 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7efe2c04ee80 con 0x7efe3c0b0100 2024-08-17T02:26:12.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.077+0000 7efe3b59e700 1 -- 172.21.15.153:0/988253540 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7efe3c064330 con 0x7efe3c0b0100 2024-08-17T02:26:12.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.765+0000 7efe2a7fc700 1 -- 172.21.15.153:0/988253540 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7efe2c0524a0 con 0x7efe3c0b0100 2024-08-17T02:26:12.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.773+0000 7efe3b59e700 1 -- 172.21.15.153:0/988253540 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7efe1c060860 msgr2=0x7efe1c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.773+0000 7efe3b59e700 1 --2- 172.21.15.153:0/988253540 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7efe1c060860 0x7efe1c062d10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efe3c0cbc70 tx=0x7efe30008040 comp rx=0 tx=0).stop 2024-08-17T02:26:12.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.773+0000 7efe3b59e700 1 -- 172.21.15.153:0/988253540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe3c0b0100 msgr2=0x7efe3c0aaa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.773+0000 7efe3b59e700 1 --2- 172.21.15.153:0/988253540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe3c0b0100 0x7efe3c0aaa10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efe2c009290 tx=0x7efe2c016000 comp rx=0 tx=0).stop 2024-08-17T02:26:12.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.773+0000 7efe3b59e700 1 -- 172.21.15.153:0/988253540 shutdown_connections 2024-08-17T02:26:12.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.773+0000 7efe3b59e700 1 --2- 172.21.15.153:0/988253540 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7efe1c060860 0x7efe1c062d10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.773+0000 7efe3b59e700 1 --2- 172.21.15.153:0/988253540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe3c13fa50 0x7efe3c138ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.773+0000 7efe3b59e700 1 --2- 172.21.15.153:0/988253540 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe3c13f680 0x7efe3c138590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.773+0000 7efe3b59e700 1 --2- 172.21.15.153:0/988253540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe3c0b0100 0x7efe3c0aaa10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.773+0000 7efe3b59e700 1 -- 172.21.15.153:0/988253540 >> 172.21.15.153:0/988253540 conn(0x7efe3c0678a0 msgr2=0x7efe3c13dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:12.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.777+0000 7efe3b59e700 1 -- 172.21.15.153:0/988253540 shutdown_connections 2024-08-17T02:26:12.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.777+0000 7efe3b59e700 1 -- 172.21.15.153:0/988253540 wait complete. 2024-08-17T02:26:12.781 INFO:teuthology.orchestra.run.smithi153.stderr:new fs with metadata pool 2 and data pool 3 2024-08-17T02:26:12.792 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:12.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.889+0000 7f7192330700 1 Processor -- start 2024-08-17T02:26:12.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.889+0000 7f7192330700 1 -- start start 2024-08-17T02:26:12.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.889+0000 7f7192330700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f718c155d20 0x7f718c0b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.889+0000 7f7192330700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f718c06df10 0x7f718c06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.889+0000 7f7192330700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f718c06e870 con 0x7f718c0ad7c0 2024-08-17T02:26:12.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.889+0000 7f7192330700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f718c0adc10 con 0x7f718c06df10 2024-08-17T02:26:12.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.889+0000 7f7192330700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f718c0af2b0 con 0x7f718c155d20 2024-08-17T02:26:12.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.889+0000 7f7191b2f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f718c06df10 0x7f718c06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.889+0000 7f7190b2d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f718c0ad7c0 0x7f718c0aea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35628/0 (socket says 172.21.15.153:35628) 2024-08-17T02:26:12.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.889+0000 7f7190b2d700 1 -- 172.21.15.153:0/262348376 learned_addr learned my addr 172.21.15.153:0/262348376 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:12.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.889+0000 7f719132e700 1 --2- 172.21.15.153:0/262348376 >> v2:172.21.15.174:3300/0 conn(0x7f718c155d20 0x7f718c0b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.889+0000 7f7191b2f700 1 -- 172.21.15.153:0/262348376 >> v2:172.21.15.174:3300/0 conn(0x7f718c155d20 msgr2=0x7f718c0b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:12.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.889+0000 7f7191b2f700 1 --2- 172.21.15.153:0/262348376 >> v2:172.21.15.174:3300/0 conn(0x7f718c155d20 0x7f718c0b0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.889+0000 7f7183fff700 1 -- 172.21.15.153:0/262348376 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3457577747 0 0) 0x7f718c06e870 con 0x7f718c0ad7c0 2024-08-17T02:26:12.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.889+0000 7f7191b2f700 1 -- 172.21.15.153:0/262348376 >> v1:172.21.15.153:6789/0 conn(0x7f718c0ad7c0 legacy=0x7f718c0aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.889+0000 7f7191b2f700 1 -- 172.21.15.153:0/262348376 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f718c0af590 con 0x7f718c06df10 2024-08-17T02:26:12.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.893+0000 7f7191b2f700 1 --2- 172.21.15.153:0/262348376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f718c06df10 0x7f718c06e330 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f718c0b1d50 tx=0x7f717c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95aa74cb7d0c4a63 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:12.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.893+0000 7f7183fff700 1 -- 172.21.15.153:0/262348376 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c00b6b0 con 0x7f718c06df10 2024-08-17T02:26:12.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.893+0000 7f7183fff700 1 -- 172.21.15.153:0/262348376 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717c00b810 con 0x7f718c06df10 2024-08-17T02:26:12.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.893+0000 7f7183fff700 1 -- 172.21.15.153:0/262348376 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c00bbb0 con 0x7f718c06df10 2024-08-17T02:26:12.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.893+0000 7f7192330700 1 -- 172.21.15.153:0/262348376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f718c06df10 msgr2=0x7f718c06e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.893+0000 7f7192330700 1 --2- 172.21.15.153:0/262348376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f718c06df10 0x7f718c06e330 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f718c0b1d50 tx=0x7f717c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.893+0000 7f7192330700 1 -- 172.21.15.153:0/262348376 shutdown_connections 2024-08-17T02:26:12.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.893+0000 7f7192330700 1 --2- 172.21.15.153:0/262348376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f718c06df10 0x7f718c06e330 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.893+0000 7f7192330700 1 --2- 172.21.15.153:0/262348376 >> v2:172.21.15.174:3300/0 conn(0x7f718c155d20 0x7f718c0b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.893+0000 7f7192330700 1 -- 172.21.15.153:0/262348376 >> 172.21.15.153:0/262348376 conn(0x7f718c0678d0 msgr2=0x7f718c067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:12.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.893+0000 7f7192330700 1 -- 172.21.15.153:0/262348376 shutdown_connections 2024-08-17T02:26:12.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.893+0000 7f7192330700 1 -- 172.21.15.153:0/262348376 wait complete. 2024-08-17T02:26:12.902 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.893+0000 7f7192330700 1 Processor -- start 2024-08-17T02:26:12.902 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.893+0000 7f7192330700 1 -- start start 2024-08-17T02:26:12.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.897+0000 7f7192330700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f718c06df10 0x7f718c139ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.897+0000 7f7192330700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f718c0ad7c0 0x7f718c142d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.897+0000 7f7192330700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f718c155d20 0x7f718c149290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.897+0000 7f7192330700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718c142890 con 0x7f718c06df10 2024-08-17T02:26:12.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.897+0000 7f7192330700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718c1588a0 con 0x7f718c0ad7c0 2024-08-17T02:26:12.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.897+0000 7f7192330700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f718c158b40 con 0x7f718c155d20 2024-08-17T02:26:12.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.897+0000 7f719132e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f718c06df10 0x7f718c139ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.897+0000 7f719132e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f718c06df10 0x7f718c139ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57202/0 (socket says 172.21.15.153:57202) 2024-08-17T02:26:12.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.897+0000 7f719132e700 1 -- 172.21.15.153:0/852115318 learned_addr learned my addr 172.21.15.153:0/852115318 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:12.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.897+0000 7f7190b2d700 1 --2- 172.21.15.153:0/852115318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f718c0ad7c0 0x7f718c142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.897+0000 7f7191b2f700 1 --2- 172.21.15.153:0/852115318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f718c155d20 0x7f718c149290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.897+0000 7f719132e700 1 -- 172.21.15.153:0/852115318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f718c155d20 msgr2=0x7f718c149290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.897+0000 7f719132e700 1 --2- 172.21.15.153:0/852115318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f718c155d20 0x7f718c149290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.897+0000 7f719132e700 1 -- 172.21.15.153:0/852115318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f718c0ad7c0 msgr2=0x7f718c142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.897+0000 7f719132e700 1 --2- 172.21.15.153:0/852115318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f718c0ad7c0 0x7f718c142d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.897+0000 7f719132e700 1 -- 172.21.15.153:0/852115318 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f717c009420 con 0x7f718c06df10 2024-08-17T02:26:12.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.897+0000 7f7190b2d700 1 --2- 172.21.15.153:0/852115318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f718c0ad7c0 0x7f718c142d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:12.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.897+0000 7f719132e700 1 --2- 172.21.15.153:0/852115318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f718c06df10 0x7f718c139ff0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f718400d890 tx=0x7f7184008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:12.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.897+0000 7f71817fa700 1 -- 172.21.15.153:0/852115318 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718400b600 con 0x7f718c06df10 2024-08-17T02:26:12.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.897+0000 7f71817fa700 1 -- 172.21.15.153:0/852115318 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718400b760 con 0x7f718c06df10 2024-08-17T02:26:12.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.897+0000 7f7192330700 1 -- 172.21.15.153:0/852115318 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f718c158e20 con 0x7f718c06df10 2024-08-17T02:26:12.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.897+0000 7f71817fa700 1 -- 172.21.15.153:0/852115318 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718400bae0 con 0x7f718c06df10 2024-08-17T02:26:12.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.897+0000 7f7192330700 1 -- 172.21.15.153:0/852115318 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f718c14d880 con 0x7f718c06df10 2024-08-17T02:26:12.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.897+0000 7f7192330700 1 -- 172.21.15.153:0/852115318 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f718c0643a0 con 0x7f718c06df10 2024-08-17T02:26:12.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.897+0000 7f71817fa700 1 -- 172.21.15.153:0/852115318 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f718401e460 con 0x7f718c06df10 2024-08-17T02:26:12.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.897+0000 7f71817fa700 1 --2- 172.21.15.153:0/852115318 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7178060860 0x7f7178062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.897+0000 7f71817fa700 1 -- 172.21.15.153:0/852115318 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f718407d2a0 con 0x7f718c06df10 2024-08-17T02:26:12.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.897+0000 7f7190b2d700 1 --2- 172.21.15.153:0/852115318 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7178060860 0x7f7178062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.901+0000 7f7190b2d700 1 --2- 172.21.15.153:0/852115318 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7178060860 0x7f7178062d10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f718c06a740 tx=0x7f7188009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:12.909 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:12.905+0000 7f71817fa700 1 -- 172.21.15.153:0/852115318 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f718404d6f0 con 0x7f718c06df10 2024-08-17T02:26:13.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.073+0000 7f7192330700 1 -- 172.21.15.153:0/852115318 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f718c06f5f0 con 0x7f718c06df10 2024-08-17T02:26:13.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.073+0000 7f71817fa700 1 -- 172.21.15.153:0/852115318 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15411 (secure 0 0 0) 0x7f7184050d10 con 0x7f718c06df10 2024-08-17T02:26:13.077 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:13.078 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":20,"fsid":"56d41c33-b929-456d-96be-2aac4ecd299d","created":"2024-08-17T02:25:47.756085+0000","modified":"2024-08-17T02:26:12.082017+0000","last_up_change":"2024-08-17T02:25:58.643690+0000","last_in_change":"2024-08-17T02:25:49.809186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:58.093273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:09.856520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:11.080706+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0736f8e6-818e-42e6-a0dc-8aaf813315d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":24234},{"type":"v1","addr":"172.21.15.153:6817","nonce":24234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":24234},{"type":"v1","addr":"172.21.15.153:6819","nonce":24234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":24234},{"type":"v1","addr":"172.21.15.153:6823","nonce":24234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":24234},{"type":"v1","addr":"172.21.15.153:6821","nonce":24234}]},"public_addr":"172.21.15.153:6817/24234","cluster_addr":"172.21.15.153:6819/24234","heartbeat_back_addr":"172.21.15.153:6823/24234","heartbeat_front_addr":"172.21.15.153:6821/24234","state":["exists","up"]},{"osd":1,"uuid":"011762e9-6c2d-441a-aa56-68474639d72f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":24232},{"type":"v1","addr":"172.21.15.153:6801","nonce":24232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":24232},{"type":"v1","addr":"172.21.15.153:6803","nonce":24232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":24232},{"type":"v1","addr":"172.21.15.153:6809","nonce":24232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":24232},{"type":"v1","addr":"172.21.15.153:6806","nonce":24232}]},"public_addr":"172.21.15.153:6801/24232","cluster_addr":"172.21.15.153:6803/24232","heartbeat_back_addr":"172.21.15.153:6809/24232","heartbeat_front_addr":"172.21.15.153:6806/24232","state":["exists","up"]},{"osd":2,"uuid":"b562cd97-aa12-455e-b46a-e720a2ec9d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":24235},{"type":"v1","addr":"172.21.15.153:6808","nonce":24235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":24235},{"type":"v1","addr":"172.21.15.153:6811","nonce":24235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":24235},{"type":"v1","addr":"172.21.15.153:6815","nonce":24235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":24235},{"type":"v1","addr":"172.21.15.153:6813","nonce":24235}]},"public_addr":"172.21.15.153:6808/24235","cluster_addr":"172.21.15.153:6811/24235","heartbeat_back_addr":"172.21.15.153:6815/24235","heartbeat_front_addr":"172.21.15.153:6813/24235","state":["exists","up"]},{"osd":3,"uuid":"222da52f-90c2-4132-a5d2-6f6cf83d4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":24236},{"type":"v1","addr":"172.21.15.153:6825","nonce":24236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":24236},{"type":"v1","addr":"172.21.15.153:6827","nonce":24236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":24236},{"type":"v1","addr":"172.21.15.153:6831","nonce":24236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":24236},{"type":"v1","addr":"172.21.15.153:6829","nonce":24236}]},"public_addr":"172.21.15.153:6825/24236","cluster_addr":"172.21.15.153:6827/24236","heartbeat_back_addr":"172.21.15.153:6831/24236","heartbeat_front_addr":"172.21.15.153:6829/24236","state":["exists","up"]},{"osd":4,"uuid":"a38a04cd-032b-4977-a260-1ef3567d0c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24456},{"type":"v1","addr":"172.21.15.174:6809","nonce":24456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24456},{"type":"v1","addr":"172.21.15.174:6811","nonce":24456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24456},{"type":"v1","addr":"172.21.15.174:6815","nonce":24456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24456},{"type":"v1","addr":"172.21.15.174:6813","nonce":24456}]},"public_addr":"172.21.15.174:6809/24456","cluster_addr":"172.21.15.174:6811/24456","heartbeat_back_addr":"172.21.15.174:6815/24456","heartbeat_front_addr":"172.21.15.174:6813/24456","state":["exists","up"]},{"osd":5,"uuid":"c7778084-e751-48da-87a1-ab8bbe85aa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24457},{"type":"v1","addr":"172.21.15.174:6825","nonce":24457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24457},{"type":"v1","addr":"172.21.15.174:6827","nonce":24457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24457},{"type":"v1","addr":"172.21.15.174:6831","nonce":24457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24457},{"type":"v1","addr":"172.21.15.174:6829","nonce":24457}]},"public_addr":"172.21.15.174:6825/24457","cluster_addr":"172.21.15.174:6827/24457","heartbeat_back_addr":"172.21.15.174:6831/24457","heartbeat_front_addr":"172.21.15.174:6829/24457","state":["exists","up"]},{"osd":6,"uuid":"2d8e0715-254f-442c-9625-50721d0bc858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24477},{"type":"v1","addr":"172.21.15.174:6801","nonce":24477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24477},{"type":"v1","addr":"172.21.15.174:6803","nonce":24477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24477},{"type":"v1","addr":"172.21.15.174:6807","nonce":24477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24477},{"type":"v1","addr":"172.21.15.174:6805","nonce":24477}]},"public_addr":"172.21.15.174:6801/24477","cluster_addr":"172.21.15.174:6803/24477","heartbeat_back_addr":"172.21.15.174:6807/24477","heartbeat_front_addr":"172.21.15.174:6805/24477","state":["exists","up"]},{"osd":7,"uuid":"dffda25a-4601-4ddb-9a27-b0be1cadde27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24455},{"type":"v1","addr":"172.21.15.174:6817","nonce":24455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24455},{"type":"v1","addr":"172.21.15.174:6819","nonce":24455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24455},{"type":"v1","addr":"172.21.15.174:6823","nonce":24455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24455},{"type":"v1","addr":"172.21.15.174:6821","nonce":24455}]},"public_addr":"172.21.15.174:6817/24455","cluster_addr":"172.21.15.174:6819/24455","heartbeat_back_addr":"172.21.15.174:6823/24455","heartbeat_front_addr":"172.21.15.174:6821/24455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.990117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.033862+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.748087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.112877+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.070448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.360961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.110940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.226377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:13.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.077+0000 7f7192330700 1 -- 172.21.15.153:0/852115318 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7178060860 msgr2=0x7f7178062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.077+0000 7f7192330700 1 --2- 172.21.15.153:0/852115318 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7178060860 0x7f7178062d10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f718c06a740 tx=0x7f7188009040 comp rx=0 tx=0).stop 2024-08-17T02:26:13.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.077+0000 7f7192330700 1 -- 172.21.15.153:0/852115318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f718c06df10 msgr2=0x7f718c139ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.077+0000 7f7192330700 1 --2- 172.21.15.153:0/852115318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f718c06df10 0x7f718c139ff0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f718400d890 tx=0x7f7184008040 comp rx=0 tx=0).stop 2024-08-17T02:26:13.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.077+0000 7f7192330700 1 -- 172.21.15.153:0/852115318 shutdown_connections 2024-08-17T02:26:13.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.077+0000 7f7192330700 1 --2- 172.21.15.153:0/852115318 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7178060860 0x7f7178062d10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.077+0000 7f7192330700 1 --2- 172.21.15.153:0/852115318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f718c155d20 0x7f718c149290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.077+0000 7f7192330700 1 --2- 172.21.15.153:0/852115318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f718c0ad7c0 0x7f718c142d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.077+0000 7f7192330700 1 --2- 172.21.15.153:0/852115318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f718c06df10 0x7f718c139ff0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.077+0000 7f7192330700 1 -- 172.21.15.153:0/852115318 >> 172.21.15.153:0/852115318 conn(0x7f718c0678d0 msgr2=0x7f718c063060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:13.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.077+0000 7f7192330700 1 -- 172.21.15.153:0/852115318 shutdown_connections 2024-08-17T02:26:13.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.077+0000 7f7192330700 1 -- 172.21.15.153:0/852115318 wait complete. 2024-08-17T02:26:13.092 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:13.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.189+0000 7fb2c4c27700 1 Processor -- start 2024-08-17T02:26:13.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.193+0000 7fb2c4c27700 1 -- start start 2024-08-17T02:26:13.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.193+0000 7fb2c4c27700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2c0159040 0x7fb2c00cf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.193+0000 7fb2c4c27700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb2c00d0010 0x7fb2c00d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.193+0000 7fb2c4c27700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb2c015cea0 0x7fb2c015d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.193+0000 7fb2c4c27700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2c00cf190 con 0x7fb2c015cea0 2024-08-17T02:26:13.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.193+0000 7fb2c4c27700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2c00d09a0 con 0x7fb2c00d0010 2024-08-17T02:26:13.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.193+0000 7fb2c4c27700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c00ce5e0 con 0x7fb2c0159040 2024-08-17T02:26:13.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.193+0000 7fb2bffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb2c015cea0 0x7fb2c015d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.193+0000 7fb2bffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb2c015cea0 0x7fb2c015d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57210/0 (socket says 172.21.15.153:57210) 2024-08-17T02:26:13.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.193+0000 7fb2bffff700 1 -- 172.21.15.153:0/1288725551 learned_addr learned my addr 172.21.15.153:0/1288725551 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:13.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.193+0000 7fb2bf7fe700 1 --2- 172.21.15.153:0/1288725551 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2c0159040 0x7fb2c00cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.193+0000 7fb2beffd700 1 --2- 172.21.15.153:0/1288725551 >> v2:172.21.15.174:3300/0 conn(0x7fb2c00d0010 0x7fb2c00d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.193+0000 7fb2bffff700 1 -- 172.21.15.153:0/1288725551 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2c0159040 msgr2=0x7fb2c00cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:13.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.193+0000 7fb2bffff700 1 --2- 172.21.15.153:0/1288725551 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2c0159040 0x7fb2c00cf620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.193+0000 7fb2bffff700 1 -- 172.21.15.153:0/1288725551 >> v2:172.21.15.174:3300/0 conn(0x7fb2c00d0010 msgr2=0x7fb2c00d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:13.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.193+0000 7fb2bffff700 1 --2- 172.21.15.153:0/1288725551 >> v2:172.21.15.174:3300/0 conn(0x7fb2c00d0010 0x7fb2c00d0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.193+0000 7fb2bffff700 1 -- 172.21.15.153:0/1288725551 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c00ce860 con 0x7fb2c015cea0 2024-08-17T02:26:13.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.193+0000 7fb2bffff700 1 --2- 172.21.15.153:0/1288725551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2c015cea0 0x7fb2c015d320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb2c0067f20 tx=0x7fb2b8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=410df66a7322c1f7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:13.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.193+0000 7fb2be7fc700 1 -- 172.21.15.153:0/1288725551 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b800e070 con 0x7fb2c015cea0 2024-08-17T02:26:13.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.193+0000 7fb2be7fc700 1 -- 172.21.15.153:0/1288725551 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b800b970 con 0x7fb2c015cea0 2024-08-17T02:26:13.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.193+0000 7fb2be7fc700 1 -- 172.21.15.153:0/1288725551 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b80092e0 con 0x7fb2c015cea0 2024-08-17T02:26:13.200 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.193+0000 7fb2c4c27700 1 -- 172.21.15.153:0/1288725551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2c015cea0 msgr2=0x7fb2c015d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.200 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.193+0000 7fb2c4c27700 1 --2- 172.21.15.153:0/1288725551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2c015cea0 0x7fb2c015d320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb2c0067f20 tx=0x7fb2b8009840 comp rx=0 tx=0).stop 2024-08-17T02:26:13.200 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.193+0000 7fb2c4c27700 1 -- 172.21.15.153:0/1288725551 shutdown_connections 2024-08-17T02:26:13.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.193+0000 7fb2c4c27700 1 --2- 172.21.15.153:0/1288725551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2c015cea0 0x7fb2c015d320 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.193+0000 7fb2c4c27700 1 --2- 172.21.15.153:0/1288725551 >> v2:172.21.15.174:3300/0 conn(0x7fb2c00d0010 0x7fb2c00d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.193+0000 7fb2c4c27700 1 --2- 172.21.15.153:0/1288725551 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2c0159040 0x7fb2c00cf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.193+0000 7fb2c4c27700 1 -- 172.21.15.153:0/1288725551 >> 172.21.15.153:0/1288725551 conn(0x7fb2c0068250 msgr2=0x7fb2c0068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:13.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.197+0000 7fb2c4c27700 1 -- 172.21.15.153:0/1288725551 shutdown_connections 2024-08-17T02:26:13.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.197+0000 7fb2c4c27700 1 -- 172.21.15.153:0/1288725551 wait complete. 2024-08-17T02:26:13.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.197+0000 7fb2c4c27700 1 Processor -- start 2024-08-17T02:26:13.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.197+0000 7fb2c4c27700 1 -- start start 2024-08-17T02:26:13.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.201+0000 7fb2c4c27700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2c00d0010 0x7fb2c00cc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.201+0000 7fb2c4c27700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2c0159040 0x7fb2c00affa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.201+0000 7fb2c4c27700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2c015cea0 0x7fb2c00c4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.201+0000 7fb2c4c27700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c00b5130 con 0x7fb2c00d0010 2024-08-17T02:26:13.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.201+0000 7fb2c4c27700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c00b4270 con 0x7fb2c0159040 2024-08-17T02:26:13.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.201+0000 7fb2c4c27700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c0153e70 con 0x7fb2c015cea0 2024-08-17T02:26:13.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.201+0000 7fb2bf7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2c00d0010 0x7fb2c00cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.201+0000 7fb2bf7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2c00d0010 0x7fb2c00cc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57212/0 (socket says 172.21.15.153:57212) 2024-08-17T02:26:13.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.201+0000 7fb2bf7fe700 1 -- 172.21.15.153:0/1423290981 learned_addr learned my addr 172.21.15.153:0/1423290981 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:13.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.201+0000 7fb2beffd700 1 --2- 172.21.15.153:0/1423290981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2c0159040 0x7fb2c00affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.201+0000 7fb2bffff700 1 --2- 172.21.15.153:0/1423290981 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2c015cea0 0x7fb2c00c4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.201+0000 7fb2bf7fe700 1 -- 172.21.15.153:0/1423290981 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2c015cea0 msgr2=0x7fb2c00c4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.201+0000 7fb2bf7fe700 1 --2- 172.21.15.153:0/1423290981 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2c015cea0 0x7fb2c00c4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.201+0000 7fb2bf7fe700 1 -- 172.21.15.153:0/1423290981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2c0159040 msgr2=0x7fb2c00affa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.201+0000 7fb2bf7fe700 1 --2- 172.21.15.153:0/1423290981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2c0159040 0x7fb2c00affa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.201+0000 7fb2bf7fe700 1 -- 172.21.15.153:0/1423290981 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b8009ae0 con 0x7fb2c00d0010 2024-08-17T02:26:13.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.201+0000 7fb2beffd700 1 --2- 172.21.15.153:0/1423290981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2c0159040 0x7fb2c00affa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:13.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.201+0000 7fb2bffff700 1 --2- 172.21.15.153:0/1423290981 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2c015cea0 0x7fb2c00c4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:13.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.201+0000 7fb2bf7fe700 1 --2- 172.21.15.153:0/1423290981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2c00d0010 0x7fb2c00cc690 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb2b400ec80 tx=0x7fb2b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:13.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.201+0000 7fb2a77fe700 1 -- 172.21.15.153:0/1423290981 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b400c850 con 0x7fb2c00d0010 2024-08-17T02:26:13.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.201+0000 7fb2a77fe700 1 -- 172.21.15.153:0/1423290981 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b400c9b0 con 0x7fb2c00d0010 2024-08-17T02:26:13.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.201+0000 7fb2a77fe700 1 -- 172.21.15.153:0/1423290981 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b400cd50 con 0x7fb2c00d0010 2024-08-17T02:26:13.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.201+0000 7fb2c4c27700 1 -- 172.21.15.153:0/1423290981 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2c00b4520 con 0x7fb2c00d0010 2024-08-17T02:26:13.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.201+0000 7fb2c4c27700 1 -- 172.21.15.153:0/1423290981 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2c00b4ae0 con 0x7fb2c00d0010 2024-08-17T02:26:13.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.205+0000 7fb2c4c27700 1 -- 172.21.15.153:0/1423290981 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2c00643a0 con 0x7fb2c00d0010 2024-08-17T02:26:13.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.205+0000 7fb2a77fe700 1 -- 172.21.15.153:0/1423290981 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb2b4013680 con 0x7fb2c00d0010 2024-08-17T02:26:13.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.205+0000 7fb2a77fe700 1 --2- 172.21.15.153:0/1423290981 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb2ac060860 0x7fb2ac062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.205+0000 7fb2a77fe700 1 -- 172.21.15.153:0/1423290981 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb2b407cde0 con 0x7fb2c00d0010 2024-08-17T02:26:13.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.205+0000 7fb2beffd700 1 --2- 172.21.15.153:0/1423290981 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb2ac060860 0x7fb2ac062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.205+0000 7fb2beffd700 1 --2- 172.21.15.153:0/1423290981 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb2ac060860 0x7fb2ac062d10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb2c00b2a20 tx=0x7fb2b00091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:13.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.213+0000 7fb2a77fe700 1 -- 172.21.15.153:0/1423290981 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb2b404d230 con 0x7fb2c00d0010 2024-08-17T02:26:13.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.381+0000 7fb2c4c27700 1 -- 172.21.15.153:0/1423290981 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2c00b3480 con 0x7fb2c00d0010 2024-08-17T02:26:13.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.381+0000 7fb2a77fe700 1 -- 172.21.15.153:0/1423290981 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15411 (secure 0 0 0) 0x7fb2b4050850 con 0x7fb2c00d0010 2024-08-17T02:26:13.386 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:13.387 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":20,"fsid":"56d41c33-b929-456d-96be-2aac4ecd299d","created":"2024-08-17T02:25:47.756085+0000","modified":"2024-08-17T02:26:12.082017+0000","last_up_change":"2024-08-17T02:25:58.643690+0000","last_in_change":"2024-08-17T02:25:49.809186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:58.093273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:09.856520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:11.080706+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0736f8e6-818e-42e6-a0dc-8aaf813315d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":24234},{"type":"v1","addr":"172.21.15.153:6817","nonce":24234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":24234},{"type":"v1","addr":"172.21.15.153:6819","nonce":24234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":24234},{"type":"v1","addr":"172.21.15.153:6823","nonce":24234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":24234},{"type":"v1","addr":"172.21.15.153:6821","nonce":24234}]},"public_addr":"172.21.15.153:6817/24234","cluster_addr":"172.21.15.153:6819/24234","heartbeat_back_addr":"172.21.15.153:6823/24234","heartbeat_front_addr":"172.21.15.153:6821/24234","state":["exists","up"]},{"osd":1,"uuid":"011762e9-6c2d-441a-aa56-68474639d72f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":24232},{"type":"v1","addr":"172.21.15.153:6801","nonce":24232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":24232},{"type":"v1","addr":"172.21.15.153:6803","nonce":24232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":24232},{"type":"v1","addr":"172.21.15.153:6809","nonce":24232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":24232},{"type":"v1","addr":"172.21.15.153:6806","nonce":24232}]},"public_addr":"172.21.15.153:6801/24232","cluster_addr":"172.21.15.153:6803/24232","heartbeat_back_addr":"172.21.15.153:6809/24232","heartbeat_front_addr":"172.21.15.153:6806/24232","state":["exists","up"]},{"osd":2,"uuid":"b562cd97-aa12-455e-b46a-e720a2ec9d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":24235},{"type":"v1","addr":"172.21.15.153:6808","nonce":24235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":24235},{"type":"v1","addr":"172.21.15.153:6811","nonce":24235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":24235},{"type":"v1","addr":"172.21.15.153:6815","nonce":24235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":24235},{"type":"v1","addr":"172.21.15.153:6813","nonce":24235}]},"public_addr":"172.21.15.153:6808/24235","cluster_addr":"172.21.15.153:6811/24235","heartbeat_back_addr":"172.21.15.153:6815/24235","heartbeat_front_addr":"172.21.15.153:6813/24235","state":["exists","up"]},{"osd":3,"uuid":"222da52f-90c2-4132-a5d2-6f6cf83d4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":24236},{"type":"v1","addr":"172.21.15.153:6825","nonce":24236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":24236},{"type":"v1","addr":"172.21.15.153:6827","nonce":24236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":24236},{"type":"v1","addr":"172.21.15.153:6831","nonce":24236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":24236},{"type":"v1","addr":"172.21.15.153:6829","nonce":24236}]},"public_addr":"172.21.15.153:6825/24236","cluster_addr":"172.21.15.153:6827/24236","heartbeat_back_addr":"172.21.15.153:6831/24236","heartbeat_front_addr":"172.21.15.153:6829/24236","state":["exists","up"]},{"osd":4,"uuid":"a38a04cd-032b-4977-a260-1ef3567d0c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24456},{"type":"v1","addr":"172.21.15.174:6809","nonce":24456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24456},{"type":"v1","addr":"172.21.15.174:6811","nonce":24456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24456},{"type":"v1","addr":"172.21.15.174:6815","nonce":24456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24456},{"type":"v1","addr":"172.21.15.174:6813","nonce":24456}]},"public_addr":"172.21.15.174:6809/24456","cluster_addr":"172.21.15.174:6811/24456","heartbeat_back_addr":"172.21.15.174:6815/24456","heartbeat_front_addr":"172.21.15.174:6813/24456","state":["exists","up"]},{"osd":5,"uuid":"c7778084-e751-48da-87a1-ab8bbe85aa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24457},{"type":"v1","addr":"172.21.15.174:6825","nonce":24457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24457},{"type":"v1","addr":"172.21.15.174:6827","nonce":24457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24457},{"type":"v1","addr":"172.21.15.174:6831","nonce":24457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24457},{"type":"v1","addr":"172.21.15.174:6829","nonce":24457}]},"public_addr":"172.21.15.174:6825/24457","cluster_addr":"172.21.15.174:6827/24457","heartbeat_back_addr":"172.21.15.174:6831/24457","heartbeat_front_addr":"172.21.15.174:6829/24457","state":["exists","up"]},{"osd":6,"uuid":"2d8e0715-254f-442c-9625-50721d0bc858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24477},{"type":"v1","addr":"172.21.15.174:6801","nonce":24477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24477},{"type":"v1","addr":"172.21.15.174:6803","nonce":24477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24477},{"type":"v1","addr":"172.21.15.174:6807","nonce":24477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24477},{"type":"v1","addr":"172.21.15.174:6805","nonce":24477}]},"public_addr":"172.21.15.174:6801/24477","cluster_addr":"172.21.15.174:6803/24477","heartbeat_back_addr":"172.21.15.174:6807/24477","heartbeat_front_addr":"172.21.15.174:6805/24477","state":["exists","up"]},{"osd":7,"uuid":"dffda25a-4601-4ddb-9a27-b0be1cadde27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24455},{"type":"v1","addr":"172.21.15.174:6817","nonce":24455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24455},{"type":"v1","addr":"172.21.15.174:6819","nonce":24455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24455},{"type":"v1","addr":"172.21.15.174:6823","nonce":24455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24455},{"type":"v1","addr":"172.21.15.174:6821","nonce":24455}]},"public_addr":"172.21.15.174:6817/24455","cluster_addr":"172.21.15.174:6819/24455","heartbeat_back_addr":"172.21.15.174:6823/24455","heartbeat_front_addr":"172.21.15.174:6821/24455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.990117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.033862+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.748087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.112877+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.070448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.360961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.110940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.226377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:13.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.385+0000 7fb2c4c27700 1 -- 172.21.15.153:0/1423290981 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb2ac060860 msgr2=0x7fb2ac062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.385+0000 7fb2c4c27700 1 --2- 172.21.15.153:0/1423290981 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb2ac060860 0x7fb2ac062d10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb2c00b2a20 tx=0x7fb2b00091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.385+0000 7fb2c4c27700 1 -- 172.21.15.153:0/1423290981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2c00d0010 msgr2=0x7fb2c00cc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.385+0000 7fb2c4c27700 1 --2- 172.21.15.153:0/1423290981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2c00d0010 0x7fb2c00cc690 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb2b400ec80 tx=0x7fb2b40091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.385+0000 7fb2c4c27700 1 -- 172.21.15.153:0/1423290981 shutdown_connections 2024-08-17T02:26:13.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.385+0000 7fb2c4c27700 1 --2- 172.21.15.153:0/1423290981 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb2ac060860 0x7fb2ac062d10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.385+0000 7fb2c4c27700 1 --2- 172.21.15.153:0/1423290981 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2c015cea0 0x7fb2c00c4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.385+0000 7fb2c4c27700 1 --2- 172.21.15.153:0/1423290981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2c0159040 0x7fb2c00affa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.385+0000 7fb2c4c27700 1 --2- 172.21.15.153:0/1423290981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2c00d0010 0x7fb2c00cc690 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.385+0000 7fb2c4c27700 1 -- 172.21.15.153:0/1423290981 >> 172.21.15.153:0/1423290981 conn(0x7fb2c0068250 msgr2=0x7fb2c00aee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:13.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.385+0000 7fb2c4c27700 1 -- 172.21.15.153:0/1423290981 shutdown_connections 2024-08-17T02:26:13.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.385+0000 7fb2c4c27700 1 -- 172.21.15.153:0/1423290981 wait complete. 2024-08-17T02:26:13.401 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:26:13.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.509+0000 7f91bf59e700 1 Processor -- start 2024-08-17T02:26:13.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.509+0000 7f91bf59e700 1 -- start start 2024-08-17T02:26:13.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.513+0000 7f91bf59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f91c0067400 0x7f91c01593d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.513+0000 7f91bf59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c00cf670 con 0x7f91c0067030 2024-08-17T02:26:13.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.513+0000 7f91bf59e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c00cea60 con 0x7f91c00cfb00 2024-08-17T02:26:13.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.513+0000 7f91bf59e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c0159910 con 0x7f91c0067400 2024-08-17T02:26:13.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.513+0000 7f91bed9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f91c0067400 0x7f91c01593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.513+0000 7f91be59c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f91c0067030 0x7f91c00cb080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35636/0 (socket says 172.21.15.153:35636) 2024-08-17T02:26:13.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.513+0000 7f91be59c700 1 -- 172.21.15.153:0/2449072010 learned_addr learned my addr 172.21.15.153:0/2449072010 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:13.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.513+0000 7f91bd59a700 1 -- 172.21.15.153:0/2449072010 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3787793028 0 0) 0x7f91c00cf670 con 0x7f91c0067030 2024-08-17T02:26:13.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.513+0000 7f91bd59a700 1 -- 172.21.15.153:0/2449072010 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91a8003570 con 0x7f91c0067030 2024-08-17T02:26:13.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.513+0000 7f91bed9d700 1 -- 172.21.15.153:0/2449072010 >> v1:172.21.15.174:6789/0 conn(0x7f91c00cfb00 legacy=0x7f91c0158cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.513+0000 7f91bed9d700 1 -- 172.21.15.153:0/2449072010 >> v1:172.21.15.153:6789/0 conn(0x7f91c0067030 legacy=0x7f91c00cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.513+0000 7f91bd59a700 1 -- 172.21.15.153:0/2449072010 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 143732486 0 0) 0x7f91c00cea60 con 0x7f91c00cfb00 2024-08-17T02:26:13.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.513+0000 7f91bed9d700 1 -- 172.21.15.153:0/2449072010 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c00ced40 con 0x7f91c0067400 2024-08-17T02:26:13.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.513+0000 7f91bed9d700 1 --2- 172.21.15.153:0/2449072010 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91c0067400 0x7f91c01593d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f91b80098e0 tx=0x7f91b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54a52ae8fcbfc6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:13.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.513+0000 7f91bd59a700 1 -- 172.21.15.153:0/2449072010 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b800b640 con 0x7f91c0067400 2024-08-17T02:26:13.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.513+0000 7f91bd59a700 1 -- 172.21.15.153:0/2449072010 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b800b7a0 con 0x7f91c0067400 2024-08-17T02:26:13.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.513+0000 7f91bd59a700 1 -- 172.21.15.153:0/2449072010 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b800bb40 con 0x7f91c0067400 2024-08-17T02:26:13.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.513+0000 7f91bf59e700 1 -- 172.21.15.153:0/2449072010 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91c0067400 msgr2=0x7f91c01593d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.513+0000 7f91bf59e700 1 --2- 172.21.15.153:0/2449072010 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91c0067400 0x7f91c01593d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f91b80098e0 tx=0x7f91b80091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.513+0000 7f91bf59e700 1 -- 172.21.15.153:0/2449072010 shutdown_connections 2024-08-17T02:26:13.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.513+0000 7f91bf59e700 1 --2- 172.21.15.153:0/2449072010 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91c0067400 0x7f91c01593d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.513+0000 7f91bf59e700 1 -- 172.21.15.153:0/2449072010 >> 172.21.15.153:0/2449072010 conn(0x7f91c00d0b50 msgr2=0x7f91c00ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:13.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.513+0000 7f91bf59e700 1 -- 172.21.15.153:0/2449072010 shutdown_connections 2024-08-17T02:26:13.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.513+0000 7f91bf59e700 1 -- 172.21.15.153:0/2449072010 wait complete. 2024-08-17T02:26:13.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.517+0000 7f91bf59e700 1 Processor -- start 2024-08-17T02:26:13.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.517+0000 7f91bf59e700 1 -- start start 2024-08-17T02:26:13.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.517+0000 7f91bf59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91c0067030 0x7f91c015c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.517+0000 7f91bf59e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91c0067400 0x7f91c01694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.517+0000 7f91bf59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91c00cfb00 0x7f91c0143a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.517+0000 7f91bf59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c0151220 con 0x7f91c00cfb00 2024-08-17T02:26:13.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.517+0000 7f91bf59e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c0169a20 con 0x7f91c0067400 2024-08-17T02:26:13.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.517+0000 7f91bf59e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c016a860 con 0x7f91c0067030 2024-08-17T02:26:13.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.517+0000 7f91bed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91c00cfb00 0x7f91c0143a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.517+0000 7f91bed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91c00cfb00 0x7f91c0143a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57226/0 (socket says 172.21.15.153:57226) 2024-08-17T02:26:13.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.517+0000 7f91bed9d700 1 -- 172.21.15.153:0/3996054339 learned_addr learned my addr 172.21.15.153:0/3996054339 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:13.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.517+0000 7f91be59c700 1 --2- 172.21.15.153:0/3996054339 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91c0067030 0x7f91c015c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.517+0000 7f91bdd9b700 1 --2- 172.21.15.153:0/3996054339 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91c0067400 0x7f91c01694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.517+0000 7f91bed9d700 1 -- 172.21.15.153:0/3996054339 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91c0067030 msgr2=0x7f91c015c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.517+0000 7f91bed9d700 1 --2- 172.21.15.153:0/3996054339 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91c0067030 0x7f91c015c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.521+0000 7f91bed9d700 1 -- 172.21.15.153:0/3996054339 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91c0067400 msgr2=0x7f91c01694e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.521+0000 7f91bed9d700 1 --2- 172.21.15.153:0/3996054339 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91c0067400 0x7f91c01694e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.521+0000 7f91bed9d700 1 -- 172.21.15.153:0/3996054339 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b8009420 con 0x7f91c00cfb00 2024-08-17T02:26:13.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.521+0000 7f91bed9d700 1 --2- 172.21.15.153:0/3996054339 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91c00cfb00 0x7f91c0143a80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f91c0069520 tx=0x7f91b8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:13.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.521+0000 7f91ae7fc700 1 -- 172.21.15.153:0/3996054339 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b801f070 con 0x7f91c00cfb00 2024-08-17T02:26:13.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.521+0000 7f91ae7fc700 1 -- 172.21.15.153:0/3996054339 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b8002f70 con 0x7f91c00cfb00 2024-08-17T02:26:13.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.521+0000 7f91bf59e700 1 -- 172.21.15.153:0/3996054339 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c0169c50 con 0x7f91c00cfb00 2024-08-17T02:26:13.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.521+0000 7f91ae7fc700 1 -- 172.21.15.153:0/3996054339 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b800bb40 con 0x7f91c00cfb00 2024-08-17T02:26:13.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.521+0000 7f91bf59e700 1 -- 172.21.15.153:0/3996054339 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c016a210 con 0x7f91c00cfb00 2024-08-17T02:26:13.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.521+0000 7f91ae7fc700 1 -- 172.21.15.153:0/3996054339 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f91b8023070 con 0x7f91c00cfb00 2024-08-17T02:26:13.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.521+0000 7f91ae7fc700 1 --2- 172.21.15.153:0/3996054339 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f91a0060860 0x7f91a0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.521+0000 7f91bf59e700 1 -- 172.21.15.153:0/3996054339 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91c016a9d0 con 0x7f91c00cfb00 2024-08-17T02:26:13.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.521+0000 7f91ae7fc700 1 -- 172.21.15.153:0/3996054339 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f91b807e0e0 con 0x7f91c00cfb00 2024-08-17T02:26:13.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.521+0000 7f91be59c700 1 --2- 172.21.15.153:0/3996054339 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f91a0060860 0x7f91a0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.521+0000 7f91be59c700 1 --2- 172.21.15.153:0/3996054339 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f91a0060860 0x7f91a0062d10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f91b0005c50 tx=0x7f91b0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:13.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.529+0000 7f91ae7fc700 1 -- 172.21.15.153:0/3996054339 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f91b804e490 con 0x7f91c00cfb00 2024-08-17T02:26:13.731 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.729+0000 7f91bf59e700 1 -- 172.21.15.153:0/3996054339 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f91c00638f0 con 0x7f91c00cfb00 2024-08-17T02:26:13.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.769+0000 7f91ae7fc700 1 -- 172.21.15.153:0/3996054339 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f91b802a070 con 0x7f91c00cfb00 2024-08-17T02:26:13.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.773+0000 7f91bf59e700 1 -- 172.21.15.153:0/3996054339 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f91a0060860 msgr2=0x7f91a0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.773+0000 7f91bf59e700 1 --2- 172.21.15.153:0/3996054339 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f91a0060860 0x7f91a0062d10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f91b0005c50 tx=0x7f91b0009040 comp rx=0 tx=0).stop 2024-08-17T02:26:13.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.773+0000 7f91bf59e700 1 -- 172.21.15.153:0/3996054339 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91c00cfb00 msgr2=0x7f91c0143a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.773+0000 7f91bf59e700 1 --2- 172.21.15.153:0/3996054339 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91c00cfb00 0x7f91c0143a80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f91c0069520 tx=0x7f91b8017000 comp rx=0 tx=0).stop 2024-08-17T02:26:13.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.773+0000 7f91bf59e700 1 -- 172.21.15.153:0/3996054339 shutdown_connections 2024-08-17T02:26:13.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.773+0000 7f91bf59e700 1 --2- 172.21.15.153:0/3996054339 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f91a0060860 0x7f91a0062d10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.773+0000 7f91bf59e700 1 --2- 172.21.15.153:0/3996054339 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91c00cfb00 0x7f91c0143a80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.773+0000 7f91bf59e700 1 --2- 172.21.15.153:0/3996054339 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91c0067400 0x7f91c01694e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.773+0000 7f91bf59e700 1 --2- 172.21.15.153:0/3996054339 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91c0067030 0x7f91c015c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.773+0000 7f91bf59e700 1 -- 172.21.15.153:0/3996054339 >> 172.21.15.153:0/3996054339 conn(0x7f91c00d0b50 msgr2=0x7f91c0154590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:13.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.773+0000 7f91bf59e700 1 -- 172.21.15.153:0/3996054339 shutdown_connections 2024-08-17T02:26:13.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.773+0000 7f91bf59e700 1 -- 172.21.15.153:0/3996054339 wait complete. 2024-08-17T02:26:13.793 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:26:13.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.909+0000 7f09227f7700 1 Processor -- start 2024-08-17T02:26:13.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.909+0000 7f09227f7700 1 -- start start 2024-08-17T02:26:13.915 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.909+0000 7f09227f7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f091c067030 0x7f091c067400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.915 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.913+0000 7f09227f7700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f091c0cf670 con 0x7f091c158cc0 2024-08-17T02:26:13.915 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.913+0000 7f09227f7700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f091c0cea60 con 0x7f091c0cfb00 2024-08-17T02:26:13.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.913+0000 7f09227f7700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f091c0ced40 con 0x7f091c067030 2024-08-17T02:26:13.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.913+0000 7f0921ff6700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f091c158cc0 0x7f091c1590d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35646/0 (socket says 172.21.15.153:35646) 2024-08-17T02:26:13.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.913+0000 7f0921ff6700 1 -- 172.21.15.153:0/792692359 learned_addr learned my addr 172.21.15.153:0/792692359 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:13.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.913+0000 7f09217f5700 1 --2- 172.21.15.153:0/792692359 >> v2:172.21.15.153:3300/0 conn(0x7f091c067030 0x7f091c067400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.913+0000 7f0913fff700 1 -- 172.21.15.153:0/792692359 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3159554828 0 0) 0x7f091c0cf670 con 0x7f091c158cc0 2024-08-17T02:26:13.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.913+0000 7f0913fff700 1 -- 172.21.15.153:0/792692359 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0908003570 con 0x7f091c158cc0 2024-08-17T02:26:13.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.913+0000 7f09217f5700 1 -- 172.21.15.153:0/792692359 >> v1:172.21.15.174:6789/0 conn(0x7f091c0cfb00 legacy=0x7f091c0cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.913+0000 7f09217f5700 1 -- 172.21.15.153:0/792692359 >> v1:172.21.15.153:6789/0 conn(0x7f091c158cc0 legacy=0x7f091c1590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.913+0000 7f09217f5700 1 -- 172.21.15.153:0/792692359 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f091c0cf020 con 0x7f091c067030 2024-08-17T02:26:13.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.913+0000 7f09217f5700 1 --2- 172.21.15.153:0/792692359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f091c067030 0x7f091c067400 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f090c0098e0 tx=0x7f090c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3faf63de28ce7e71 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:13.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.913+0000 7f0913fff700 1 -- 172.21.15.153:0/792692359 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c00b640 con 0x7f091c067030 2024-08-17T02:26:13.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.913+0000 7f0913fff700 1 -- 172.21.15.153:0/792692359 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090c00b7a0 con 0x7f091c067030 2024-08-17T02:26:13.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.913+0000 7f0913fff700 1 -- 172.21.15.153:0/792692359 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c00bb40 con 0x7f091c067030 2024-08-17T02:26:13.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.913+0000 7f09227f7700 1 -- 172.21.15.153:0/792692359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f091c067030 msgr2=0x7f091c067400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.913+0000 7f09227f7700 1 --2- 172.21.15.153:0/792692359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f091c067030 0x7f091c067400 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f090c0098e0 tx=0x7f090c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.913+0000 7f09227f7700 1 -- 172.21.15.153:0/792692359 shutdown_connections 2024-08-17T02:26:13.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.913+0000 7f09227f7700 1 --2- 172.21.15.153:0/792692359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f091c067030 0x7f091c067400 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.913+0000 7f09227f7700 1 -- 172.21.15.153:0/792692359 >> 172.21.15.153:0/792692359 conn(0x7f091c0d0b50 msgr2=0x7f091c0ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:13.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.913+0000 7f09227f7700 1 -- 172.21.15.153:0/792692359 shutdown_connections 2024-08-17T02:26:13.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.913+0000 7f09227f7700 1 -- 172.21.15.153:0/792692359 wait complete. 2024-08-17T02:26:13.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.913+0000 7f09227f7700 1 Processor -- start 2024-08-17T02:26:13.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.913+0000 7f09227f7700 1 -- start start 2024-08-17T02:26:13.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.917+0000 7f09227f7700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f091c067030 0x7f091c14ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.917+0000 7f09227f7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f091c0cfb00 0x7f091c0c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.917+0000 7f09227f7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f091c158cc0 0x7f091c0c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.917+0000 7f09227f7700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091c15d390 con 0x7f091c158cc0 2024-08-17T02:26:13.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.917+0000 7f09227f7700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091c15a030 con 0x7f091c067030 2024-08-17T02:26:13.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.917+0000 7f09227f7700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f091c0c8d70 con 0x7f091c0cfb00 2024-08-17T02:26:13.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.917+0000 7f0921ff6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f091c158cc0 0x7f091c0c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.917+0000 7f0921ff6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f091c158cc0 0x7f091c0c53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57246/0 (socket says 172.21.15.153:57246) 2024-08-17T02:26:13.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.917+0000 7f0921ff6700 1 -- 172.21.15.153:0/122234728 learned_addr learned my addr 172.21.15.153:0/122234728 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:13.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.917+0000 7f0920ff4700 1 --2- 172.21.15.153:0/122234728 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f091c0cfb00 0x7f091c0c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.917+0000 7f09217f5700 1 --2- 172.21.15.153:0/122234728 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f091c067030 0x7f091c14ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.917+0000 7f0921ff6700 1 -- 172.21.15.153:0/122234728 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f091c0cfb00 msgr2=0x7f091c0c4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.917+0000 7f0921ff6700 1 --2- 172.21.15.153:0/122234728 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f091c0cfb00 0x7f091c0c4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.917+0000 7f0921ff6700 1 -- 172.21.15.153:0/122234728 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f091c067030 msgr2=0x7f091c14ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.917+0000 7f0921ff6700 1 --2- 172.21.15.153:0/122234728 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f091c067030 0x7f091c14ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.917+0000 7f0921ff6700 1 -- 172.21.15.153:0/122234728 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090c009420 con 0x7f091c158cc0 2024-08-17T02:26:13.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.917+0000 7f0921ff6700 1 --2- 172.21.15.153:0/122234728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f091c158cc0 0x7f091c0c53a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0914001460 tx=0x7f0914001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:13.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.917+0000 7f09117fa700 1 -- 172.21.15.153:0/122234728 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091400a870 con 0x7f091c158cc0 2024-08-17T02:26:13.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.917+0000 7f09117fa700 1 -- 172.21.15.153:0/122234728 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091400a9d0 con 0x7f091c158cc0 2024-08-17T02:26:13.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.917+0000 7f09227f7700 1 -- 172.21.15.153:0/122234728 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f091c0c9050 con 0x7f091c158cc0 2024-08-17T02:26:13.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.917+0000 7f09117fa700 1 -- 172.21.15.153:0/122234728 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091400ad50 con 0x7f091c158cc0 2024-08-17T02:26:13.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.917+0000 7f09227f7700 1 -- 172.21.15.153:0/122234728 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f091c159cc0 con 0x7f091c158cc0 2024-08-17T02:26:13.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.917+0000 7f09227f7700 1 -- 172.21.15.153:0/122234728 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f091c15a1a0 con 0x7f091c158cc0 2024-08-17T02:26:13.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.921+0000 7f09117fa700 1 -- 172.21.15.153:0/122234728 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0914007300 con 0x7f091c158cc0 2024-08-17T02:26:13.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.921+0000 7f09117fa700 1 --2- 172.21.15.153:0/122234728 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f0900060860 0x7f0900062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.921+0000 7f09117fa700 1 -- 172.21.15.153:0/122234728 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f091407ced0 con 0x7f091c158cc0 2024-08-17T02:26:13.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.921+0000 7f09217f5700 1 --2- 172.21.15.153:0/122234728 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f0900060860 0x7f0900062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.921+0000 7f09217f5700 1 --2- 172.21.15.153:0/122234728 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f0900060860 0x7f0900062d10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f090c0093f0 tx=0x7f090c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:13.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:13.929+0000 7f09117fa700 1 -- 172.21.15.153:0/122234728 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f091404d310 con 0x7f091c158cc0 2024-08-17T02:26:14.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.125+0000 7f09227f7700 1 -- 172.21.15.153:0/122234728 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f091c0638f0 con 0x7f091c158cc0 2024-08-17T02:26:14.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.777+0000 7f09117fa700 1 -- 172.21.15.153:0/122234728 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0914050930 con 0x7f091c158cc0 2024-08-17T02:26:14.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.781+0000 7f09227f7700 1 -- 172.21.15.153:0/122234728 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f0900060860 msgr2=0x7f0900062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.781+0000 7f09227f7700 1 --2- 172.21.15.153:0/122234728 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f0900060860 0x7f0900062d10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f090c0093f0 tx=0x7f090c017000 comp rx=0 tx=0).stop 2024-08-17T02:26:14.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.781+0000 7f09227f7700 1 -- 172.21.15.153:0/122234728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f091c158cc0 msgr2=0x7f091c0c53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.781+0000 7f09227f7700 1 --2- 172.21.15.153:0/122234728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f091c158cc0 0x7f091c0c53a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0914001460 tx=0x7f0914001a40 comp rx=0 tx=0).stop 2024-08-17T02:26:14.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.781+0000 7f09227f7700 1 -- 172.21.15.153:0/122234728 shutdown_connections 2024-08-17T02:26:14.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.781+0000 7f09227f7700 1 --2- 172.21.15.153:0/122234728 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f0900060860 0x7f0900062d10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.781+0000 7f09227f7700 1 --2- 172.21.15.153:0/122234728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f091c158cc0 0x7f091c0c53a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.785+0000 7f09227f7700 1 --2- 172.21.15.153:0/122234728 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f091c0cfb00 0x7f091c0c4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.785+0000 7f09227f7700 1 --2- 172.21.15.153:0/122234728 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f091c067030 0x7f091c14ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.785+0000 7f09227f7700 1 -- 172.21.15.153:0/122234728 >> 172.21.15.153:0/122234728 conn(0x7f091c0d0b50 msgr2=0x7f091c0cdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:14.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.785+0000 7f09227f7700 1 -- 172.21.15.153:0/122234728 shutdown_connections 2024-08-17T02:26:14.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.785+0000 7f09227f7700 1 -- 172.21.15.153:0/122234728 wait complete. 2024-08-17T02:26:14.802 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:14.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.909+0000 7f3f6316d700 1 Processor -- start 2024-08-17T02:26:14.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.909+0000 7f3f6316d700 1 -- start start 2024-08-17T02:26:14.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.909+0000 7f3f6316d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f5c15d540 0x7f3f5c0af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.909+0000 7f3f6316d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3f5c06e830 0x7f3f5c0a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.909+0000 7f3f6316d700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f5c0b0270 con 0x7f3f5c0a9260 2024-08-17T02:26:14.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.909+0000 7f3f6316d700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f5c0af660 con 0x7f3f5c06e830 2024-08-17T02:26:14.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.909+0000 7f3f6316d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c0af940 con 0x7f3f5c15d540 2024-08-17T02:26:14.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.909+0000 7f3f5bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3f5c06e830 0x7f3f5c0a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.909+0000 7f3f5bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3f5c06e830 0x7f3f5c0a8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57262/0 (socket says 172.21.15.153:57262) 2024-08-17T02:26:14.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.909+0000 7f3f5bfff700 1 -- 172.21.15.153:0/951929312 learned_addr learned my addr 172.21.15.153:0/951929312 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:14.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.909+0000 7f3f60f09700 1 --2- 172.21.15.153:0/951929312 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f5c15d540 0x7f3f5c0af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.915 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.909+0000 7f3f5bfff700 1 -- 172.21.15.153:0/951929312 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f5c15d540 msgr2=0x7f3f5c0af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:14.915 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.909+0000 7f3f5bfff700 1 --2- 172.21.15.153:0/951929312 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f5c15d540 0x7f3f5c0af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.915 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.909+0000 7f3f5bfff700 1 -- 172.21.15.153:0/951929312 >> v1:172.21.15.153:6789/0 conn(0x7f3f5c0a9260 legacy=0x7f3f5c0b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.915 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.909+0000 7f3f5b7fe700 1 -- 172.21.15.153:0/951929312 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3332437177 0 0) 0x7f3f5c0b0270 con 0x7f3f5c0a9260 2024-08-17T02:26:14.915 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.909+0000 7f3f5bfff700 1 -- 172.21.15.153:0/951929312 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5c0afc20 con 0x7f3f5c06e830 2024-08-17T02:26:14.915 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.909+0000 7f3f5bfff700 1 --2- 172.21.15.153:0/951929312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f5c06e830 0x7f3f5c0a8d20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3f54009f20 tx=0x7f3f54009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f25f81d0ef249a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:14.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.909+0000 7f3f5b7fe700 1 -- 172.21.15.153:0/951929312 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5400e070 con 0x7f3f5c06e830 2024-08-17T02:26:14.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.909+0000 7f3f5b7fe700 1 -- 172.21.15.153:0/951929312 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5400b9d0 con 0x7f3f5c06e830 2024-08-17T02:26:14.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.909+0000 7f3f5b7fe700 1 -- 172.21.15.153:0/951929312 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f540092e0 con 0x7f3f5c06e830 2024-08-17T02:26:14.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.909+0000 7f3f6316d700 1 -- 172.21.15.153:0/951929312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f5c06e830 msgr2=0x7f3f5c0a8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.909+0000 7f3f6316d700 1 --2- 172.21.15.153:0/951929312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f5c06e830 0x7f3f5c0a8d20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3f54009f20 tx=0x7f3f54009840 comp rx=0 tx=0).stop 2024-08-17T02:26:14.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.909+0000 7f3f6316d700 1 -- 172.21.15.153:0/951929312 shutdown_connections 2024-08-17T02:26:14.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.909+0000 7f3f6316d700 1 --2- 172.21.15.153:0/951929312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f5c06e830 0x7f3f5c0a8d20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.909+0000 7f3f6316d700 1 --2- 172.21.15.153:0/951929312 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f5c15d540 0x7f3f5c0af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.909+0000 7f3f6316d700 1 -- 172.21.15.153:0/951929312 >> 172.21.15.153:0/951929312 conn(0x7f3f5c066e00 msgr2=0x7f3f5c067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:14.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.913+0000 7f3f6316d700 1 -- 172.21.15.153:0/951929312 shutdown_connections 2024-08-17T02:26:14.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.913+0000 7f3f6316d700 1 -- 172.21.15.153:0/951929312 wait complete. 2024-08-17T02:26:14.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.913+0000 7f3f6316d700 1 Processor -- start 2024-08-17T02:26:14.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.913+0000 7f3f6316d700 1 -- start start 2024-08-17T02:26:14.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.913+0000 7f3f6316d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f5c06e830 0x7f3f5c1573e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.913+0000 7f3f6316d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f5c0a9260 0x7f3f5c15e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.913+0000 7f3f6316d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f5c15d540 0x7f3f5c096a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.913+0000 7f3f6316d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c15f7c0 con 0x7f3f5c06e830 2024-08-17T02:26:14.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.913+0000 7f3f6316d700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c157920 con 0x7f3f5c15d540 2024-08-17T02:26:14.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.913+0000 7f3f6316d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c15ebb0 con 0x7f3f5c0a9260 2024-08-17T02:26:14.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.913+0000 7f3f60f09700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f5c06e830 0x7f3f5c1573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.913+0000 7f3f60f09700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f5c06e830 0x7f3f5c1573e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57266/0 (socket says 172.21.15.153:57266) 2024-08-17T02:26:14.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.913+0000 7f3f60f09700 1 -- 172.21.15.153:0/4272302041 learned_addr learned my addr 172.21.15.153:0/4272302041 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:14.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.913+0000 7f3f5bfff700 1 --2- 172.21.15.153:0/4272302041 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f5c0a9260 0x7f3f5c15e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.913+0000 7f3f6170a700 1 --2- 172.21.15.153:0/4272302041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f5c15d540 0x7f3f5c096a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.913+0000 7f3f60f09700 1 -- 172.21.15.153:0/4272302041 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f5c0a9260 msgr2=0x7f3f5c15e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.913+0000 7f3f60f09700 1 --2- 172.21.15.153:0/4272302041 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f5c0a9260 0x7f3f5c15e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.913+0000 7f3f60f09700 1 -- 172.21.15.153:0/4272302041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f5c15d540 msgr2=0x7f3f5c096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.913+0000 7f3f60f09700 1 --2- 172.21.15.153:0/4272302041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f5c15d540 0x7f3f5c096a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.913+0000 7f3f60f09700 1 -- 172.21.15.153:0/4272302041 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f54009ae0 con 0x7f3f5c06e830 2024-08-17T02:26:14.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.913+0000 7f3f6170a700 1 --2- 172.21.15.153:0/4272302041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f5c15d540 0x7f3f5c096a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:14.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.913+0000 7f3f60f09700 1 --2- 172.21.15.153:0/4272302041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f5c06e830 0x7f3f5c1573e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3f5000e960 tx=0x7f3f500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:14.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.917+0000 7f3f58ff9700 1 -- 172.21.15.153:0/4272302041 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5000c850 con 0x7f3f5c06e830 2024-08-17T02:26:14.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.917+0000 7f3f58ff9700 1 -- 172.21.15.153:0/4272302041 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5000c9b0 con 0x7f3f5c06e830 2024-08-17T02:26:14.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.917+0000 7f3f6316d700 1 -- 172.21.15.153:0/4272302041 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f5c15ee90 con 0x7f3f5c06e830 2024-08-17T02:26:14.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.917+0000 7f3f58ff9700 1 -- 172.21.15.153:0/4272302041 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5000cd50 con 0x7f3f5c06e830 2024-08-17T02:26:14.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.917+0000 7f3f6316d700 1 -- 172.21.15.153:0/4272302041 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f5c15f450 con 0x7f3f5c06e830 2024-08-17T02:26:14.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.917+0000 7f3f6316d700 1 -- 172.21.15.153:0/4272302041 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f5c0645c0 con 0x7f3f5c06e830 2024-08-17T02:26:14.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.917+0000 7f3f58ff9700 1 -- 172.21.15.153:0/4272302041 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f3f50013680 con 0x7f3f5c06e830 2024-08-17T02:26:14.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.917+0000 7f3f58ff9700 1 --2- 172.21.15.153:0/4272302041 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3f48060860 0x7f3f48062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.917+0000 7f3f58ff9700 1 -- 172.21.15.153:0/4272302041 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3f5007cd60 con 0x7f3f5c06e830 2024-08-17T02:26:14.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.917+0000 7f3f5bfff700 1 --2- 172.21.15.153:0/4272302041 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3f48060860 0x7f3f48062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.921+0000 7f3f5bfff700 1 --2- 172.21.15.153:0/4272302041 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3f48060860 0x7f3f48062d10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3f54009880 tx=0x7f3f54018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:14.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:14.925+0000 7f3f58ff9700 1 -- 172.21.15.153:0/4272302041 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f3f5004d1b0 con 0x7f3f5c06e830 2024-08-17T02:26:15.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.125+0000 7f3f6316d700 1 -- 172.21.15.153:0/4272302041 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3f5c0cb220 con 0x7f3f5c06e830 2024-08-17T02:26:15.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.125+0000 7f3f58ff9700 1 -- 172.21.15.153:0/4272302041 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f3f500507d0 con 0x7f3f5c06e830 2024-08-17T02:26:15.128 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:15.128 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/610991976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":610991976},{"type":"v1","addr":"172.21.15.153:6835","nonce":610991976}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/3521472122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3521472122},{"type":"v1","addr":"172.21.15.153:6837","nonce":3521472122}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1184225885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1184225885},{"type":"v1","addr":"172.21.15.174:6833","nonce":1184225885}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:12.082812+0000","modified":"2024-08-17T02:26:14.770527+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/477398839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":477398839},{"type":"v1","addr":"172.21.15.174:6835","nonce":477398839}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:26:15.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.125+0000 7f3f6316d700 1 -- 172.21.15.153:0/4272302041 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3f48060860 msgr2=0x7f3f48062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.125+0000 7f3f6316d700 1 --2- 172.21.15.153:0/4272302041 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3f48060860 0x7f3f48062d10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3f54009880 tx=0x7f3f54018000 comp rx=0 tx=0).stop 2024-08-17T02:26:15.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.125+0000 7f3f6316d700 1 -- 172.21.15.153:0/4272302041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f5c06e830 msgr2=0x7f3f5c1573e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.125+0000 7f3f6316d700 1 --2- 172.21.15.153:0/4272302041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f5c06e830 0x7f3f5c1573e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3f5000e960 tx=0x7f3f500091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.129+0000 7f3f6316d700 1 -- 172.21.15.153:0/4272302041 shutdown_connections 2024-08-17T02:26:15.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.129+0000 7f3f6316d700 1 --2- 172.21.15.153:0/4272302041 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3f48060860 0x7f3f48062d10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.129+0000 7f3f6316d700 1 --2- 172.21.15.153:0/4272302041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f5c15d540 0x7f3f5c096a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.129+0000 7f3f6316d700 1 --2- 172.21.15.153:0/4272302041 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f5c0a9260 0x7f3f5c15e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.129+0000 7f3f6316d700 1 --2- 172.21.15.153:0/4272302041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f5c06e830 0x7f3f5c1573e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.129+0000 7f3f6316d700 1 -- 172.21.15.153:0/4272302041 >> 172.21.15.153:0/4272302041 conn(0x7f3f5c066e00 msgr2=0x7f3f5c0674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:15.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.129+0000 7f3f6316d700 1 -- 172.21.15.153:0/4272302041 shutdown_connections 2024-08-17T02:26:15.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.129+0000 7f3f6316d700 1 -- 172.21.15.153:0/4272302041 wait complete. 2024-08-17T02:26:15.132 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 6 2024-08-17T02:26:15.143 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:15.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.245+0000 7f4adffff700 1 Processor -- start 2024-08-17T02:26:15.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.245+0000 7f4adffff700 1 -- start start 2024-08-17T02:26:15.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.245+0000 7f4adffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4ae0153320 0x7f4ae01536f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.245+0000 7f4adffff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ae015a190 0x7f4ae015cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.245+0000 7f4adffff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ae015dbd0 con 0x7f4ae00ccaa0 2024-08-17T02:26:15.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.245+0000 7f4adffff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ae00ce430 con 0x7f4ae0153320 2024-08-17T02:26:15.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.245+0000 7f4adffff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae015d370 con 0x7f4ae015a190 2024-08-17T02:26:15.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.245+0000 7f4adeffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4ae0153320 0x7f4ae01536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.245+0000 7f4adf7fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f4ae00ccaa0 0x7f4ae0066e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35660/0 (socket says 172.21.15.153:35660) 2024-08-17T02:26:15.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.245+0000 7f4adf7fe700 1 -- 172.21.15.153:0/3545364497 learned_addr learned my addr 172.21.15.153:0/3545364497 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:15.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.245+0000 7f4ad7fff700 1 --2- 172.21.15.153:0/3545364497 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ae015a190 0x7f4ae015cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.249+0000 7f4ade7fc700 1 -- 172.21.15.153:0/3545364497 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2884706584 0 0) 0x7f4ae015dbd0 con 0x7f4ae00ccaa0 2024-08-17T02:26:15.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.249+0000 7f4ade7fc700 1 -- 172.21.15.153:0/3545364497 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4acc003570 con 0x7f4ae00ccaa0 2024-08-17T02:26:15.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.249+0000 7f4ad7fff700 1 -- 172.21.15.153:0/3545364497 >> v2:172.21.15.153:3300/0 conn(0x7f4ae0153320 msgr2=0x7f4ae01536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:15.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.249+0000 7f4ad7fff700 1 --2- 172.21.15.153:0/3545364497 >> v2:172.21.15.153:3300/0 conn(0x7f4ae0153320 0x7f4ae01536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.249+0000 7f4ad7fff700 1 -- 172.21.15.153:0/3545364497 >> v1:172.21.15.153:6789/0 conn(0x7f4ae00ccaa0 legacy=0x7f4ae0066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.249+0000 7f4ad7fff700 1 -- 172.21.15.153:0/3545364497 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae015d610 con 0x7f4ae015a190 2024-08-17T02:26:15.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.249+0000 7f4adeffd700 1 --2- 172.21.15.153:0/3545364497 >> v2:172.21.15.153:3300/0 conn(0x7f4ae0153320 0x7f4ae01536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:15.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.249+0000 7f4ad7fff700 1 --2- 172.21.15.153:0/3545364497 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ae015a190 0x7f4ae015cc60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4ac80098e0 tx=0x7f4ac80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e45113a67c819df6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:15.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.249+0000 7f4ade7fc700 1 -- 172.21.15.153:0/3545364497 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8011630 con 0x7f4ae015a190 2024-08-17T02:26:15.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.249+0000 7f4ade7fc700 1 -- 172.21.15.153:0/3545364497 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac8011790 con 0x7f4ae015a190 2024-08-17T02:26:15.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.249+0000 7f4ade7fc700 1 -- 172.21.15.153:0/3545364497 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8011b30 con 0x7f4ae015a190 2024-08-17T02:26:15.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.249+0000 7f4adffff700 1 -- 172.21.15.153:0/3545364497 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ae015a190 msgr2=0x7f4ae015cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.249+0000 7f4adffff700 1 --2- 172.21.15.153:0/3545364497 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ae015a190 0x7f4ae015cc60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4ac80098e0 tx=0x7f4ac80091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.249+0000 7f4adffff700 1 -- 172.21.15.153:0/3545364497 shutdown_connections 2024-08-17T02:26:15.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.249+0000 7f4adffff700 1 --2- 172.21.15.153:0/3545364497 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ae015a190 0x7f4ae015cc60 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.249+0000 7f4adffff700 1 --2- 172.21.15.153:0/3545364497 >> v2:172.21.15.153:3300/0 conn(0x7f4ae0153320 0x7f4ae01536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.249+0000 7f4adffff700 1 -- 172.21.15.153:0/3545364497 >> 172.21.15.153:0/3545364497 conn(0x7f4ae00d00a0 msgr2=0x7f4ae00d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:15.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.249+0000 7f4adffff700 1 -- 172.21.15.153:0/3545364497 shutdown_connections 2024-08-17T02:26:15.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.249+0000 7f4adffff700 1 -- 172.21.15.153:0/3545364497 wait complete. 2024-08-17T02:26:15.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.249+0000 7f4adffff700 1 Processor -- start 2024-08-17T02:26:15.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.253+0000 7f4adffff700 1 -- start start 2024-08-17T02:26:15.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.253+0000 7f4adffff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ae00ccaa0 0x7f4ae00c7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.253+0000 7f4adffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ae0153320 0x7f4ae0150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.253+0000 7f4adffff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ae015a190 0x7f4ae014ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.253+0000 7f4adffff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae014fed0 con 0x7f4ae0153320 2024-08-17T02:26:15.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.253+0000 7f4adffff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae01506b0 con 0x7f4ae00ccaa0 2024-08-17T02:26:15.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.253+0000 7f4adffff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae00c83b0 con 0x7f4ae015a190 2024-08-17T02:26:15.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.253+0000 7f4ad7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ae0153320 0x7f4ae0150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.253+0000 7f4ad7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ae0153320 0x7f4ae0150170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57270/0 (socket says 172.21.15.153:57270) 2024-08-17T02:26:15.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.253+0000 7f4ad7fff700 1 -- 172.21.15.153:0/20775487 learned_addr learned my addr 172.21.15.153:0/20775487 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:15.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.253+0000 7f4adf7fe700 1 --2- 172.21.15.153:0/20775487 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ae015a190 0x7f4ae014ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.253+0000 7f4adeffd700 1 --2- 172.21.15.153:0/20775487 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ae00ccaa0 0x7f4ae00c7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.253+0000 7f4ad7fff700 1 -- 172.21.15.153:0/20775487 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ae015a190 msgr2=0x7f4ae014ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.253+0000 7f4ad7fff700 1 --2- 172.21.15.153:0/20775487 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ae015a190 0x7f4ae014ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.253+0000 7f4ad7fff700 1 -- 172.21.15.153:0/20775487 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ae00ccaa0 msgr2=0x7f4ae00c7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.253+0000 7f4ad7fff700 1 --2- 172.21.15.153:0/20775487 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ae00ccaa0 0x7f4ae00c7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.253+0000 7f4ad7fff700 1 -- 172.21.15.153:0/20775487 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad0009420 con 0x7f4ae0153320 2024-08-17T02:26:15.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.253+0000 7f4ad7fff700 1 --2- 172.21.15.153:0/20775487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ae0153320 0x7f4ae0150170 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00ce570 tx=0x7f4ac8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:15.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.253+0000 7f4ad6ffd700 1 -- 172.21.15.153:0/20775487 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8000c40 con 0x7f4ae0153320 2024-08-17T02:26:15.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.253+0000 7f4ad6ffd700 1 -- 172.21.15.153:0/20775487 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac8011900 con 0x7f4ae0153320 2024-08-17T02:26:15.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.253+0000 7f4ad6ffd700 1 -- 172.21.15.153:0/20775487 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8025420 con 0x7f4ae0153320 2024-08-17T02:26:15.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.253+0000 7f4adffff700 1 -- 172.21.15.153:0/20775487 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac8009420 con 0x7f4ae0153320 2024-08-17T02:26:15.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.253+0000 7f4adffff700 1 -- 172.21.15.153:0/20775487 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ae00c8970 con 0x7f4ae0153320 2024-08-17T02:26:15.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.253+0000 7f4adffff700 1 -- 172.21.15.153:0/20775487 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ae00638f0 con 0x7f4ae0153320 2024-08-17T02:26:15.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.257+0000 7f4ad6ffd700 1 -- 172.21.15.153:0/20775487 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4ac8023070 con 0x7f4ae0153320 2024-08-17T02:26:15.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.257+0000 7f4ad6ffd700 1 --2- 172.21.15.153:0/20775487 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4ac0060860 0x7f4ac0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.257+0000 7f4ad6ffd700 1 -- 172.21.15.153:0/20775487 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4ac807df80 con 0x7f4ae0153320 2024-08-17T02:26:15.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.257+0000 7f4adeffd700 1 --2- 172.21.15.153:0/20775487 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4ac0060860 0x7f4ac0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.257+0000 7f4adeffd700 1 --2- 172.21.15.153:0/20775487 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4ac0060860 0x7f4ac0062d10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0009f40 tx=0x7f4ad00091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:15.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.265+0000 7f4ad6ffd700 1 -- 172.21.15.153:0/20775487 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f4ac80ae480 con 0x7f4ae0153320 2024-08-17T02:26:15.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.433+0000 7f4adffff700 1 -- 172.21.15.153:0/20775487 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ae00cdea0 con 0x7f4ae0153320 2024-08-17T02:26:15.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.437+0000 7f4ad6ffd700 1 -- 172.21.15.153:0/20775487 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f4ae00cdea0 con 0x7f4ae0153320 2024-08-17T02:26:15.439 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:15.440 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":21,"fsid":"56d41c33-b929-456d-96be-2aac4ecd299d","created":"2024-08-17T02:25:47.756085+0000","modified":"2024-08-17T02:26:13.759246+0000","last_up_change":"2024-08-17T02:25:58.643690+0000","last_in_change":"2024-08-17T02:25:49.809186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:58.093273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:09.856520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:11.080706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0736f8e6-818e-42e6-a0dc-8aaf813315d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":24234},{"type":"v1","addr":"172.21.15.153:6817","nonce":24234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":24234},{"type":"v1","addr":"172.21.15.153:6819","nonce":24234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":24234},{"type":"v1","addr":"172.21.15.153:6823","nonce":24234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":24234},{"type":"v1","addr":"172.21.15.153:6821","nonce":24234}]},"public_addr":"172.21.15.153:6817/24234","cluster_addr":"172.21.15.153:6819/24234","heartbeat_back_addr":"172.21.15.153:6823/24234","heartbeat_front_addr":"172.21.15.153:6821/24234","state":["exists","up"]},{"osd":1,"uuid":"011762e9-6c2d-441a-aa56-68474639d72f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":24232},{"type":"v1","addr":"172.21.15.153:6801","nonce":24232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":24232},{"type":"v1","addr":"172.21.15.153:6803","nonce":24232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":24232},{"type":"v1","addr":"172.21.15.153:6809","nonce":24232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":24232},{"type":"v1","addr":"172.21.15.153:6806","nonce":24232}]},"public_addr":"172.21.15.153:6801/24232","cluster_addr":"172.21.15.153:6803/24232","heartbeat_back_addr":"172.21.15.153:6809/24232","heartbeat_front_addr":"172.21.15.153:6806/24232","state":["exists","up"]},{"osd":2,"uuid":"b562cd97-aa12-455e-b46a-e720a2ec9d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":24235},{"type":"v1","addr":"172.21.15.153:6808","nonce":24235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":24235},{"type":"v1","addr":"172.21.15.153:6811","nonce":24235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":24235},{"type":"v1","addr":"172.21.15.153:6815","nonce":24235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":24235},{"type":"v1","addr":"172.21.15.153:6813","nonce":24235}]},"public_addr":"172.21.15.153:6808/24235","cluster_addr":"172.21.15.153:6811/24235","heartbeat_back_addr":"172.21.15.153:6815/24235","heartbeat_front_addr":"172.21.15.153:6813/24235","state":["exists","up"]},{"osd":3,"uuid":"222da52f-90c2-4132-a5d2-6f6cf83d4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":24236},{"type":"v1","addr":"172.21.15.153:6825","nonce":24236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":24236},{"type":"v1","addr":"172.21.15.153:6827","nonce":24236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":24236},{"type":"v1","addr":"172.21.15.153:6831","nonce":24236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":24236},{"type":"v1","addr":"172.21.15.153:6829","nonce":24236}]},"public_addr":"172.21.15.153:6825/24236","cluster_addr":"172.21.15.153:6827/24236","heartbeat_back_addr":"172.21.15.153:6831/24236","heartbeat_front_addr":"172.21.15.153:6829/24236","state":["exists","up"]},{"osd":4,"uuid":"a38a04cd-032b-4977-a260-1ef3567d0c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24456},{"type":"v1","addr":"172.21.15.174:6809","nonce":24456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24456},{"type":"v1","addr":"172.21.15.174:6811","nonce":24456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24456},{"type":"v1","addr":"172.21.15.174:6815","nonce":24456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24456},{"type":"v1","addr":"172.21.15.174:6813","nonce":24456}]},"public_addr":"172.21.15.174:6809/24456","cluster_addr":"172.21.15.174:6811/24456","heartbeat_back_addr":"172.21.15.174:6815/24456","heartbeat_front_addr":"172.21.15.174:6813/24456","state":["exists","up"]},{"osd":5,"uuid":"c7778084-e751-48da-87a1-ab8bbe85aa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24457},{"type":"v1","addr":"172.21.15.174:6825","nonce":24457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24457},{"type":"v1","addr":"172.21.15.174:6827","nonce":24457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24457},{"type":"v1","addr":"172.21.15.174:6831","nonce":24457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24457},{"type":"v1","addr":"172.21.15.174:6829","nonce":24457}]},"public_addr":"172.21.15.174:6825/24457","cluster_addr":"172.21.15.174:6827/24457","heartbeat_back_addr":"172.21.15.174:6831/24457","heartbeat_front_addr":"172.21.15.174:6829/24457","state":["exists","up"]},{"osd":6,"uuid":"2d8e0715-254f-442c-9625-50721d0bc858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24477},{"type":"v1","addr":"172.21.15.174:6801","nonce":24477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24477},{"type":"v1","addr":"172.21.15.174:6803","nonce":24477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24477},{"type":"v1","addr":"172.21.15.174:6807","nonce":24477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24477},{"type":"v1","addr":"172.21.15.174:6805","nonce":24477}]},"public_addr":"172.21.15.174:6801/24477","cluster_addr":"172.21.15.174:6803/24477","heartbeat_back_addr":"172.21.15.174:6807/24477","heartbeat_front_addr":"172.21.15.174:6805/24477","state":["exists","up"]},{"osd":7,"uuid":"dffda25a-4601-4ddb-9a27-b0be1cadde27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24455},{"type":"v1","addr":"172.21.15.174:6817","nonce":24455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24455},{"type":"v1","addr":"172.21.15.174:6819","nonce":24455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24455},{"type":"v1","addr":"172.21.15.174:6823","nonce":24455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24455},{"type":"v1","addr":"172.21.15.174:6821","nonce":24455}]},"public_addr":"172.21.15.174:6817/24455","cluster_addr":"172.21.15.174:6819/24455","heartbeat_back_addr":"172.21.15.174:6823/24455","heartbeat_front_addr":"172.21.15.174:6821/24455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.990117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.033862+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.748087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.112877+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.070448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.360961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.110940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.226377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:15.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.437+0000 7f4adffff700 1 -- 172.21.15.153:0/20775487 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4ac0060860 msgr2=0x7f4ac0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.437+0000 7f4adffff700 1 --2- 172.21.15.153:0/20775487 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4ac0060860 0x7f4ac0062d10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0009f40 tx=0x7f4ad00091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.437+0000 7f4adffff700 1 -- 172.21.15.153:0/20775487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ae0153320 msgr2=0x7f4ae0150170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.437+0000 7f4adffff700 1 --2- 172.21.15.153:0/20775487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ae0153320 0x7f4ae0150170 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00ce570 tx=0x7f4ac8017000 comp rx=0 tx=0).stop 2024-08-17T02:26:15.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.437+0000 7f4adffff700 1 -- 172.21.15.153:0/20775487 shutdown_connections 2024-08-17T02:26:15.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.437+0000 7f4adffff700 1 --2- 172.21.15.153:0/20775487 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4ac0060860 0x7f4ac0062d10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.437+0000 7f4adffff700 1 --2- 172.21.15.153:0/20775487 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ae015a190 0x7f4ae014ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.437+0000 7f4adffff700 1 --2- 172.21.15.153:0/20775487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ae0153320 0x7f4ae0150170 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.437+0000 7f4adffff700 1 --2- 172.21.15.153:0/20775487 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ae00ccaa0 0x7f4ae00c7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.437+0000 7f4adffff700 1 -- 172.21.15.153:0/20775487 >> 172.21.15.153:0/20775487 conn(0x7f4ae00d00a0 msgr2=0x7f4ae0066e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:15.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.437+0000 7f4adffff700 1 -- 172.21.15.153:0/20775487 shutdown_connections 2024-08-17T02:26:15.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.437+0000 7f4adffff700 1 -- 172.21.15.153:0/20775487 wait complete. 2024-08-17T02:26:15.454 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:26:15.454 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:26:15.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.561+0000 7fb1db05c700 1 Processor -- start 2024-08-17T02:26:15.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.561+0000 7fb1db05c700 1 -- start start 2024-08-17T02:26:15.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.565+0000 7fb1db05c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb1d41553e0 0x7fb1d40af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.565+0000 7fb1db05c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1d40686a0 0x7fb1d4068b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.565+0000 7fb1db05c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1d4155c00 con 0x7fb1d41557b0 2024-08-17T02:26:15.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.565+0000 7fb1db05c700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d4069040 con 0x7fb1d41553e0 2024-08-17T02:26:15.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.565+0000 7fb1db05c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d4155e30 con 0x7fb1d40686a0 2024-08-17T02:26:15.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.565+0000 7fb1da05a700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb1d41553e0 0x7fb1d40af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.565+0000 7fb1da05a700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb1d41553e0 0x7fb1d40af4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57284/0 (socket says 172.21.15.153:57284) 2024-08-17T02:26:15.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.565+0000 7fb1da05a700 1 -- 172.21.15.153:0/3716756055 learned_addr learned my addr 172.21.15.153:0/3716756055 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:15.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.565+0000 7fb1da85b700 1 --2- 172.21.15.153:0/3716756055 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1d40686a0 0x7fb1d4068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.565+0000 7fb1da05a700 1 -- 172.21.15.153:0/3716756055 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1d40686a0 msgr2=0x7fb1d4068b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:15.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.565+0000 7fb1da05a700 1 --2- 172.21.15.153:0/3716756055 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1d40686a0 0x7fb1d4068b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.565+0000 7fb1da05a700 1 -- 172.21.15.153:0/3716756055 >> v1:172.21.15.174:6789/0 conn(0x7fb1d41557b0 legacy=0x7fb1d40b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.565+0000 7fb1da05a700 1 -- 172.21.15.153:0/3716756055 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d4156110 con 0x7fb1d41553e0 2024-08-17T02:26:15.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.565+0000 7fb1da05a700 1 --2- 172.21.15.153:0/3716756055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1d41553e0 0x7fb1d40af4d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb1d00099b0 tx=0x7fb1d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=873c86ca107aaaa7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:15.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.565+0000 7fb1d9058700 1 -- 172.21.15.153:0/3716756055 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d0009ea0 con 0x7fb1d41553e0 2024-08-17T02:26:15.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.565+0000 7fb1d9058700 1 -- 172.21.15.153:0/3716756055 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d000b860 con 0x7fb1d41553e0 2024-08-17T02:26:15.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.565+0000 7fb1d9058700 1 -- 172.21.15.153:0/3716756055 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d000bc00 con 0x7fb1d41553e0 2024-08-17T02:26:15.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.565+0000 7fb1db05c700 1 -- 172.21.15.153:0/3716756055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1d41553e0 msgr2=0x7fb1d40af4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.565+0000 7fb1db05c700 1 --2- 172.21.15.153:0/3716756055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1d41553e0 0x7fb1d40af4d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb1d00099b0 tx=0x7fb1d0009250 comp rx=0 tx=0).stop 2024-08-17T02:26:15.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.565+0000 7fb1db05c700 1 -- 172.21.15.153:0/3716756055 shutdown_connections 2024-08-17T02:26:15.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.565+0000 7fb1db05c700 1 --2- 172.21.15.153:0/3716756055 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1d40686a0 0x7fb1d4068b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.565+0000 7fb1db05c700 1 --2- 172.21.15.153:0/3716756055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1d41553e0 0x7fb1d40af4d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.565+0000 7fb1db05c700 1 -- 172.21.15.153:0/3716756055 >> 172.21.15.153:0/3716756055 conn(0x7fb1d406d800 msgr2=0x7fb1d406dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:15.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.565+0000 7fb1db05c700 1 -- 172.21.15.153:0/3716756055 shutdown_connections 2024-08-17T02:26:15.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.569+0000 7fb1db05c700 1 -- 172.21.15.153:0/3716756055 wait complete. 2024-08-17T02:26:15.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.569+0000 7fb1db05c700 1 Processor -- start 2024-08-17T02:26:15.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.569+0000 7fb1db05c700 1 -- start start 2024-08-17T02:26:15.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.569+0000 7fb1db05c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1d40686a0 0x7fb1d41534d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.569+0000 7fb1db05c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1d41553e0 0x7fb1d40ad750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.569+0000 7fb1db05c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1d41557b0 0x7fb1d40adc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.569+0000 7fb1db05c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d4168190 con 0x7fb1d41557b0 2024-08-17T02:26:15.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.569+0000 7fb1db05c700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d4168470 con 0x7fb1d41553e0 2024-08-17T02:26:15.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.569+0000 7fb1db05c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d4153dd0 con 0x7fb1d40686a0 2024-08-17T02:26:15.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.569+0000 7fb1da85b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1d41557b0 0x7fb1d40adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.569+0000 7fb1da85b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1d41557b0 0x7fb1d40adc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57288/0 (socket says 172.21.15.153:57288) 2024-08-17T02:26:15.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.569+0000 7fb1da85b700 1 -- 172.21.15.153:0/888570883 learned_addr learned my addr 172.21.15.153:0/888570883 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:15.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.569+0000 7fb1da05a700 1 --2- 172.21.15.153:0/888570883 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1d40686a0 0x7fb1d41534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.569+0000 7fb1d9859700 1 --2- 172.21.15.153:0/888570883 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1d41553e0 0x7fb1d40ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.569+0000 7fb1da85b700 1 -- 172.21.15.153:0/888570883 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1d40686a0 msgr2=0x7fb1d41534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.569+0000 7fb1da85b700 1 --2- 172.21.15.153:0/888570883 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1d40686a0 0x7fb1d41534d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.569+0000 7fb1da85b700 1 -- 172.21.15.153:0/888570883 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1d41553e0 msgr2=0x7fb1d40ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.569+0000 7fb1da85b700 1 --2- 172.21.15.153:0/888570883 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1d41553e0 0x7fb1d40ad750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.569+0000 7fb1da85b700 1 -- 172.21.15.153:0/888570883 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d00094f0 con 0x7fb1d41557b0 2024-08-17T02:26:15.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.569+0000 7fb1da85b700 1 --2- 172.21.15.153:0/888570883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1d41557b0 0x7fb1d40adc90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc009f10 tx=0x7fb1cc00a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:15.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.569+0000 7fb1ca7fc700 1 -- 172.21.15.153:0/888570883 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc007cb0 con 0x7fb1d41557b0 2024-08-17T02:26:15.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.573+0000 7fb1ca7fc700 1 -- 172.21.15.153:0/888570883 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1cc010040 con 0x7fb1d41557b0 2024-08-17T02:26:15.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.573+0000 7fb1db05c700 1 -- 172.21.15.153:0/888570883 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d41540b0 con 0x7fb1d41557b0 2024-08-17T02:26:15.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.573+0000 7fb1ca7fc700 1 -- 172.21.15.153:0/888570883 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc014640 con 0x7fb1d41557b0 2024-08-17T02:26:15.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.573+0000 7fb1db05c700 1 -- 172.21.15.153:0/888570883 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d4153a10 con 0x7fb1d41557b0 2024-08-17T02:26:15.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.573+0000 7fb1db05c700 1 -- 172.21.15.153:0/888570883 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d41685e0 con 0x7fb1d41557b0 2024-08-17T02:26:15.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.573+0000 7fb1ca7fc700 1 -- 172.21.15.153:0/888570883 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb1cc014a30 con 0x7fb1d41557b0 2024-08-17T02:26:15.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.573+0000 7fb1ca7fc700 1 --2- 172.21.15.153:0/888570883 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb1b8060860 0x7fb1b8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.573+0000 7fb1ca7fc700 1 -- 172.21.15.153:0/888570883 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb1cc07d320 con 0x7fb1d41557b0 2024-08-17T02:26:15.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.573+0000 7fb1da05a700 1 --2- 172.21.15.153:0/888570883 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb1b8060860 0x7fb1b8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.573+0000 7fb1da05a700 1 --2- 172.21.15.153:0/888570883 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb1b8060860 0x7fb1b8062d10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb1d00099b0 tx=0x7fb1d0017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:15.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.581+0000 7fb1ca7fc700 1 -- 172.21.15.153:0/888570883 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb1cc04d770 con 0x7fb1d41557b0 2024-08-17T02:26:15.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.741+0000 7fb1db05c700 1 -- 172.21.15.153:0/888570883 --> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb1d40638f0 con 0x7fb1b8060860 2024-08-17T02:26:15.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.749+0000 7fb1ca7fc700 1 -- 172.21.15.153:0/888570883 <== mgr.4104 v2:172.21.15.153:6832/24147 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252693 (secure 0 0 0) 0x7fb1d40638f0 con 0x7fb1b8060860 2024-08-17T02:26:15.755 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:15.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.753+0000 7fb1db05c700 1 -- 172.21.15.153:0/888570883 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb1b8060860 msgr2=0x7fb1b8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.753+0000 7fb1db05c700 1 --2- 172.21.15.153:0/888570883 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb1b8060860 0x7fb1b8062d10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb1d00099b0 tx=0x7fb1d0017000 comp rx=0 tx=0).stop 2024-08-17T02:26:15.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.753+0000 7fb1db05c700 1 -- 172.21.15.153:0/888570883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1d41557b0 msgr2=0x7fb1d40adc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.753+0000 7fb1db05c700 1 --2- 172.21.15.153:0/888570883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1d41557b0 0x7fb1d40adc90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc009f10 tx=0x7fb1cc00a890 comp rx=0 tx=0).stop 2024-08-17T02:26:15.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.753+0000 7fb1db05c700 1 -- 172.21.15.153:0/888570883 shutdown_connections 2024-08-17T02:26:15.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.753+0000 7fb1db05c700 1 --2- 172.21.15.153:0/888570883 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb1b8060860 0x7fb1b8062d10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.753+0000 7fb1db05c700 1 --2- 172.21.15.153:0/888570883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1d41557b0 0x7fb1d40adc90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.753+0000 7fb1db05c700 1 --2- 172.21.15.153:0/888570883 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1d41553e0 0x7fb1d40ad750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.753+0000 7fb1db05c700 1 --2- 172.21.15.153:0/888570883 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1d40686a0 0x7fb1d41534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.753+0000 7fb1db05c700 1 -- 172.21.15.153:0/888570883 >> 172.21.15.153:0/888570883 conn(0x7fb1d406d800 msgr2=0x7fb1d406b090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:15.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.753+0000 7fb1db05c700 1 -- 172.21.15.153:0/888570883 shutdown_connections 2024-08-17T02:26:15.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.753+0000 7fb1db05c700 1 -- 172.21.15.153:0/888570883 wait complete. 2024-08-17T02:26:15.759 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-08-17T02:26:15.768 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-08-17T02:26:14.036409+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590972,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":181,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":38,"acting":38,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":2381336,"kb_used_data":2480,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752593384,"statfs":{"total":773094113280,"available":770655625216,"internally_reserved":0,"allocated":2539520,"data_stored":1584645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":604,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001176"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.758694+0000","last_change":"2024-08-17T02:26:12.758694+0000","last_active":"2024-08-17T02:26:12.758694+0000","last_peered":"2024-08-17T02:26:12.758694+0000","last_clean":"2024-08-17T02:26:12.758694+0000","last_became_active":"2024-08-17T02:26:12.758036+0000","last_became_peered":"2024-08-17T02:26:12.758036+0000","last_unstale":"2024-08-17T02:26:12.758694+0000","last_undegraded":"2024-08-17T02:26:12.758694+0000","last_fullsized":"2024-08-17T02:26:12.758694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:48:08.511164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.762220+0000","last_change":"2024-08-17T02:26:12.762220+0000","last_active":"2024-08-17T02:26:12.762220+0000","last_peered":"2024-08-17T02:26:12.762220+0000","last_clean":"2024-08-17T02:26:12.762220+0000","last_became_active":"2024-08-17T02:26:12.761872+0000","last_became_peered":"2024-08-17T02:26:12.761872+0000","last_unstale":"2024-08-17T02:26:12.762220+0000","last_undegraded":"2024-08-17T02:26:12.762220+0000","last_fullsized":"2024-08-17T02:26:12.762220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:40:15.880102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.761378+0000","last_change":"2024-08-17T02:26:12.761378+0000","last_active":"2024-08-17T02:26:12.761378+0000","last_peered":"2024-08-17T02:26:12.761378+0000","last_clean":"2024-08-17T02:26:12.761378+0000","last_became_active":"2024-08-17T02:26:12.761023+0000","last_became_peered":"2024-08-17T02:26:12.761023+0000","last_unstale":"2024-08-17T02:26:12.761378+0000","last_undegraded":"2024-08-17T02:26:12.761378+0000","last_fullsized":"2024-08-17T02:26:12.761378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:48:08.511164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.764704+0000","last_change":"2024-08-17T02:26:12.764704+0000","last_active":"2024-08-17T02:26:12.764704+0000","last_peered":"2024-08-17T02:26:12.764704+0000","last_clean":"2024-08-17T02:26:12.764704+0000","last_became_active":"2024-08-17T02:26:12.764364+0000","last_became_peered":"2024-08-17T02:26:12.764364+0000","last_unstale":"2024-08-17T02:26:12.764704+0000","last_undegraded":"2024-08-17T02:26:12.764704+0000","last_fullsized":"2024-08-17T02:26:12.764704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:04:38.025404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.771799+0000","last_change":"2024-08-17T02:26:12.771799+0000","last_active":"2024-08-17T02:26:12.771799+0000","last_peered":"2024-08-17T02:26:12.771799+0000","last_clean":"2024-08-17T02:26:12.771799+0000","last_became_active":"2024-08-17T02:26:12.771451+0000","last_became_peered":"2024-08-17T02:26:12.771451+0000","last_unstale":"2024-08-17T02:26:12.771799+0000","last_undegraded":"2024-08-17T02:26:12.771799+0000","last_fullsized":"2024-08-17T02:26:12.771799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:49:58.271852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.764126+0000","last_change":"2024-08-17T02:26:12.764126+0000","last_active":"2024-08-17T02:26:12.764126+0000","last_peered":"2024-08-17T02:26:12.764126+0000","last_clean":"2024-08-17T02:26:12.764126+0000","last_became_active":"2024-08-17T02:26:12.763871+0000","last_became_peered":"2024-08-17T02:26:12.763871+0000","last_unstale":"2024-08-17T02:26:12.764126+0000","last_undegraded":"2024-08-17T02:26:12.764126+0000","last_fullsized":"2024-08-17T02:26:12.764126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:52.634628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:10.708539+0000","last_change":"2024-08-17T02:26:10.708539+0000","last_active":"2024-08-17T02:26:10.708539+0000","last_peered":"2024-08-17T02:26:10.708539+0000","last_clean":"2024-08-17T02:26:10.708539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:10.708539+0000","last_undegraded":"2024-08-17T02:26:10.708539+0000","last_fullsized":"2024-08-17T02:26:10.708539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.761203+0000","last_change":"2024-08-17T02:26:12.761203+0000","last_active":"2024-08-17T02:26:12.761203+0000","last_peered":"2024-08-17T02:26:12.761203+0000","last_clean":"2024-08-17T02:26:12.761203+0000","last_became_active":"2024-08-17T02:26:12.759701+0000","last_became_peered":"2024-08-17T02:26:12.759701+0000","last_unstale":"2024-08-17T02:26:12.761203+0000","last_undegraded":"2024-08-17T02:26:12.761203+0000","last_fullsized":"2024-08-17T02:26:12.761203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:11:48.128685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:10.708539+0000","last_change":"2024-08-17T02:26:10.708539+0000","last_active":"2024-08-17T02:26:10.708539+0000","last_peered":"2024-08-17T02:26:10.708539+0000","last_clean":"2024-08-17T02:26:10.708539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:10.708539+0000","last_undegraded":"2024-08-17T02:26:10.708539+0000","last_fullsized":"2024-08-17T02:26:10.708539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:10.708539+0000","last_change":"2024-08-17T02:26:10.708539+0000","last_active":"2024-08-17T02:26:10.708539+0000","last_peered":"2024-08-17T02:26:10.708539+0000","last_clean":"2024-08-17T02:26:10.708539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:10.708539+0000","last_undegraded":"2024-08-17T02:26:10.708539+0000","last_fullsized":"2024-08-17T02:26:10.708539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:10.708539+0000","last_change":"2024-08-17T02:26:10.708539+0000","last_active":"2024-08-17T02:26:10.708539+0000","last_peered":"2024-08-17T02:26:10.708539+0000","last_clean":"2024-08-17T02:26:10.708539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:10.708539+0000","last_undegraded":"2024-08-17T02:26:10.708539+0000","last_fullsized":"2024-08-17T02:26:10.708539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:10.708539+0000","last_change":"2024-08-17T02:26:10.708539+0000","last_active":"2024-08-17T02:26:10.708539+0000","last_peered":"2024-08-17T02:26:10.708539+0000","last_clean":"2024-08-17T02:26:10.708539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:10.708539+0000","last_undegraded":"2024-08-17T02:26:10.708539+0000","last_fullsized":"2024-08-17T02:26:10.708539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:10.708539+0000","last_change":"2024-08-17T02:26:10.708539+0000","last_active":"2024-08-17T02:26:10.708539+0000","last_peered":"2024-08-17T02:26:10.708539+0000","last_clean":"2024-08-17T02:26:10.708539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:10.708539+0000","last_undegraded":"2024-08-17T02:26:10.708539+0000","last_fullsized":"2024-08-17T02:26:10.708539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.763838+0000","last_change":"2024-08-17T02:26:12.763838+0000","last_active":"2024-08-17T02:26:12.763838+0000","last_peered":"2024-08-17T02:26:12.763838+0000","last_clean":"2024-08-17T02:26:12.763838+0000","last_became_active":"2024-08-17T02:26:12.763383+0000","last_became_peered":"2024-08-17T02:26:12.763383+0000","last_unstale":"2024-08-17T02:26:12.763838+0000","last_undegraded":"2024-08-17T02:26:12.763838+0000","last_fullsized":"2024-08-17T02:26:12.763838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:58:46.781607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:10.708539+0000","last_change":"2024-08-17T02:26:10.708539+0000","last_active":"2024-08-17T02:26:10.708539+0000","last_peered":"2024-08-17T02:26:10.708539+0000","last_clean":"2024-08-17T02:26:10.708539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:10.708539+0000","last_undegraded":"2024-08-17T02:26:10.708539+0000","last_fullsized":"2024-08-17T02:26:10.708539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:10.708539+0000","last_change":"2024-08-17T02:26:10.708539+0000","last_active":"2024-08-17T02:26:10.708539+0000","last_peered":"2024-08-17T02:26:10.708539+0000","last_clean":"2024-08-17T02:26:10.708539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:10.708539+0000","last_undegraded":"2024-08-17T02:26:10.708539+0000","last_fullsized":"2024-08-17T02:26:10.708539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.780977+0000","last_change":"2024-08-17T02:26:11.743421+0000","last_active":"2024-08-17T02:26:12.780977+0000","last_peered":"2024-08-17T02:26:12.780977+0000","last_clean":"2024-08-17T02:26:12.780977+0000","last_became_active":"2024-08-17T02:26:11.743158+0000","last_became_peered":"2024-08-17T02:26:11.743158+0000","last_unstale":"2024-08-17T02:26:12.780977+0000","last_undegraded":"2024-08-17T02:26:12.780977+0000","last_fullsized":"2024-08-17T02:26:12.780977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:09:59.680512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.769818+0000","last_change":"2024-08-17T02:26:12.769818+0000","last_active":"2024-08-17T02:26:12.769818+0000","last_peered":"2024-08-17T02:26:12.769818+0000","last_clean":"2024-08-17T02:26:12.769818+0000","last_became_active":"2024-08-17T02:26:12.769239+0000","last_became_peered":"2024-08-17T02:26:12.769239+0000","last_unstale":"2024-08-17T02:26:12.769818+0000","last_undegraded":"2024-08-17T02:26:12.769818+0000","last_fullsized":"2024-08-17T02:26:12.769818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:18.753712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:10.708539+0000","last_change":"2024-08-17T02:26:10.708539+0000","last_active":"2024-08-17T02:26:10.708539+0000","last_peered":"2024-08-17T02:26:10.708539+0000","last_clean":"2024-08-17T02:26:10.708539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:10.708539+0000","last_undegraded":"2024-08-17T02:26:10.708539+0000","last_fullsized":"2024-08-17T02:26:10.708539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:10.708539+0000","last_change":"2024-08-17T02:26:10.708539+0000","last_active":"2024-08-17T02:26:10.708539+0000","last_peered":"2024-08-17T02:26:10.708539+0000","last_clean":"2024-08-17T02:26:10.708539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:10.708539+0000","last_undegraded":"2024-08-17T02:26:10.708539+0000","last_fullsized":"2024-08-17T02:26:10.708539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.782649+0000","last_change":"2024-08-17T02:26:11.745341+0000","last_active":"2024-08-17T02:26:12.782649+0000","last_peered":"2024-08-17T02:26:12.782649+0000","last_clean":"2024-08-17T02:26:12.782649+0000","last_became_active":"2024-08-17T02:26:11.745025+0000","last_became_peered":"2024-08-17T02:26:11.745025+0000","last_unstale":"2024-08-17T02:26:12.782649+0000","last_undegraded":"2024-08-17T02:26:12.782649+0000","last_fullsized":"2024-08-17T02:26:12.782649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:47:43.451789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:10.708539+0000","last_change":"2024-08-17T02:26:10.708539+0000","last_active":"2024-08-17T02:26:10.708539+0000","last_peered":"2024-08-17T02:26:10.708539+0000","last_clean":"2024-08-17T02:26:10.708539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:10.708539+0000","last_undegraded":"2024-08-17T02:26:10.708539+0000","last_fullsized":"2024-08-17T02:26:10.708539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.780268+0000","last_change":"2024-08-17T02:26:11.746064+0000","last_active":"2024-08-17T02:26:12.780268+0000","last_peered":"2024-08-17T02:26:12.780268+0000","last_clean":"2024-08-17T02:26:12.780268+0000","last_became_active":"2024-08-17T02:26:11.745735+0000","last_became_peered":"2024-08-17T02:26:11.745735+0000","last_unstale":"2024-08-17T02:26:12.780268+0000","last_undegraded":"2024-08-17T02:26:12.780268+0000","last_fullsized":"2024-08-17T02:26:12.780268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:18:27.869243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:10.708539+0000","last_change":"2024-08-17T02:26:10.708539+0000","last_active":"2024-08-17T02:26:10.708539+0000","last_peered":"2024-08-17T02:26:10.708539+0000","last_clean":"2024-08-17T02:26:10.708539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:10.708539+0000","last_undegraded":"2024-08-17T02:26:10.708539+0000","last_fullsized":"2024-08-17T02:26:10.708539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:11.749512+0000","last_change":"2024-08-17T02:26:11.744390+0000","last_active":"2024-08-17T02:26:11.749512+0000","last_peered":"2024-08-17T02:26:11.749512+0000","last_clean":"2024-08-17T02:26:11.749512+0000","last_became_active":"2024-08-17T02:26:11.744090+0000","last_became_peered":"2024-08-17T02:26:11.744090+0000","last_unstale":"2024-08-17T02:26:11.749512+0000","last_undegraded":"2024-08-17T02:26:11.749512+0000","last_fullsized":"2024-08-17T02:26:11.749512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:45:35.172781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":159,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-08-17T02:26:01.678090+0000","last_change":"2024-08-17T02:26:00.033569+0000","last_active":"2024-08-17T02:26:01.678090+0000","last_peered":"2024-08-17T02:26:01.678090+0000","last_clean":"2024-08-17T02:26:01.678090+0000","last_became_active":"2024-08-17T02:26:00.031512+0000","last_became_peered":"2024-08-17T02:26:00.031512+0000","last_unstale":"2024-08-17T02:26:01.678090+0000","last_undegraded":"2024-08-17T02:26:01.678090+0000","last_fullsized":"2024-08-17T02:26:01.678090+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:58.643690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:58.643690+0000","last_clean_scrub_stamp":"2024-08-17T02:25:58.643690+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:47:24.121981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:10.708539+0000","last_change":"2024-08-17T02:26:10.708539+0000","last_active":"2024-08-17T02:26:10.708539+0000","last_peered":"2024-08-17T02:26:10.708539+0000","last_clean":"2024-08-17T02:26:10.708539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:10.708539+0000","last_undegraded":"2024-08-17T02:26:10.708539+0000","last_fullsized":"2024-08-17T02:26:10.708539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:10.708539+0000","last_change":"2024-08-17T02:26:10.708539+0000","last_active":"2024-08-17T02:26:10.708539+0000","last_peered":"2024-08-17T02:26:10.708539+0000","last_clean":"2024-08-17T02:26:10.708539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:10.708539+0000","last_undegraded":"2024-08-17T02:26:10.708539+0000","last_fullsized":"2024-08-17T02:26:10.708539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.758664+0000","last_change":"2024-08-17T02:26:12.758664+0000","last_active":"2024-08-17T02:26:12.758664+0000","last_peered":"2024-08-17T02:26:12.758664+0000","last_clean":"2024-08-17T02:26:12.758664+0000","last_became_active":"2024-08-17T02:26:12.758221+0000","last_became_peered":"2024-08-17T02:26:12.758221+0000","last_unstale":"2024-08-17T02:26:12.758664+0000","last_undegraded":"2024-08-17T02:26:12.758664+0000","last_fullsized":"2024-08-17T02:26:12.758664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:15:37.296290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:11.752548+0000","last_change":"2024-08-17T02:26:11.746935+0000","last_active":"2024-08-17T02:26:11.752548+0000","last_peered":"2024-08-17T02:26:11.752548+0000","last_clean":"2024-08-17T02:26:11.752548+0000","last_became_active":"2024-08-17T02:26:11.746769+0000","last_became_peered":"2024-08-17T02:26:11.746769+0000","last_unstale":"2024-08-17T02:26:11.752548+0000","last_undegraded":"2024-08-17T02:26:11.752548+0000","last_fullsized":"2024-08-17T02:26:11.752548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:31:45.321709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:10.708539+0000","last_change":"2024-08-17T02:26:10.708539+0000","last_active":"2024-08-17T02:26:10.708539+0000","last_peered":"2024-08-17T02:26:10.708539+0000","last_clean":"2024-08-17T02:26:10.708539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:10.708539+0000","last_undegraded":"2024-08-17T02:26:10.708539+0000","last_fullsized":"2024-08-17T02:26:10.708539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:10.708539+0000","last_change":"2024-08-17T02:26:10.708539+0000","last_active":"2024-08-17T02:26:10.708539+0000","last_peered":"2024-08-17T02:26:10.708539+0000","last_clean":"2024-08-17T02:26:10.708539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:10.708539+0000","last_undegraded":"2024-08-17T02:26:10.708539+0000","last_fullsized":"2024-08-17T02:26:10.708539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:10.708539+0000","last_change":"2024-08-17T02:26:10.708539+0000","last_active":"2024-08-17T02:26:10.708539+0000","last_peered":"2024-08-17T02:26:10.708539+0000","last_clean":"2024-08-17T02:26:10.708539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:10.708539+0000","last_undegraded":"2024-08-17T02:26:10.708539+0000","last_fullsized":"2024-08-17T02:26:10.708539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:10.708539+0000","last_change":"2024-08-17T02:26:10.708539+0000","last_active":"2024-08-17T02:26:10.708539+0000","last_peered":"2024-08-17T02:26:10.708539+0000","last_clean":"2024-08-17T02:26:10.708539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:10.708539+0000","last_undegraded":"2024-08-17T02:26:10.708539+0000","last_fullsized":"2024-08-17T02:26:10.708539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:10.708539+0000","last_change":"2024-08-17T02:26:10.708539+0000","last_active":"2024-08-17T02:26:10.708539+0000","last_peered":"2024-08-17T02:26:10.708539+0000","last_clean":"2024-08-17T02:26:10.708539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:10.708539+0000","last_undegraded":"2024-08-17T02:26:10.708539+0000","last_fullsized":"2024-08-17T02:26:10.708539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.759849+0000","last_change":"2024-08-17T02:26:12.759849+0000","last_active":"2024-08-17T02:26:12.759849+0000","last_peered":"2024-08-17T02:26:12.759849+0000","last_clean":"2024-08-17T02:26:12.759849+0000","last_became_active":"2024-08-17T02:26:12.759502+0000","last_became_peered":"2024-08-17T02:26:12.759502+0000","last_unstale":"2024-08-17T02:26:12.759849+0000","last_undegraded":"2024-08-17T02:26:12.759849+0000","last_fullsized":"2024-08-17T02:26:12.759849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:00:16.197120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:10.708539+0000","last_change":"2024-08-17T02:26:10.708539+0000","last_active":"2024-08-17T02:26:10.708539+0000","last_peered":"2024-08-17T02:26:10.708539+0000","last_clean":"2024-08-17T02:26:10.708539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:10.708539+0000","last_undegraded":"2024-08-17T02:26:10.708539+0000","last_fullsized":"2024-08-17T02:26:10.708539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:10.708539+0000","last_change":"2024-08-17T02:26:10.708539+0000","last_active":"2024-08-17T02:26:10.708539+0000","last_peered":"2024-08-17T02:26:10.708539+0000","last_clean":"2024-08-17T02:26:10.708539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:10.708539+0000","last_undegraded":"2024-08-17T02:26:10.708539+0000","last_fullsized":"2024-08-17T02:26:10.708539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:10.708539+0000","last_change":"2024-08-17T02:26:10.708539+0000","last_active":"2024-08-17T02:26:10.708539+0000","last_peered":"2024-08-17T02:26:10.708539+0000","last_clean":"2024-08-17T02:26:10.708539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:10.708539+0000","last_undegraded":"2024-08-17T02:26:10.708539+0000","last_fullsized":"2024-08-17T02:26:10.708539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:10.708539+0000","last_change":"2024-08-17T02:26:10.708539+0000","last_active":"2024-08-17T02:26:10.708539+0000","last_peered":"2024-08-17T02:26:10.708539+0000","last_clean":"2024-08-17T02:26:10.708539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:10.708539+0000","last_undegraded":"2024-08-17T02:26:10.708539+0000","last_fullsized":"2024-08-17T02:26:10.708539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:10.708539+0000","last_change":"2024-08-17T02:26:10.708539+0000","last_active":"2024-08-17T02:26:10.708539+0000","last_peered":"2024-08-17T02:26:10.708539+0000","last_clean":"2024-08-17T02:26:10.708539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:10.708539+0000","last_undegraded":"2024-08-17T02:26:10.708539+0000","last_fullsized":"2024-08-17T02:26:10.708539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:10.708539+0000","last_change":"2024-08-17T02:26:10.708539+0000","last_active":"2024-08-17T02:26:10.708539+0000","last_peered":"2024-08-17T02:26:10.708539+0000","last_clean":"2024-08-17T02:26:10.708539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:10.708539+0000","last_undegraded":"2024-08-17T02:26:10.708539+0000","last_fullsized":"2024-08-17T02:26:10.708539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.763641+0000","last_change":"2024-08-17T02:26:12.763641+0000","last_active":"2024-08-17T02:26:12.763641+0000","last_peered":"2024-08-17T02:26:12.763641+0000","last_clean":"2024-08-17T02:26:12.763641+0000","last_became_active":"2024-08-17T02:26:12.763027+0000","last_became_peered":"2024-08-17T02:26:12.763027+0000","last_unstale":"2024-08-17T02:26:12.763641+0000","last_undegraded":"2024-08-17T02:26:12.763641+0000","last_fullsized":"2024-08-17T02:26:12.763641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:49:37.970276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:10.708539+0000","last_change":"2024-08-17T02:26:10.708539+0000","last_active":"2024-08-17T02:26:10.708539+0000","last_peered":"2024-08-17T02:26:10.708539+0000","last_clean":"2024-08-17T02:26:10.708539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:10.708539+0000","last_undegraded":"2024-08-17T02:26:10.708539+0000","last_fullsized":"2024-08-17T02:26:10.708539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:11.716679+0000","last_change":"2024-08-17T02:26:11.716679+0000","last_active":"2024-08-17T02:26:11.716679+0000","last_peered":"2024-08-17T02:26:11.716679+0000","last_clean":"2024-08-17T02:26:11.716679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:11.716679+0000","last_undegraded":"2024-08-17T02:26:11.716679+0000","last_fullsized":"2024-08-17T02:26:11.716679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.789231+0000","last_change":"2024-08-17T02:26:11.750667+0000","last_active":"2024-08-17T02:26:12.789231+0000","last_peered":"2024-08-17T02:26:12.789231+0000","last_clean":"2024-08-17T02:26:12.789231+0000","last_became_active":"2024-08-17T02:26:11.750353+0000","last_became_peered":"2024-08-17T02:26:11.750353+0000","last_unstale":"2024-08-17T02:26:12.789231+0000","last_undegraded":"2024-08-17T02:26:12.789231+0000","last_fullsized":"2024-08-17T02:26:12.789231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:57:03.276859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":604,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":12,"acting":12,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298092,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073748,"statfs":{"total":96636764160,"available":96331517952,"internally_reserved":0,"allocated":753664,"data_stored":636916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.335}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4830000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.194}]}]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297512,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":159744,"data_stored":46548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3140000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297512,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":159744,"data_stored":46548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.335}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3029999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.28}]}]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297516,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074324,"statfs":{"total":96636764160,"available":96332107776,"internally_reserved":0,"allocated":159744,"data_stored":46548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]}]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297512,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":159744,"data_stored":46548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3740000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297512,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":159744,"data_stored":46548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.244}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":184320,"data_stored":58616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298144,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073696,"statfs":{"total":96636764160,"available":96331464704,"internally_reserved":0,"allocated":802816,"data_stored":656373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:26:15.773 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:26:15.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.873+0000 7f7782223700 1 Processor -- start 2024-08-17T02:26:15.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.873+0000 7f7782223700 1 -- start start 2024-08-17T02:26:15.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.877+0000 7f7782223700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f777c0b0e90 0x7f777c159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.877+0000 7f7782223700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f777c153430 0x7f777c153890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.877+0000 7f7782223700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f777c0b1c50 con 0x7f777c159c00 2024-08-17T02:26:15.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.877+0000 7f7782223700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f777c15a8c0 con 0x7f777c0b0e90 2024-08-17T02:26:15.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.877+0000 7f7782223700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f777c0ac890 con 0x7f777c153430 2024-08-17T02:26:15.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.877+0000 7f7780a20700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f777c0b0e90 0x7f777c159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.877+0000 7f7780a20700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f777c0b0e90 0x7f777c159fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57298/0 (socket says 172.21.15.153:57298) 2024-08-17T02:26:15.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.877+0000 7f7780a20700 1 -- 172.21.15.153:0/3394300261 learned_addr learned my addr 172.21.15.153:0/3394300261 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:15.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.877+0000 7f7781a22700 1 --2- 172.21.15.153:0/3394300261 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f777c153430 0x7f777c153890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.877+0000 7f7780a20700 1 -- 172.21.15.153:0/3394300261 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f777c153430 msgr2=0x7f777c153890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:15.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.877+0000 7f7780a20700 1 --2- 172.21.15.153:0/3394300261 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f777c153430 0x7f777c153890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.877+0000 7f7780a20700 1 -- 172.21.15.153:0/3394300261 >> v1:172.21.15.174:6789/0 conn(0x7f777c159c00 legacy=0x7f777c0b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.877+0000 7f7780a20700 1 -- 172.21.15.153:0/3394300261 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f777c153dd0 con 0x7f777c0b0e90 2024-08-17T02:26:15.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.877+0000 7f7781a22700 1 --2- 172.21.15.153:0/3394300261 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f777c153430 0x7f777c153890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:15.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.877+0000 7f7780a20700 1 --2- 172.21.15.153:0/3394300261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f777c0b0e90 0x7f777c159fd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f776c0099b0 tx=0x7f776c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61ba412f0f339113 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:15.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.877+0000 7f7773fff700 1 -- 172.21.15.153:0/3394300261 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776c00b860 con 0x7f777c0b0e90 2024-08-17T02:26:15.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.877+0000 7f7773fff700 1 -- 172.21.15.153:0/3394300261 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776c00b9c0 con 0x7f777c0b0e90 2024-08-17T02:26:15.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.877+0000 7f7773fff700 1 -- 172.21.15.153:0/3394300261 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776c00bd60 con 0x7f777c0b0e90 2024-08-17T02:26:15.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.877+0000 7f7782223700 1 -- 172.21.15.153:0/3394300261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f777c0b0e90 msgr2=0x7f777c159fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.877+0000 7f7782223700 1 --2- 172.21.15.153:0/3394300261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f777c0b0e90 0x7f777c159fd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f776c0099b0 tx=0x7f776c009250 comp rx=0 tx=0).stop 2024-08-17T02:26:15.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.877+0000 7f7782223700 1 -- 172.21.15.153:0/3394300261 shutdown_connections 2024-08-17T02:26:15.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.877+0000 7f7782223700 1 --2- 172.21.15.153:0/3394300261 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f777c153430 0x7f777c153890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.877+0000 7f7782223700 1 --2- 172.21.15.153:0/3394300261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f777c0b0e90 0x7f777c159fd0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.877+0000 7f7782223700 1 -- 172.21.15.153:0/3394300261 >> 172.21.15.153:0/3394300261 conn(0x7f777c0ccdb0 msgr2=0x7f777c0cd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:15.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.877+0000 7f7782223700 1 -- 172.21.15.153:0/3394300261 shutdown_connections 2024-08-17T02:26:15.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.877+0000 7f7782223700 1 -- 172.21.15.153:0/3394300261 wait complete. 2024-08-17T02:26:15.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.881+0000 7f7782223700 1 Processor -- start 2024-08-17T02:26:15.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.881+0000 7f7782223700 1 -- start start 2024-08-17T02:26:15.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.881+0000 7f7782223700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f777c0b0e90 0x7f777c155f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.881+0000 7f7782223700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f777c153430 0x7f777c06b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.881+0000 7f7782223700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f777c159c00 0x7f777c154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.881+0000 7f7782223700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777c155ac0 con 0x7f777c159c00 2024-08-17T02:26:15.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.881+0000 7f7782223700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777c154ec0 con 0x7f777c153430 2024-08-17T02:26:15.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.881+0000 7f7782223700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f777c06bdb0 con 0x7f777c0b0e90 2024-08-17T02:26:15.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.881+0000 7f7781a22700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f777c159c00 0x7f777c154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.881+0000 7f7781a22700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f777c159c00 0x7f777c154980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57314/0 (socket says 172.21.15.153:57314) 2024-08-17T02:26:15.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.881+0000 7f7781a22700 1 -- 172.21.15.153:0/300508865 learned_addr learned my addr 172.21.15.153:0/300508865 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:15.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.881+0000 7f7781221700 1 --2- 172.21.15.153:0/300508865 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f777c0b0e90 0x7f777c155f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.881+0000 7f7780a20700 1 --2- 172.21.15.153:0/300508865 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f777c153430 0x7f777c06b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.881+0000 7f7781a22700 1 -- 172.21.15.153:0/300508865 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f777c0b0e90 msgr2=0x7f777c155f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.881+0000 7f7781a22700 1 --2- 172.21.15.153:0/300508865 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f777c0b0e90 0x7f777c155f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.881+0000 7f7781a22700 1 -- 172.21.15.153:0/300508865 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f777c153430 msgr2=0x7f777c06b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.881+0000 7f7781a22700 1 --2- 172.21.15.153:0/300508865 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f777c153430 0x7f777c06b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.881+0000 7f7781a22700 1 -- 172.21.15.153:0/300508865 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776c0094f0 con 0x7f777c159c00 2024-08-17T02:26:15.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.881+0000 7f7781a22700 1 --2- 172.21.15.153:0/300508865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f777c159c00 0x7f777c154980 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f777400d180 tx=0x7f7774009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:15.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.881+0000 7f77717fa700 1 -- 172.21.15.153:0/300508865 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777400dcc0 con 0x7f777c159c00 2024-08-17T02:26:15.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.881+0000 7f77717fa700 1 -- 172.21.15.153:0/300508865 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f777400f040 con 0x7f777c159c00 2024-08-17T02:26:15.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.881+0000 7f7782223700 1 -- 172.21.15.153:0/300508865 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f777c155190 con 0x7f777c159c00 2024-08-17T02:26:15.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.881+0000 7f77717fa700 1 -- 172.21.15.153:0/300508865 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7774015690 con 0x7f777c159c00 2024-08-17T02:26:15.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.881+0000 7f7782223700 1 -- 172.21.15.153:0/300508865 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f777c155750 con 0x7f777c159c00 2024-08-17T02:26:15.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.885+0000 7f7782223700 1 -- 172.21.15.153:0/300508865 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f777c155c30 con 0x7f777c159c00 2024-08-17T02:26:15.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.885+0000 7f77717fa700 1 -- 172.21.15.153:0/300508865 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f77740143a0 con 0x7f777c159c00 2024-08-17T02:26:15.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.885+0000 7f77717fa700 1 --2- 172.21.15.153:0/300508865 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7760060890 0x7f7760062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.885+0000 7f77717fa700 1 -- 172.21.15.153:0/300508865 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f777407cd80 con 0x7f777c159c00 2024-08-17T02:26:15.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.885+0000 7f7781221700 1 --2- 172.21.15.153:0/300508865 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7760060890 0x7f7760062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.885+0000 7f7781221700 1 --2- 172.21.15.153:0/300508865 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7760060890 0x7f7760062d40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f77780039f0 tx=0x7f7778007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:15.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:15.889+0000 7f77717fa700 1 -- 172.21.15.153:0/300508865 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f777404d130 con 0x7f777c159c00 2024-08-17T02:26:16.054 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.049+0000 7f7782223700 1 -- 172.21.15.153:0/300508865 --> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f777c0638f0 con 0x7f7760060890 2024-08-17T02:26:16.069 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.065+0000 7f77717fa700 1 -- 172.21.15.153:0/300508865 <== mgr.4104 v2:172.21.15.153:6832/24147 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264543 (secure 0 0 0) 0x7f777c0638f0 con 0x7f7760060890 2024-08-17T02:26:16.072 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:16.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.069+0000 7f7782223700 1 -- 172.21.15.153:0/300508865 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7760060890 msgr2=0x7f7760062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.069+0000 7f7782223700 1 --2- 172.21.15.153:0/300508865 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7760060890 0x7f7760062d40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f77780039f0 tx=0x7f7778007ec0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.069+0000 7f7782223700 1 -- 172.21.15.153:0/300508865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f777c159c00 msgr2=0x7f777c154980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.069+0000 7f7782223700 1 --2- 172.21.15.153:0/300508865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f777c159c00 0x7f777c154980 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f777400d180 tx=0x7f7774009a50 comp rx=0 tx=0).stop 2024-08-17T02:26:16.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.073+0000 7f7782223700 1 -- 172.21.15.153:0/300508865 shutdown_connections 2024-08-17T02:26:16.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.073+0000 7f7782223700 1 --2- 172.21.15.153:0/300508865 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7760060890 0x7f7760062d40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.073+0000 7f7782223700 1 --2- 172.21.15.153:0/300508865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f777c159c00 0x7f777c154980 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.073+0000 7f7782223700 1 --2- 172.21.15.153:0/300508865 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f777c153430 0x7f777c06b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.073+0000 7f7782223700 1 --2- 172.21.15.153:0/300508865 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f777c0b0e90 0x7f777c155f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.073+0000 7f7782223700 1 -- 172.21.15.153:0/300508865 >> 172.21.15.153:0/300508865 conn(0x7f777c0ccdb0 msgr2=0x7f777c149a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:16.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.073+0000 7f7782223700 1 -- 172.21.15.153:0/300508865 shutdown_connections 2024-08-17T02:26:16.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.073+0000 7f7782223700 1 -- 172.21.15.153:0/300508865 wait complete. 2024-08-17T02:26:16.076 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-08-17T02:26:16.088 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-08-17T02:26:16.036881+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381620,"kb_used_data":2760,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752593100,"statfs":{"total":773094113280,"available":770655334400,"internally_reserved":0,"allocated":2826240,"data_stored":1707969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.318301"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.777798+0000","last_change":"2024-08-17T02:26:12.777798+0000","last_active":"2024-08-17T02:26:12.777798+0000","last_peered":"2024-08-17T02:26:12.777798+0000","last_clean":"2024-08-17T02:26:12.777798+0000","last_became_active":"2024-08-17T02:26:12.776925+0000","last_became_peered":"2024-08-17T02:26:12.776925+0000","last_unstale":"2024-08-17T02:26:12.777798+0000","last_undegraded":"2024-08-17T02:26:12.777798+0000","last_fullsized":"2024-08-17T02:26:12.777798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:30:26.589185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.766974+0000","last_change":"2024-08-17T02:26:12.764803+0000","last_active":"2024-08-17T02:26:12.766974+0000","last_peered":"2024-08-17T02:26:12.766974+0000","last_clean":"2024-08-17T02:26:12.766974+0000","last_became_active":"2024-08-17T02:26:12.764396+0000","last_became_peered":"2024-08-17T02:26:12.764396+0000","last_unstale":"2024-08-17T02:26:12.766974+0000","last_undegraded":"2024-08-17T02:26:12.766974+0000","last_fullsized":"2024-08-17T02:26:12.766974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:35:38.652631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.758694+0000","last_change":"2024-08-17T02:26:12.758694+0000","last_active":"2024-08-17T02:26:12.758694+0000","last_peered":"2024-08-17T02:26:12.758694+0000","last_clean":"2024-08-17T02:26:12.758694+0000","last_became_active":"2024-08-17T02:26:12.758036+0000","last_became_peered":"2024-08-17T02:26:12.758036+0000","last_unstale":"2024-08-17T02:26:12.758694+0000","last_undegraded":"2024-08-17T02:26:12.758694+0000","last_fullsized":"2024-08-17T02:26:12.758694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:48:08.511164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.774763+0000","last_change":"2024-08-17T02:26:12.769763+0000","last_active":"2024-08-17T02:26:12.774763+0000","last_peered":"2024-08-17T02:26:12.774763+0000","last_clean":"2024-08-17T02:26:12.774763+0000","last_became_active":"2024-08-17T02:26:12.769481+0000","last_became_peered":"2024-08-17T02:26:12.769481+0000","last_unstale":"2024-08-17T02:26:12.774763+0000","last_undegraded":"2024-08-17T02:26:12.774763+0000","last_fullsized":"2024-08-17T02:26:12.774763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:35:55.150476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.767565+0000","last_change":"2024-08-17T02:26:12.767565+0000","last_active":"2024-08-17T02:26:12.767565+0000","last_peered":"2024-08-17T02:26:12.767565+0000","last_clean":"2024-08-17T02:26:12.767565+0000","last_became_active":"2024-08-17T02:26:12.767168+0000","last_became_peered":"2024-08-17T02:26:12.767168+0000","last_unstale":"2024-08-17T02:26:12.767565+0000","last_undegraded":"2024-08-17T02:26:12.767565+0000","last_fullsized":"2024-08-17T02:26:12.767565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:02:03.668267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.768745+0000","last_change":"2024-08-17T02:26:12.763368+0000","last_active":"2024-08-17T02:26:12.768745+0000","last_peered":"2024-08-17T02:26:12.768745+0000","last_clean":"2024-08-17T02:26:12.768745+0000","last_became_active":"2024-08-17T02:26:12.763106+0000","last_became_peered":"2024-08-17T02:26:12.763106+0000","last_unstale":"2024-08-17T02:26:12.768745+0000","last_undegraded":"2024-08-17T02:26:12.768745+0000","last_fullsized":"2024-08-17T02:26:12.768745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:57:16.242016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.767440+0000","last_change":"2024-08-17T02:26:12.767440+0000","last_active":"2024-08-17T02:26:12.767440+0000","last_peered":"2024-08-17T02:26:12.767440+0000","last_clean":"2024-08-17T02:26:12.767440+0000","last_became_active":"2024-08-17T02:26:12.766962+0000","last_became_peered":"2024-08-17T02:26:12.766962+0000","last_unstale":"2024-08-17T02:26:12.767440+0000","last_undegraded":"2024-08-17T02:26:12.767440+0000","last_fullsized":"2024-08-17T02:26:12.767440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:57:16.242016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.768304+0000","last_change":"2024-08-17T02:26:12.768304+0000","last_active":"2024-08-17T02:26:12.768304+0000","last_peered":"2024-08-17T02:26:12.768304+0000","last_clean":"2024-08-17T02:26:12.768304+0000","last_became_active":"2024-08-17T02:26:12.768041+0000","last_became_peered":"2024-08-17T02:26:12.768041+0000","last_unstale":"2024-08-17T02:26:12.768304+0000","last_undegraded":"2024-08-17T02:26:12.768304+0000","last_fullsized":"2024-08-17T02:26:12.768304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:12:11.738249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.770547+0000","last_change":"2024-08-17T02:26:12.770547+0000","last_active":"2024-08-17T02:26:12.770547+0000","last_peered":"2024-08-17T02:26:12.770547+0000","last_clean":"2024-08-17T02:26:12.770547+0000","last_became_active":"2024-08-17T02:26:12.770189+0000","last_became_peered":"2024-08-17T02:26:12.770189+0000","last_unstale":"2024-08-17T02:26:12.770547+0000","last_undegraded":"2024-08-17T02:26:12.770547+0000","last_fullsized":"2024-08-17T02:26:12.770547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:28:12.295650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.762340+0000","last_change":"2024-08-17T02:26:12.762340+0000","last_active":"2024-08-17T02:26:12.762340+0000","last_peered":"2024-08-17T02:26:12.762340+0000","last_clean":"2024-08-17T02:26:12.762340+0000","last_became_active":"2024-08-17T02:26:12.762033+0000","last_became_peered":"2024-08-17T02:26:12.762033+0000","last_unstale":"2024-08-17T02:26:12.762340+0000","last_undegraded":"2024-08-17T02:26:12.762340+0000","last_fullsized":"2024-08-17T02:26:12.762340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:01:31.899155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.763725+0000","last_change":"2024-08-17T02:26:12.763725+0000","last_active":"2024-08-17T02:26:12.763725+0000","last_peered":"2024-08-17T02:26:12.763725+0000","last_clean":"2024-08-17T02:26:12.763725+0000","last_became_active":"2024-08-17T02:26:12.763362+0000","last_became_peered":"2024-08-17T02:26:12.763362+0000","last_unstale":"2024-08-17T02:26:12.763725+0000","last_undegraded":"2024-08-17T02:26:12.763725+0000","last_fullsized":"2024-08-17T02:26:12.763725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:35:38.652631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.769441+0000","last_change":"2024-08-17T02:26:12.760713+0000","last_active":"2024-08-17T02:26:12.769441+0000","last_peered":"2024-08-17T02:26:12.769441+0000","last_clean":"2024-08-17T02:26:12.769441+0000","last_became_active":"2024-08-17T02:26:12.760422+0000","last_became_peered":"2024-08-17T02:26:12.760422+0000","last_unstale":"2024-08-17T02:26:12.769441+0000","last_undegraded":"2024-08-17T02:26:12.769441+0000","last_fullsized":"2024-08-17T02:26:12.769441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:47:11.421230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.763523+0000","last_change":"2024-08-17T02:26:12.763523+0000","last_active":"2024-08-17T02:26:12.763523+0000","last_peered":"2024-08-17T02:26:12.763523+0000","last_clean":"2024-08-17T02:26:12.763523+0000","last_became_active":"2024-08-17T02:26:12.762838+0000","last_became_peered":"2024-08-17T02:26:12.762838+0000","last_unstale":"2024-08-17T02:26:12.763523+0000","last_undegraded":"2024-08-17T02:26:12.763523+0000","last_fullsized":"2024-08-17T02:26:12.763523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:35:55.150476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.762220+0000","last_change":"2024-08-17T02:26:12.762220+0000","last_active":"2024-08-17T02:26:12.762220+0000","last_peered":"2024-08-17T02:26:12.762220+0000","last_clean":"2024-08-17T02:26:12.762220+0000","last_became_active":"2024-08-17T02:26:12.761872+0000","last_became_peered":"2024-08-17T02:26:12.761872+0000","last_unstale":"2024-08-17T02:26:12.762220+0000","last_undegraded":"2024-08-17T02:26:12.762220+0000","last_fullsized":"2024-08-17T02:26:12.762220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:40:15.880102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.770390+0000","last_change":"2024-08-17T02:26:12.768586+0000","last_active":"2024-08-17T02:26:12.770390+0000","last_peered":"2024-08-17T02:26:12.770390+0000","last_clean":"2024-08-17T02:26:12.770390+0000","last_became_active":"2024-08-17T02:26:12.768293+0000","last_became_peered":"2024-08-17T02:26:12.768293+0000","last_unstale":"2024-08-17T02:26:12.770390+0000","last_undegraded":"2024-08-17T02:26:12.770390+0000","last_fullsized":"2024-08-17T02:26:12.770390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:22.659534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.765002+0000","last_change":"2024-08-17T02:26:12.757448+0000","last_active":"2024-08-17T02:26:12.765002+0000","last_peered":"2024-08-17T02:26:12.765002+0000","last_clean":"2024-08-17T02:26:12.765002+0000","last_became_active":"2024-08-17T02:26:12.755026+0000","last_became_peered":"2024-08-17T02:26:12.755026+0000","last_unstale":"2024-08-17T02:26:12.765002+0000","last_undegraded":"2024-08-17T02:26:12.765002+0000","last_fullsized":"2024-08-17T02:26:12.765002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:22.659534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.774812+0000","last_change":"2024-08-17T02:26:12.770619+0000","last_active":"2024-08-17T02:26:12.774812+0000","last_peered":"2024-08-17T02:26:12.774812+0000","last_clean":"2024-08-17T02:26:12.774812+0000","last_became_active":"2024-08-17T02:26:12.770280+0000","last_became_peered":"2024-08-17T02:26:12.770280+0000","last_unstale":"2024-08-17T02:26:12.774812+0000","last_undegraded":"2024-08-17T02:26:12.774812+0000","last_fullsized":"2024-08-17T02:26:12.774812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:09:06.162369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.761378+0000","last_change":"2024-08-17T02:26:12.761378+0000","last_active":"2024-08-17T02:26:12.761378+0000","last_peered":"2024-08-17T02:26:12.761378+0000","last_clean":"2024-08-17T02:26:12.761378+0000","last_became_active":"2024-08-17T02:26:12.761023+0000","last_became_peered":"2024-08-17T02:26:12.761023+0000","last_unstale":"2024-08-17T02:26:12.761378+0000","last_undegraded":"2024-08-17T02:26:12.761378+0000","last_fullsized":"2024-08-17T02:26:12.761378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:48:08.511164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.767191+0000","last_change":"2024-08-17T02:26:12.767191+0000","last_active":"2024-08-17T02:26:12.767191+0000","last_peered":"2024-08-17T02:26:12.767191+0000","last_clean":"2024-08-17T02:26:12.767191+0000","last_became_active":"2024-08-17T02:26:12.766917+0000","last_became_peered":"2024-08-17T02:26:12.766917+0000","last_unstale":"2024-08-17T02:26:12.767191+0000","last_undegraded":"2024-08-17T02:26:12.767191+0000","last_fullsized":"2024-08-17T02:26:12.767191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:52.096067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.769217+0000","last_change":"2024-08-17T02:26:12.769217+0000","last_active":"2024-08-17T02:26:12.769217+0000","last_peered":"2024-08-17T02:26:12.769217+0000","last_clean":"2024-08-17T02:26:12.769217+0000","last_became_active":"2024-08-17T02:26:12.768948+0000","last_became_peered":"2024-08-17T02:26:12.768948+0000","last_unstale":"2024-08-17T02:26:12.769217+0000","last_undegraded":"2024-08-17T02:26:12.769217+0000","last_fullsized":"2024-08-17T02:26:12.769217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:22.659534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.764704+0000","last_change":"2024-08-17T02:26:12.764704+0000","last_active":"2024-08-17T02:26:12.764704+0000","last_peered":"2024-08-17T02:26:12.764704+0000","last_clean":"2024-08-17T02:26:12.764704+0000","last_became_active":"2024-08-17T02:26:12.764364+0000","last_became_peered":"2024-08-17T02:26:12.764364+0000","last_unstale":"2024-08-17T02:26:12.764704+0000","last_undegraded":"2024-08-17T02:26:12.764704+0000","last_fullsized":"2024-08-17T02:26:12.764704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:04:38.025404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.774928+0000","last_change":"2024-08-17T02:26:12.771719+0000","last_active":"2024-08-17T02:26:12.774928+0000","last_peered":"2024-08-17T02:26:12.774928+0000","last_clean":"2024-08-17T02:26:12.774928+0000","last_became_active":"2024-08-17T02:26:12.770932+0000","last_became_peered":"2024-08-17T02:26:12.770932+0000","last_unstale":"2024-08-17T02:26:12.774928+0000","last_undegraded":"2024-08-17T02:26:12.774928+0000","last_fullsized":"2024-08-17T02:26:12.774928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:12:11.738249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.768435+0000","last_change":"2024-08-17T02:26:12.768435+0000","last_active":"2024-08-17T02:26:12.768435+0000","last_peered":"2024-08-17T02:26:12.768435+0000","last_clean":"2024-08-17T02:26:12.768435+0000","last_became_active":"2024-08-17T02:26:12.768140+0000","last_became_peered":"2024-08-17T02:26:12.768140+0000","last_unstale":"2024-08-17T02:26:12.768435+0000","last_undegraded":"2024-08-17T02:26:12.768435+0000","last_fullsized":"2024-08-17T02:26:12.768435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:02:03.668267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.774691+0000","last_change":"2024-08-17T02:26:12.769539+0000","last_active":"2024-08-17T02:26:12.774691+0000","last_peered":"2024-08-17T02:26:12.774691+0000","last_clean":"2024-08-17T02:26:12.774691+0000","last_became_active":"2024-08-17T02:26:12.769265+0000","last_became_peered":"2024-08-17T02:26:12.769265+0000","last_unstale":"2024-08-17T02:26:12.774691+0000","last_undegraded":"2024-08-17T02:26:12.774691+0000","last_fullsized":"2024-08-17T02:26:12.774691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:30:26.589185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.770914+0000","last_change":"2024-08-17T02:26:12.770914+0000","last_active":"2024-08-17T02:26:12.770914+0000","last_peered":"2024-08-17T02:26:12.770914+0000","last_clean":"2024-08-17T02:26:12.770914+0000","last_became_active":"2024-08-17T02:26:12.770412+0000","last_became_peered":"2024-08-17T02:26:12.770412+0000","last_unstale":"2024-08-17T02:26:12.770914+0000","last_undegraded":"2024-08-17T02:26:12.770914+0000","last_fullsized":"2024-08-17T02:26:12.770914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:01:31.899155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.771500+0000","last_change":"2024-08-17T02:26:12.771500+0000","last_active":"2024-08-17T02:26:12.771500+0000","last_peered":"2024-08-17T02:26:12.771500+0000","last_clean":"2024-08-17T02:26:12.771500+0000","last_became_active":"2024-08-17T02:26:12.771244+0000","last_became_peered":"2024-08-17T02:26:12.771244+0000","last_unstale":"2024-08-17T02:26:12.771500+0000","last_undegraded":"2024-08-17T02:26:12.771500+0000","last_fullsized":"2024-08-17T02:26:12.771500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:52.096067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.771527+0000","last_change":"2024-08-17T02:26:12.769916+0000","last_active":"2024-08-17T02:26:12.771527+0000","last_peered":"2024-08-17T02:26:12.771527+0000","last_clean":"2024-08-17T02:26:12.771527+0000","last_became_active":"2024-08-17T02:26:12.769640+0000","last_became_peered":"2024-08-17T02:26:12.769640+0000","last_unstale":"2024-08-17T02:26:12.771527+0000","last_undegraded":"2024-08-17T02:26:12.771527+0000","last_fullsized":"2024-08-17T02:26:12.771527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:52.096067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.774242+0000","last_change":"2024-08-17T02:26:12.774242+0000","last_active":"2024-08-17T02:26:12.774242+0000","last_peered":"2024-08-17T02:26:12.774242+0000","last_clean":"2024-08-17T02:26:12.774242+0000","last_became_active":"2024-08-17T02:26:12.773927+0000","last_became_peered":"2024-08-17T02:26:12.773927+0000","last_unstale":"2024-08-17T02:26:12.774242+0000","last_undegraded":"2024-08-17T02:26:12.774242+0000","last_fullsized":"2024-08-17T02:26:12.774242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:57:43.119108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.771799+0000","last_change":"2024-08-17T02:26:12.771799+0000","last_active":"2024-08-17T02:26:12.771799+0000","last_peered":"2024-08-17T02:26:12.771799+0000","last_clean":"2024-08-17T02:26:12.771799+0000","last_became_active":"2024-08-17T02:26:12.771451+0000","last_became_peered":"2024-08-17T02:26:12.771451+0000","last_unstale":"2024-08-17T02:26:12.771799+0000","last_undegraded":"2024-08-17T02:26:12.771799+0000","last_fullsized":"2024-08-17T02:26:12.771799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:49:58.271852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.774907+0000","last_change":"2024-08-17T02:26:12.771407+0000","last_active":"2024-08-17T02:26:12.774907+0000","last_peered":"2024-08-17T02:26:12.774907+0000","last_clean":"2024-08-17T02:26:12.774907+0000","last_became_active":"2024-08-17T02:26:12.770406+0000","last_became_peered":"2024-08-17T02:26:12.770406+0000","last_unstale":"2024-08-17T02:26:12.774907+0000","last_undegraded":"2024-08-17T02:26:12.774907+0000","last_fullsized":"2024-08-17T02:26:12.774907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:46:54.172659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.764126+0000","last_change":"2024-08-17T02:26:12.764126+0000","last_active":"2024-08-17T02:26:12.764126+0000","last_peered":"2024-08-17T02:26:12.764126+0000","last_clean":"2024-08-17T02:26:12.764126+0000","last_became_active":"2024-08-17T02:26:12.763871+0000","last_became_peered":"2024-08-17T02:26:12.763871+0000","last_unstale":"2024-08-17T02:26:12.764126+0000","last_undegraded":"2024-08-17T02:26:12.764126+0000","last_fullsized":"2024-08-17T02:26:12.764126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:52.634628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.766452+0000","last_change":"2024-08-17T02:26:12.766452+0000","last_active":"2024-08-17T02:26:12.766452+0000","last_peered":"2024-08-17T02:26:12.766452+0000","last_clean":"2024-08-17T02:26:12.766452+0000","last_became_active":"2024-08-17T02:26:12.766197+0000","last_became_peered":"2024-08-17T02:26:12.766197+0000","last_unstale":"2024-08-17T02:26:12.766452+0000","last_undegraded":"2024-08-17T02:26:12.766452+0000","last_fullsized":"2024-08-17T02:26:12.766452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:56:34.246512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.771933+0000","last_change":"2024-08-17T02:26:12.767925+0000","last_active":"2024-08-17T02:26:12.771933+0000","last_peered":"2024-08-17T02:26:12.771933+0000","last_clean":"2024-08-17T02:26:12.771933+0000","last_became_active":"2024-08-17T02:26:12.767638+0000","last_became_peered":"2024-08-17T02:26:12.767638+0000","last_unstale":"2024-08-17T02:26:12.771933+0000","last_undegraded":"2024-08-17T02:26:12.771933+0000","last_fullsized":"2024-08-17T02:26:12.771933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:17:50.872489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.760706+0000","last_change":"2024-08-17T02:26:11.752462+0000","last_active":"2024-08-17T02:26:12.760706+0000","last_peered":"2024-08-17T02:26:12.760706+0000","last_clean":"2024-08-17T02:26:12.760706+0000","last_became_active":"2024-08-17T02:26:11.752167+0000","last_became_peered":"2024-08-17T02:26:11.752167+0000","last_unstale":"2024-08-17T02:26:12.760706+0000","last_undegraded":"2024-08-17T02:26:12.760706+0000","last_fullsized":"2024-08-17T02:26:12.760706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:28:45.373009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.761203+0000","last_change":"2024-08-17T02:26:12.761203+0000","last_active":"2024-08-17T02:26:12.761203+0000","last_peered":"2024-08-17T02:26:12.761203+0000","last_clean":"2024-08-17T02:26:12.761203+0000","last_became_active":"2024-08-17T02:26:12.759701+0000","last_became_peered":"2024-08-17T02:26:12.759701+0000","last_unstale":"2024-08-17T02:26:12.761203+0000","last_undegraded":"2024-08-17T02:26:12.761203+0000","last_fullsized":"2024-08-17T02:26:12.761203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:11:48.128685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.757343+0000","last_change":"2024-08-17T02:26:11.744002+0000","last_active":"2024-08-17T02:26:12.757343+0000","last_peered":"2024-08-17T02:26:12.757343+0000","last_clean":"2024-08-17T02:26:12.757343+0000","last_became_active":"2024-08-17T02:26:11.743661+0000","last_became_peered":"2024-08-17T02:26:11.743661+0000","last_unstale":"2024-08-17T02:26:12.757343+0000","last_undegraded":"2024-08-17T02:26:12.757343+0000","last_fullsized":"2024-08-17T02:26:12.757343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:12.144056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:11.746347+0000","last_change":"2024-08-17T02:26:11.742090+0000","last_active":"2024-08-17T02:26:11.746347+0000","last_peered":"2024-08-17T02:26:11.746347+0000","last_clean":"2024-08-17T02:26:11.746347+0000","last_became_active":"2024-08-17T02:26:11.741738+0000","last_became_peered":"2024-08-17T02:26:11.741738+0000","last_unstale":"2024-08-17T02:26:11.746347+0000","last_undegraded":"2024-08-17T02:26:11.746347+0000","last_fullsized":"2024-08-17T02:26:11.746347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:16.129872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.766090+0000","last_change":"2024-08-17T02:26:12.766090+0000","last_active":"2024-08-17T02:26:12.766090+0000","last_peered":"2024-08-17T02:26:12.766090+0000","last_clean":"2024-08-17T02:26:12.766090+0000","last_became_active":"2024-08-17T02:26:12.765809+0000","last_became_peered":"2024-08-17T02:26:12.765809+0000","last_unstale":"2024-08-17T02:26:12.766090+0000","last_undegraded":"2024-08-17T02:26:12.766090+0000","last_fullsized":"2024-08-17T02:26:12.766090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:30:26.589185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.749399+0000","last_change":"2024-08-17T02:26:11.747004+0000","last_active":"2024-08-17T02:26:12.749399+0000","last_peered":"2024-08-17T02:26:12.749399+0000","last_clean":"2024-08-17T02:26:12.749399+0000","last_became_active":"2024-08-17T02:26:11.742575+0000","last_became_peered":"2024-08-17T02:26:11.742575+0000","last_unstale":"2024-08-17T02:26:12.749399+0000","last_undegraded":"2024-08-17T02:26:12.749399+0000","last_fullsized":"2024-08-17T02:26:12.749399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:19:02.670677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.772394+0000","last_change":"2024-08-17T02:26:12.770011+0000","last_active":"2024-08-17T02:26:12.772394+0000","last_peered":"2024-08-17T02:26:12.772394+0000","last_clean":"2024-08-17T02:26:12.772394+0000","last_became_active":"2024-08-17T02:26:12.769717+0000","last_became_peered":"2024-08-17T02:26:12.769717+0000","last_unstale":"2024-08-17T02:26:12.772394+0000","last_undegraded":"2024-08-17T02:26:12.772394+0000","last_fullsized":"2024-08-17T02:26:12.772394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:01:31.899155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:11.754338+0000","last_change":"2024-08-17T02:26:11.753364+0000","last_active":"2024-08-17T02:26:11.754338+0000","last_peered":"2024-08-17T02:26:11.754338+0000","last_clean":"2024-08-17T02:26:11.754338+0000","last_became_active":"2024-08-17T02:26:11.753151+0000","last_became_peered":"2024-08-17T02:26:11.753151+0000","last_unstale":"2024-08-17T02:26:11.754338+0000","last_undegraded":"2024-08-17T02:26:11.754338+0000","last_fullsized":"2024-08-17T02:26:11.754338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:16.129872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.765940+0000","last_change":"2024-08-17T02:26:12.764566+0000","last_active":"2024-08-17T02:26:12.765940+0000","last_peered":"2024-08-17T02:26:12.765940+0000","last_clean":"2024-08-17T02:26:12.765940+0000","last_became_active":"2024-08-17T02:26:12.764233+0000","last_became_peered":"2024-08-17T02:26:12.764233+0000","last_unstale":"2024-08-17T02:26:12.765940+0000","last_undegraded":"2024-08-17T02:26:12.765940+0000","last_fullsized":"2024-08-17T02:26:12.765940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:28:12.295650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.750417+0000","last_change":"2024-08-17T02:26:11.751390+0000","last_active":"2024-08-17T02:26:12.750417+0000","last_peered":"2024-08-17T02:26:12.750417+0000","last_clean":"2024-08-17T02:26:12.750417+0000","last_became_active":"2024-08-17T02:26:11.751114+0000","last_became_peered":"2024-08-17T02:26:11.751114+0000","last_unstale":"2024-08-17T02:26:12.750417+0000","last_undegraded":"2024-08-17T02:26:12.750417+0000","last_fullsized":"2024-08-17T02:26:12.750417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:50:23.467873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.763838+0000","last_change":"2024-08-17T02:26:12.763838+0000","last_active":"2024-08-17T02:26:12.763838+0000","last_peered":"2024-08-17T02:26:12.763838+0000","last_clean":"2024-08-17T02:26:12.763838+0000","last_became_active":"2024-08-17T02:26:12.763383+0000","last_became_peered":"2024-08-17T02:26:12.763383+0000","last_unstale":"2024-08-17T02:26:12.763838+0000","last_undegraded":"2024-08-17T02:26:12.763838+0000","last_fullsized":"2024-08-17T02:26:12.763838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:58:46.781607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.781109+0000","last_change":"2024-08-17T02:26:11.749300+0000","last_active":"2024-08-17T02:26:12.781109+0000","last_peered":"2024-08-17T02:26:12.781109+0000","last_clean":"2024-08-17T02:26:12.781109+0000","last_became_active":"2024-08-17T02:26:11.748641+0000","last_became_peered":"2024-08-17T02:26:11.748641+0000","last_unstale":"2024-08-17T02:26:12.781109+0000","last_undegraded":"2024-08-17T02:26:12.781109+0000","last_fullsized":"2024-08-17T02:26:12.781109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:17:49.864348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.773125+0000","last_change":"2024-08-17T02:26:12.768314+0000","last_active":"2024-08-17T02:26:12.773125+0000","last_peered":"2024-08-17T02:26:12.773125+0000","last_clean":"2024-08-17T02:26:12.773125+0000","last_became_active":"2024-08-17T02:26:12.768066+0000","last_became_peered":"2024-08-17T02:26:12.768066+0000","last_unstale":"2024-08-17T02:26:12.773125+0000","last_undegraded":"2024-08-17T02:26:12.773125+0000","last_fullsized":"2024-08-17T02:26:12.773125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:28:46.381149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.782518+0000","last_change":"2024-08-17T02:26:11.745150+0000","last_active":"2024-08-17T02:26:12.782518+0000","last_peered":"2024-08-17T02:26:12.782518+0000","last_clean":"2024-08-17T02:26:12.782518+0000","last_became_active":"2024-08-17T02:26:11.744417+0000","last_became_peered":"2024-08-17T02:26:11.744417+0000","last_unstale":"2024-08-17T02:26:12.782518+0000","last_undegraded":"2024-08-17T02:26:12.782518+0000","last_fullsized":"2024-08-17T02:26:12.782518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:01:19.012403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.771891+0000","last_change":"2024-08-17T02:26:12.771891+0000","last_active":"2024-08-17T02:26:12.771891+0000","last_peered":"2024-08-17T02:26:12.771891+0000","last_clean":"2024-08-17T02:26:12.771891+0000","last_became_active":"2024-08-17T02:26:12.771553+0000","last_became_peered":"2024-08-17T02:26:12.771553+0000","last_unstale":"2024-08-17T02:26:12.771891+0000","last_undegraded":"2024-08-17T02:26:12.771891+0000","last_fullsized":"2024-08-17T02:26:12.771891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:09:06.162369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.780977+0000","last_change":"2024-08-17T02:26:11.743421+0000","last_active":"2024-08-17T02:26:12.780977+0000","last_peered":"2024-08-17T02:26:12.780977+0000","last_clean":"2024-08-17T02:26:12.780977+0000","last_became_active":"2024-08-17T02:26:11.743158+0000","last_became_peered":"2024-08-17T02:26:11.743158+0000","last_unstale":"2024-08-17T02:26:12.780977+0000","last_undegraded":"2024-08-17T02:26:12.780977+0000","last_fullsized":"2024-08-17T02:26:12.780977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:09:59.680512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.769818+0000","last_change":"2024-08-17T02:26:12.769818+0000","last_active":"2024-08-17T02:26:12.769818+0000","last_peered":"2024-08-17T02:26:12.769818+0000","last_clean":"2024-08-17T02:26:12.769818+0000","last_became_active":"2024-08-17T02:26:12.769239+0000","last_became_peered":"2024-08-17T02:26:12.769239+0000","last_unstale":"2024-08-17T02:26:12.769818+0000","last_undegraded":"2024-08-17T02:26:12.769818+0000","last_fullsized":"2024-08-17T02:26:12.769818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:18.753712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.754444+0000","last_change":"2024-08-17T02:26:11.750830+0000","last_active":"2024-08-17T02:26:12.754444+0000","last_peered":"2024-08-17T02:26:12.754444+0000","last_clean":"2024-08-17T02:26:12.754444+0000","last_became_active":"2024-08-17T02:26:11.750327+0000","last_became_peered":"2024-08-17T02:26:11.750327+0000","last_unstale":"2024-08-17T02:26:12.754444+0000","last_undegraded":"2024-08-17T02:26:12.754444+0000","last_fullsized":"2024-08-17T02:26:12.754444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:44:31.584691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.776592+0000","last_change":"2024-08-17T02:26:12.776592+0000","last_active":"2024-08-17T02:26:12.776592+0000","last_peered":"2024-08-17T02:26:12.776592+0000","last_clean":"2024-08-17T02:26:12.776592+0000","last_became_active":"2024-08-17T02:26:12.772976+0000","last_became_peered":"2024-08-17T02:26:12.772976+0000","last_unstale":"2024-08-17T02:26:12.776592+0000","last_undegraded":"2024-08-17T02:26:12.776592+0000","last_fullsized":"2024-08-17T02:26:12.776592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:12:11.738249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:11.748289+0000","last_change":"2024-08-17T02:26:11.744845+0000","last_active":"2024-08-17T02:26:11.748289+0000","last_peered":"2024-08-17T02:26:11.748289+0000","last_clean":"2024-08-17T02:26:11.748289+0000","last_became_active":"2024-08-17T02:26:11.743525+0000","last_became_peered":"2024-08-17T02:26:11.743525+0000","last_unstale":"2024-08-17T02:26:11.748289+0000","last_undegraded":"2024-08-17T02:26:11.748289+0000","last_fullsized":"2024-08-17T02:26:11.748289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:19:02.670677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.764059+0000","last_change":"2024-08-17T02:26:12.764059+0000","last_active":"2024-08-17T02:26:12.764059+0000","last_peered":"2024-08-17T02:26:12.764059+0000","last_clean":"2024-08-17T02:26:12.764059+0000","last_became_active":"2024-08-17T02:26:12.763801+0000","last_became_peered":"2024-08-17T02:26:12.763801+0000","last_unstale":"2024-08-17T02:26:12.764059+0000","last_undegraded":"2024-08-17T02:26:12.764059+0000","last_fullsized":"2024-08-17T02:26:12.764059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:00.945590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.782649+0000","last_change":"2024-08-17T02:26:11.745341+0000","last_active":"2024-08-17T02:26:12.782649+0000","last_peered":"2024-08-17T02:26:12.782649+0000","last_clean":"2024-08-17T02:26:12.782649+0000","last_became_active":"2024-08-17T02:26:11.745025+0000","last_became_peered":"2024-08-17T02:26:11.745025+0000","last_unstale":"2024-08-17T02:26:12.782649+0000","last_undegraded":"2024-08-17T02:26:12.782649+0000","last_fullsized":"2024-08-17T02:26:12.782649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:47:43.451789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.772497+0000","last_change":"2024-08-17T02:26:12.772497+0000","last_active":"2024-08-17T02:26:12.772497+0000","last_peered":"2024-08-17T02:26:12.772497+0000","last_clean":"2024-08-17T02:26:12.772497+0000","last_became_active":"2024-08-17T02:26:12.772175+0000","last_became_peered":"2024-08-17T02:26:12.772175+0000","last_unstale":"2024-08-17T02:26:12.772497+0000","last_undegraded":"2024-08-17T02:26:12.772497+0000","last_fullsized":"2024-08-17T02:26:12.772497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:36:24.497583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.779889+0000","last_change":"2024-08-17T02:26:11.742829+0000","last_active":"2024-08-17T02:26:12.779889+0000","last_peered":"2024-08-17T02:26:12.779889+0000","last_clean":"2024-08-17T02:26:12.779889+0000","last_became_active":"2024-08-17T02:26:11.742316+0000","last_became_peered":"2024-08-17T02:26:11.742316+0000","last_unstale":"2024-08-17T02:26:12.779889+0000","last_undegraded":"2024-08-17T02:26:12.779889+0000","last_fullsized":"2024-08-17T02:26:12.779889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:10.151157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.777702+0000","last_change":"2024-08-17T02:26:12.777702+0000","last_active":"2024-08-17T02:26:12.777702+0000","last_peered":"2024-08-17T02:26:12.777702+0000","last_clean":"2024-08-17T02:26:12.777702+0000","last_became_active":"2024-08-17T02:26:12.777420+0000","last_became_peered":"2024-08-17T02:26:12.777420+0000","last_unstale":"2024-08-17T02:26:12.777702+0000","last_undegraded":"2024-08-17T02:26:12.777702+0000","last_fullsized":"2024-08-17T02:26:12.777702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:32:22.491464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.780268+0000","last_change":"2024-08-17T02:26:11.746064+0000","last_active":"2024-08-17T02:26:12.780268+0000","last_peered":"2024-08-17T02:26:12.780268+0000","last_clean":"2024-08-17T02:26:12.780268+0000","last_became_active":"2024-08-17T02:26:11.745735+0000","last_became_peered":"2024-08-17T02:26:11.745735+0000","last_unstale":"2024-08-17T02:26:12.780268+0000","last_undegraded":"2024-08-17T02:26:12.780268+0000","last_fullsized":"2024-08-17T02:26:12.780268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:18:27.869243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.780624+0000","last_change":"2024-08-17T02:26:12.780624+0000","last_active":"2024-08-17T02:26:12.780624+0000","last_peered":"2024-08-17T02:26:12.780624+0000","last_clean":"2024-08-17T02:26:12.780624+0000","last_became_active":"2024-08-17T02:26:12.778112+0000","last_became_peered":"2024-08-17T02:26:12.778112+0000","last_unstale":"2024-08-17T02:26:12.780624+0000","last_undegraded":"2024-08-17T02:26:12.780624+0000","last_fullsized":"2024-08-17T02:26:12.780624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:46:54.172659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.783515+0000","last_change":"2024-08-17T02:26:11.743505+0000","last_active":"2024-08-17T02:26:12.783515+0000","last_peered":"2024-08-17T02:26:12.783515+0000","last_clean":"2024-08-17T02:26:12.783515+0000","last_became_active":"2024-08-17T02:26:11.743235+0000","last_became_peered":"2024-08-17T02:26:11.743235+0000","last_unstale":"2024-08-17T02:26:12.783515+0000","last_undegraded":"2024-08-17T02:26:12.783515+0000","last_fullsized":"2024-08-17T02:26:12.783515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:16.129872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.774742+0000","last_change":"2024-08-17T02:26:12.769747+0000","last_active":"2024-08-17T02:26:12.774742+0000","last_peered":"2024-08-17T02:26:12.774742+0000","last_clean":"2024-08-17T02:26:12.774742+0000","last_became_active":"2024-08-17T02:26:12.769129+0000","last_became_peered":"2024-08-17T02:26:12.769129+0000","last_unstale":"2024-08-17T02:26:12.774742+0000","last_undegraded":"2024-08-17T02:26:12.774742+0000","last_fullsized":"2024-08-17T02:26:12.774742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:02:03.668267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:11.749512+0000","last_change":"2024-08-17T02:26:11.744390+0000","last_active":"2024-08-17T02:26:11.749512+0000","last_peered":"2024-08-17T02:26:11.749512+0000","last_clean":"2024-08-17T02:26:11.749512+0000","last_became_active":"2024-08-17T02:26:11.744090+0000","last_became_peered":"2024-08-17T02:26:11.744090+0000","last_unstale":"2024-08-17T02:26:11.749512+0000","last_undegraded":"2024-08-17T02:26:11.749512+0000","last_fullsized":"2024-08-17T02:26:11.749512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:45:35.172781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.776646+0000","last_change":"2024-08-17T02:26:12.776646+0000","last_active":"2024-08-17T02:26:12.776646+0000","last_peered":"2024-08-17T02:26:12.776646+0000","last_clean":"2024-08-17T02:26:12.776646+0000","last_became_active":"2024-08-17T02:26:12.776339+0000","last_became_peered":"2024-08-17T02:26:12.776339+0000","last_unstale":"2024-08-17T02:26:12.776646+0000","last_undegraded":"2024-08-17T02:26:12.776646+0000","last_fullsized":"2024-08-17T02:26:12.776646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:39:46.134798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":162,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:11.738365+0000","last_change":"2024-08-17T02:26:00.033569+0000","last_active":"2024-08-17T02:26:11.738365+0000","last_peered":"2024-08-17T02:26:11.738365+0000","last_clean":"2024-08-17T02:26:11.738365+0000","last_became_active":"2024-08-17T02:26:00.031512+0000","last_became_peered":"2024-08-17T02:26:00.031512+0000","last_unstale":"2024-08-17T02:26:11.738365+0000","last_undegraded":"2024-08-17T02:26:11.738365+0000","last_fullsized":"2024-08-17T02:26:11.738365+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:58.643690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:58.643690+0000","last_clean_scrub_stamp":"2024-08-17T02:25:58.643690+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:47:24.121981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.748244+0000","last_change":"2024-08-17T02:26:11.747504+0000","last_active":"2024-08-17T02:26:12.748244+0000","last_peered":"2024-08-17T02:26:12.748244+0000","last_clean":"2024-08-17T02:26:12.748244+0000","last_became_active":"2024-08-17T02:26:11.747162+0000","last_became_peered":"2024-08-17T02:26:11.747162+0000","last_unstale":"2024-08-17T02:26:12.748244+0000","last_undegraded":"2024-08-17T02:26:12.748244+0000","last_fullsized":"2024-08-17T02:26:12.748244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:01:19.012403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.772153+0000","last_change":"2024-08-17T02:26:12.772153+0000","last_active":"2024-08-17T02:26:12.772153+0000","last_peered":"2024-08-17T02:26:12.772153+0000","last_clean":"2024-08-17T02:26:12.772153+0000","last_became_active":"2024-08-17T02:26:12.771909+0000","last_became_peered":"2024-08-17T02:26:12.771909+0000","last_unstale":"2024-08-17T02:26:12.772153+0000","last_undegraded":"2024-08-17T02:26:12.772153+0000","last_fullsized":"2024-08-17T02:26:12.772153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:46:54.172659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:11.760025+0000","last_change":"2024-08-17T02:26:11.755283+0000","last_active":"2024-08-17T02:26:11.760025+0000","last_peered":"2024-08-17T02:26:11.760025+0000","last_clean":"2024-08-17T02:26:11.760025+0000","last_became_active":"2024-08-17T02:26:11.754919+0000","last_became_peered":"2024-08-17T02:26:11.754919+0000","last_unstale":"2024-08-17T02:26:11.760025+0000","last_undegraded":"2024-08-17T02:26:11.760025+0000","last_fullsized":"2024-08-17T02:26:11.760025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:47:10.413089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.758664+0000","last_change":"2024-08-17T02:26:12.758664+0000","last_active":"2024-08-17T02:26:12.758664+0000","last_peered":"2024-08-17T02:26:12.758664+0000","last_clean":"2024-08-17T02:26:12.758664+0000","last_became_active":"2024-08-17T02:26:12.758221+0000","last_became_peered":"2024-08-17T02:26:12.758221+0000","last_unstale":"2024-08-17T02:26:12.758664+0000","last_undegraded":"2024-08-17T02:26:12.758664+0000","last_fullsized":"2024-08-17T02:26:12.758664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:15:37.296290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:11.752548+0000","last_change":"2024-08-17T02:26:11.746935+0000","last_active":"2024-08-17T02:26:11.752548+0000","last_peered":"2024-08-17T02:26:11.752548+0000","last_clean":"2024-08-17T02:26:11.752548+0000","last_became_active":"2024-08-17T02:26:11.746769+0000","last_became_peered":"2024-08-17T02:26:11.746769+0000","last_unstale":"2024-08-17T02:26:11.752548+0000","last_undegraded":"2024-08-17T02:26:11.752548+0000","last_fullsized":"2024-08-17T02:26:11.752548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:31:45.321709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.762938+0000","last_change":"2024-08-17T02:26:12.760578+0000","last_active":"2024-08-17T02:26:12.762938+0000","last_peered":"2024-08-17T02:26:12.762938+0000","last_clean":"2024-08-17T02:26:12.762938+0000","last_became_active":"2024-08-17T02:26:12.760278+0000","last_became_peered":"2024-08-17T02:26:12.760278+0000","last_unstale":"2024-08-17T02:26:12.762938+0000","last_undegraded":"2024-08-17T02:26:12.762938+0000","last_fullsized":"2024-08-17T02:26:12.762938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:57:43.119108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.754788+0000","last_change":"2024-08-17T02:26:11.751106+0000","last_active":"2024-08-17T02:26:12.754788+0000","last_peered":"2024-08-17T02:26:12.754788+0000","last_clean":"2024-08-17T02:26:12.754788+0000","last_became_active":"2024-08-17T02:26:11.750673+0000","last_became_peered":"2024-08-17T02:26:11.750673+0000","last_unstale":"2024-08-17T02:26:12.754788+0000","last_undegraded":"2024-08-17T02:26:12.754788+0000","last_fullsized":"2024-08-17T02:26:12.754788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:16.129872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.772914+0000","last_change":"2024-08-17T02:26:12.766859+0000","last_active":"2024-08-17T02:26:12.772914+0000","last_peered":"2024-08-17T02:26:12.772914+0000","last_clean":"2024-08-17T02:26:12.772914+0000","last_became_active":"2024-08-17T02:26:12.766495+0000","last_became_peered":"2024-08-17T02:26:12.766495+0000","last_unstale":"2024-08-17T02:26:12.772914+0000","last_undegraded":"2024-08-17T02:26:12.772914+0000","last_fullsized":"2024-08-17T02:26:12.772914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:33:42.790374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.755000+0000","last_change":"2024-08-17T02:26:11.743487+0000","last_active":"2024-08-17T02:26:12.755000+0000","last_peered":"2024-08-17T02:26:12.755000+0000","last_clean":"2024-08-17T02:26:12.755000+0000","last_became_active":"2024-08-17T02:26:11.743202+0000","last_became_peered":"2024-08-17T02:26:11.743202+0000","last_unstale":"2024-08-17T02:26:12.755000+0000","last_undegraded":"2024-08-17T02:26:12.755000+0000","last_fullsized":"2024-08-17T02:26:12.755000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:01:19.012403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.774677+0000","last_change":"2024-08-17T02:26:12.769587+0000","last_active":"2024-08-17T02:26:12.774677+0000","last_peered":"2024-08-17T02:26:12.774677+0000","last_clean":"2024-08-17T02:26:12.774677+0000","last_became_active":"2024-08-17T02:26:12.769320+0000","last_became_peered":"2024-08-17T02:26:12.769320+0000","last_unstale":"2024-08-17T02:26:12.774677+0000","last_undegraded":"2024-08-17T02:26:12.774677+0000","last_fullsized":"2024-08-17T02:26:12.774677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:52.096067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:11.754957+0000","last_change":"2024-08-17T02:26:11.751886+0000","last_active":"2024-08-17T02:26:11.754957+0000","last_peered":"2024-08-17T02:26:11.754957+0000","last_clean":"2024-08-17T02:26:11.754957+0000","last_became_active":"2024-08-17T02:26:11.751183+0000","last_became_peered":"2024-08-17T02:26:11.751183+0000","last_unstale":"2024-08-17T02:26:11.754957+0000","last_undegraded":"2024-08-17T02:26:11.754957+0000","last_fullsized":"2024-08-17T02:26:11.754957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:17:49.864348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.762902+0000","last_change":"2024-08-17T02:26:12.760992+0000","last_active":"2024-08-17T02:26:12.762902+0000","last_peered":"2024-08-17T02:26:12.762902+0000","last_clean":"2024-08-17T02:26:12.762902+0000","last_became_active":"2024-08-17T02:26:12.760709+0000","last_became_peered":"2024-08-17T02:26:12.760709+0000","last_unstale":"2024-08-17T02:26:12.762902+0000","last_undegraded":"2024-08-17T02:26:12.762902+0000","last_fullsized":"2024-08-17T02:26:12.762902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:56:34.246512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.754885+0000","last_change":"2024-08-17T02:26:11.744348+0000","last_active":"2024-08-17T02:26:12.754885+0000","last_peered":"2024-08-17T02:26:12.754885+0000","last_clean":"2024-08-17T02:26:12.754885+0000","last_became_active":"2024-08-17T02:26:11.744074+0000","last_became_peered":"2024-08-17T02:26:11.744074+0000","last_unstale":"2024-08-17T02:26:12.754885+0000","last_undegraded":"2024-08-17T02:26:12.754885+0000","last_fullsized":"2024-08-17T02:26:12.754885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:12.144056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.769279+0000","last_change":"2024-08-17T02:26:12.769279+0000","last_active":"2024-08-17T02:26:12.769279+0000","last_peered":"2024-08-17T02:26:12.769279+0000","last_clean":"2024-08-17T02:26:12.769279+0000","last_became_active":"2024-08-17T02:26:12.768690+0000","last_became_peered":"2024-08-17T02:26:12.768690+0000","last_unstale":"2024-08-17T02:26:12.769279+0000","last_undegraded":"2024-08-17T02:26:12.769279+0000","last_fullsized":"2024-08-17T02:26:12.769279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:57:16.242016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.788215+0000","last_change":"2024-08-17T02:26:11.752392+0000","last_active":"2024-08-17T02:26:12.788215+0000","last_peered":"2024-08-17T02:26:12.788215+0000","last_clean":"2024-08-17T02:26:12.788215+0000","last_became_active":"2024-08-17T02:26:11.751991+0000","last_became_peered":"2024-08-17T02:26:11.751991+0000","last_unstale":"2024-08-17T02:26:12.788215+0000","last_undegraded":"2024-08-17T02:26:12.788215+0000","last_fullsized":"2024-08-17T02:26:12.788215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:28:45.373009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.759849+0000","last_change":"2024-08-17T02:26:12.759849+0000","last_active":"2024-08-17T02:26:12.759849+0000","last_peered":"2024-08-17T02:26:12.759849+0000","last_clean":"2024-08-17T02:26:12.759849+0000","last_became_active":"2024-08-17T02:26:12.759502+0000","last_became_peered":"2024-08-17T02:26:12.759502+0000","last_unstale":"2024-08-17T02:26:12.759849+0000","last_undegraded":"2024-08-17T02:26:12.759849+0000","last_fullsized":"2024-08-17T02:26:12.759849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:00:16.197120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:11.753926+0000","last_change":"2024-08-17T02:26:11.749500+0000","last_active":"2024-08-17T02:26:11.753926+0000","last_peered":"2024-08-17T02:26:11.753926+0000","last_clean":"2024-08-17T02:26:11.753926+0000","last_became_active":"2024-08-17T02:26:11.749109+0000","last_became_peered":"2024-08-17T02:26:11.749109+0000","last_unstale":"2024-08-17T02:26:11.753926+0000","last_undegraded":"2024-08-17T02:26:11.753926+0000","last_fullsized":"2024-08-17T02:26:11.753926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:33:41.782234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.771792+0000","last_change":"2024-08-17T02:26:12.767588+0000","last_active":"2024-08-17T02:26:12.771792+0000","last_peered":"2024-08-17T02:26:12.771792+0000","last_clean":"2024-08-17T02:26:12.771792+0000","last_became_active":"2024-08-17T02:26:12.767340+0000","last_became_peered":"2024-08-17T02:26:12.767340+0000","last_unstale":"2024-08-17T02:26:12.771792+0000","last_undegraded":"2024-08-17T02:26:12.771792+0000","last_fullsized":"2024-08-17T02:26:12.771792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:13.152196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.754893+0000","last_change":"2024-08-17T02:26:11.752823+0000","last_active":"2024-08-17T02:26:12.754893+0000","last_peered":"2024-08-17T02:26:12.754893+0000","last_clean":"2024-08-17T02:26:12.754893+0000","last_became_active":"2024-08-17T02:26:11.752550+0000","last_became_peered":"2024-08-17T02:26:11.752550+0000","last_unstale":"2024-08-17T02:26:12.754893+0000","last_undegraded":"2024-08-17T02:26:12.754893+0000","last_fullsized":"2024-08-17T02:26:12.754893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:28:45.373009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.765817+0000","last_change":"2024-08-17T02:26:12.765817+0000","last_active":"2024-08-17T02:26:12.765817+0000","last_peered":"2024-08-17T02:26:12.765817+0000","last_clean":"2024-08-17T02:26:12.765817+0000","last_became_active":"2024-08-17T02:26:12.765318+0000","last_became_peered":"2024-08-17T02:26:12.765318+0000","last_unstale":"2024-08-17T02:26:12.765817+0000","last_undegraded":"2024-08-17T02:26:12.765817+0000","last_fullsized":"2024-08-17T02:26:12.765817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:28:12.295650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.755330+0000","last_change":"2024-08-17T02:26:11.747437+0000","last_active":"2024-08-17T02:26:12.755330+0000","last_peered":"2024-08-17T02:26:12.755330+0000","last_clean":"2024-08-17T02:26:12.755330+0000","last_became_active":"2024-08-17T02:26:11.747213+0000","last_became_peered":"2024-08-17T02:26:11.747213+0000","last_unstale":"2024-08-17T02:26:12.755330+0000","last_undegraded":"2024-08-17T02:26:12.755330+0000","last_fullsized":"2024-08-17T02:26:12.755330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:33:41.782234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.765628+0000","last_change":"2024-08-17T02:26:12.765628+0000","last_active":"2024-08-17T02:26:12.765628+0000","last_peered":"2024-08-17T02:26:12.765628+0000","last_clean":"2024-08-17T02:26:12.765628+0000","last_became_active":"2024-08-17T02:26:12.765332+0000","last_became_peered":"2024-08-17T02:26:12.765332+0000","last_unstale":"2024-08-17T02:26:12.765628+0000","last_undegraded":"2024-08-17T02:26:12.765628+0000","last_fullsized":"2024-08-17T02:26:12.765628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:35:38.652631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.788286+0000","last_change":"2024-08-17T02:26:11.751615+0000","last_active":"2024-08-17T02:26:12.788286+0000","last_peered":"2024-08-17T02:26:12.788286+0000","last_clean":"2024-08-17T02:26:12.788286+0000","last_became_active":"2024-08-17T02:26:11.751145+0000","last_became_peered":"2024-08-17T02:26:11.751145+0000","last_unstale":"2024-08-17T02:26:12.788286+0000","last_undegraded":"2024-08-17T02:26:12.788286+0000","last_fullsized":"2024-08-17T02:26:12.788286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:28:45.373009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.769204+0000","last_change":"2024-08-17T02:26:12.769204+0000","last_active":"2024-08-17T02:26:12.769204+0000","last_peered":"2024-08-17T02:26:12.769204+0000","last_clean":"2024-08-17T02:26:12.769204+0000","last_became_active":"2024-08-17T02:26:12.768909+0000","last_became_peered":"2024-08-17T02:26:12.768909+0000","last_unstale":"2024-08-17T02:26:12.769204+0000","last_undegraded":"2024-08-17T02:26:12.769204+0000","last_fullsized":"2024-08-17T02:26:12.769204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:57:43.119108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.773689+0000","last_change":"2024-08-17T02:26:12.765911+0000","last_active":"2024-08-17T02:26:12.773689+0000","last_peered":"2024-08-17T02:26:12.773689+0000","last_clean":"2024-08-17T02:26:12.773689+0000","last_became_active":"2024-08-17T02:26:12.765109+0000","last_became_peered":"2024-08-17T02:26:12.765109+0000","last_unstale":"2024-08-17T02:26:12.773689+0000","last_undegraded":"2024-08-17T02:26:12.773689+0000","last_fullsized":"2024-08-17T02:26:12.773689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:58:46.756190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.788171+0000","last_change":"2024-08-17T02:26:11.755644+0000","last_active":"2024-08-17T02:26:12.788171+0000","last_peered":"2024-08-17T02:26:12.788171+0000","last_clean":"2024-08-17T02:26:12.788171+0000","last_became_active":"2024-08-17T02:26:11.755257+0000","last_became_peered":"2024-08-17T02:26:11.755257+0000","last_unstale":"2024-08-17T02:26:12.788171+0000","last_undegraded":"2024-08-17T02:26:12.788171+0000","last_fullsized":"2024-08-17T02:26:12.788171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:44:31.584691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.762324+0000","last_change":"2024-08-17T02:26:12.759902+0000","last_active":"2024-08-17T02:26:12.762324+0000","last_peered":"2024-08-17T02:26:12.762324+0000","last_clean":"2024-08-17T02:26:12.762324+0000","last_became_active":"2024-08-17T02:26:12.759616+0000","last_became_peered":"2024-08-17T02:26:12.759616+0000","last_unstale":"2024-08-17T02:26:12.762324+0000","last_undegraded":"2024-08-17T02:26:12.762324+0000","last_fullsized":"2024-08-17T02:26:12.762324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:57:43.119108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.788140+0000","last_change":"2024-08-17T02:26:11.751645+0000","last_active":"2024-08-17T02:26:12.788140+0000","last_peered":"2024-08-17T02:26:12.788140+0000","last_clean":"2024-08-17T02:26:12.788140+0000","last_became_active":"2024-08-17T02:26:11.751331+0000","last_became_peered":"2024-08-17T02:26:11.751331+0000","last_unstale":"2024-08-17T02:26:12.788140+0000","last_undegraded":"2024-08-17T02:26:12.788140+0000","last_fullsized":"2024-08-17T02:26:12.788140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:12.144056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.763641+0000","last_change":"2024-08-17T02:26:12.763641+0000","last_active":"2024-08-17T02:26:12.763641+0000","last_peered":"2024-08-17T02:26:12.763641+0000","last_clean":"2024-08-17T02:26:12.763641+0000","last_became_active":"2024-08-17T02:26:12.763027+0000","last_became_peered":"2024-08-17T02:26:12.763027+0000","last_unstale":"2024-08-17T02:26:12.763641+0000","last_undegraded":"2024-08-17T02:26:12.763641+0000","last_fullsized":"2024-08-17T02:26:12.763641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:49:37.970276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.757479+0000","last_change":"2024-08-17T02:26:11.748898+0000","last_active":"2024-08-17T02:26:12.757479+0000","last_peered":"2024-08-17T02:26:12.757479+0000","last_clean":"2024-08-17T02:26:12.757479+0000","last_became_active":"2024-08-17T02:26:11.748630+0000","last_became_peered":"2024-08-17T02:26:11.748630+0000","last_unstale":"2024-08-17T02:26:12.757479+0000","last_undegraded":"2024-08-17T02:26:12.757479+0000","last_fullsized":"2024-08-17T02:26:12.757479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:12.144056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.763150+0000","last_change":"2024-08-17T02:26:12.763150+0000","last_active":"2024-08-17T02:26:12.763150+0000","last_peered":"2024-08-17T02:26:12.763150+0000","last_clean":"2024-08-17T02:26:12.763150+0000","last_became_active":"2024-08-17T02:26:12.762858+0000","last_became_peered":"2024-08-17T02:26:12.762858+0000","last_unstale":"2024-08-17T02:26:12.763150+0000","last_undegraded":"2024-08-17T02:26:12.763150+0000","last_fullsized":"2024-08-17T02:26:12.763150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:09:06.162369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.789231+0000","last_change":"2024-08-17T02:26:11.750667+0000","last_active":"2024-08-17T02:26:12.789231+0000","last_peered":"2024-08-17T02:26:12.789231+0000","last_clean":"2024-08-17T02:26:12.789231+0000","last_became_active":"2024-08-17T02:26:11.750353+0000","last_became_peered":"2024-08-17T02:26:11.750353+0000","last_unstale":"2024-08-17T02:26:12.789231+0000","last_undegraded":"2024-08-17T02:26:12.789231+0000","last_fullsized":"2024-08-17T02:26:12.789231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:57:03.276859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298136,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073704,"statfs":{"total":96636764160,"available":96331472896,"internally_reserved":0,"allocated":794624,"data_stored":656317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":208896,"data_stored":66931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297552,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":200704,"data_stored":65469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":221184,"data_stored":71793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.159}]}]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":208896,"data_stored":66931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.034}]}]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":204800,"data_stored":65539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":184320,"data_stored":58616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298144,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073696,"statfs":{"total":96636764160,"available":96331464704,"internally_reserved":0,"allocated":802816,"data_stored":656373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:26:16.092 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:26:16.092 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-17T02:26:16.092 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-08-17T02:26:16.092 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-08-17T02:26:16.093 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-08-17T02:26:16.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.201+0000 7fd1ed1c8700 1 Processor -- start 2024-08-17T02:26:16.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.201+0000 7fd1ed1c8700 1 -- start start 2024-08-17T02:26:16.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.201+0000 7fd1ed1c8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd1e80ab540 0x7fd1e80b1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.201+0000 7fd1ed1c8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd1e806df10 0x7fd1e806e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.201+0000 7fd1ed1c8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1e80aba70 con 0x7fd1e806ef10 2024-08-17T02:26:16.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.201+0000 7fd1ed1c8700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1e80abd50 con 0x7fd1e806df10 2024-08-17T02:26:16.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.201+0000 7fd1ed1c8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1e80ac030 con 0x7fd1e80ab540 2024-08-17T02:26:16.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.201+0000 7fd1e77fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd1e806df10 0x7fd1e806e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.201+0000 7fd1e77fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd1e806df10 0x7fd1e806e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57320/0 (socket says 172.21.15.153:57320) 2024-08-17T02:26:16.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.201+0000 7fd1e77fe700 1 -- 172.21.15.153:0/3215926183 learned_addr learned my addr 172.21.15.153:0/3215926183 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:16.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.201+0000 7fd1e7fff700 1 --2- 172.21.15.153:0/3215926183 >> v2:172.21.15.174:3300/0 conn(0x7fd1e80ab540 0x7fd1e80b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.205+0000 7fd1e77fe700 1 -- 172.21.15.153:0/3215926183 >> v2:172.21.15.174:3300/0 conn(0x7fd1e80ab540 msgr2=0x7fd1e80b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:16.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.205+0000 7fd1e77fe700 1 --2- 172.21.15.153:0/3215926183 >> v2:172.21.15.174:3300/0 conn(0x7fd1e80ab540 0x7fd1e80b1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.205+0000 7fd1e77fe700 1 -- 172.21.15.153:0/3215926183 >> v1:172.21.15.174:6789/0 conn(0x7fd1e806ef10 legacy=0x7fd1e8155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.205+0000 7fd1e77fe700 1 -- 172.21.15.153:0/3215926183 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e80ac310 con 0x7fd1e806df10 2024-08-17T02:26:16.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.205+0000 7fd1e77fe700 1 --2- 172.21.15.153:0/3215926183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1e806df10 0x7fd1e806e9d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd1e806c910 tx=0x7fd1dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b84ae6d799c9cb05 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:16.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.205+0000 7fd1e6ffd700 1 -- 172.21.15.153:0/3215926183 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc009e70 con 0x7fd1e806df10 2024-08-17T02:26:16.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.205+0000 7fd1e6ffd700 1 -- 172.21.15.153:0/3215926183 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1dc00b860 con 0x7fd1e806df10 2024-08-17T02:26:16.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.205+0000 7fd1e6ffd700 1 -- 172.21.15.153:0/3215926183 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc00bc00 con 0x7fd1e806df10 2024-08-17T02:26:16.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.205+0000 7fd1ed1c8700 1 -- 172.21.15.153:0/3215926183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1e806df10 msgr2=0x7fd1e806e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.205+0000 7fd1ed1c8700 1 --2- 172.21.15.153:0/3215926183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1e806df10 0x7fd1e806e9d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd1e806c910 tx=0x7fd1dc009250 comp rx=0 tx=0).stop 2024-08-17T02:26:16.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.205+0000 7fd1ed1c8700 1 -- 172.21.15.153:0/3215926183 shutdown_connections 2024-08-17T02:26:16.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.205+0000 7fd1ed1c8700 1 --2- 172.21.15.153:0/3215926183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1e806df10 0x7fd1e806e9d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.205+0000 7fd1ed1c8700 1 --2- 172.21.15.153:0/3215926183 >> v2:172.21.15.174:3300/0 conn(0x7fd1e80ab540 0x7fd1e80b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.205+0000 7fd1ed1c8700 1 -- 172.21.15.153:0/3215926183 >> 172.21.15.153:0/3215926183 conn(0x7fd1e80678d0 msgr2=0x7fd1e8067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:16.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.205+0000 7fd1ed1c8700 1 -- 172.21.15.153:0/3215926183 shutdown_connections 2024-08-17T02:26:16.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.205+0000 7fd1ed1c8700 1 -- 172.21.15.153:0/3215926183 wait complete. 2024-08-17T02:26:16.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.205+0000 7fd1ed1c8700 1 Processor -- start 2024-08-17T02:26:16.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.209+0000 7fd1ed1c8700 1 -- start start 2024-08-17T02:26:16.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.209+0000 7fd1ed1c8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1e806df10 0x7fd1e81697f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.209+0000 7fd1ed1c8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1e806ef10 0x7fd1e8147ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.209+0000 7fd1ed1c8700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1e80ab540 0x7fd1e8149b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.209+0000 7fd1ed1c8700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e81372d0 con 0x7fd1e806df10 2024-08-17T02:26:16.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.209+0000 7fd1ed1c8700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e816a790 con 0x7fd1e80ab540 2024-08-17T02:26:16.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.209+0000 7fd1ed1c8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e8169ef0 con 0x7fd1e806ef10 2024-08-17T02:26:16.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.209+0000 7fd1e7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1e806df10 0x7fd1e81697f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.209+0000 7fd1e7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1e806df10 0x7fd1e81697f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57324/0 (socket says 172.21.15.153:57324) 2024-08-17T02:26:16.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.209+0000 7fd1e7fff700 1 -- 172.21.15.153:0/798694556 learned_addr learned my addr 172.21.15.153:0/798694556 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:16.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.209+0000 7fd1e77fe700 1 --2- 172.21.15.153:0/798694556 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1e806ef10 0x7fd1e8147ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.209+0000 7fd1ec9c7700 1 --2- 172.21.15.153:0/798694556 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1e80ab540 0x7fd1e8149b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.209+0000 7fd1e7fff700 1 -- 172.21.15.153:0/798694556 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1e806ef10 msgr2=0x7fd1e8147ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.209+0000 7fd1e7fff700 1 --2- 172.21.15.153:0/798694556 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1e806ef10 0x7fd1e8147ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.209+0000 7fd1e7fff700 1 -- 172.21.15.153:0/798694556 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1e80ab540 msgr2=0x7fd1e8149b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.209+0000 7fd1e7fff700 1 --2- 172.21.15.153:0/798694556 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1e80ab540 0x7fd1e8149b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.209+0000 7fd1e7fff700 1 -- 172.21.15.153:0/798694556 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1dc0094f0 con 0x7fd1e806df10 2024-08-17T02:26:16.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.209+0000 7fd1e77fe700 1 --2- 172.21.15.153:0/798694556 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1e806ef10 0x7fd1e8147ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:16.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.209+0000 7fd1e7fff700 1 --2- 172.21.15.153:0/798694556 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1e806df10 0x7fd1e81697f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd1d800e930 tx=0x7fd1d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:16.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.209+0000 7fd1cffff700 1 -- 172.21.15.153:0/798694556 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d800eed0 con 0x7fd1e806df10 2024-08-17T02:26:16.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.209+0000 7fd1cffff700 1 -- 172.21.15.153:0/798694556 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d800c850 con 0x7fd1e806df10 2024-08-17T02:26:16.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.209+0000 7fd1cffff700 1 -- 172.21.15.153:0/798694556 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d800cbf0 con 0x7fd1e806df10 2024-08-17T02:26:16.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.209+0000 7fd1ed1c8700 1 -- 172.21.15.153:0/798694556 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1e816a1d0 con 0x7fd1e806df10 2024-08-17T02:26:16.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.209+0000 7fd1ed1c8700 1 -- 172.21.15.153:0/798694556 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e8148010 con 0x7fd1e806df10 2024-08-17T02:26:16.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.209+0000 7fd1ed1c8700 1 -- 172.21.15.153:0/798694556 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1e8137540 con 0x7fd1e806df10 2024-08-17T02:26:16.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.213+0000 7fd1cffff700 1 -- 172.21.15.153:0/798694556 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd1d8013470 con 0x7fd1e806df10 2024-08-17T02:26:16.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.213+0000 7fd1cffff700 1 --2- 172.21.15.153:0/798694556 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd1d4060860 0x7fd1d4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.213+0000 7fd1e77fe700 1 --2- 172.21.15.153:0/798694556 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd1d4060860 0x7fd1d4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.213+0000 7fd1cffff700 1 -- 172.21.15.153:0/798694556 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd1d807cdb0 con 0x7fd1e806df10 2024-08-17T02:26:16.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.213+0000 7fd1e77fe700 1 --2- 172.21.15.153:0/798694556 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd1d4060860 0x7fd1d4062d10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd1e806c910 tx=0x7fd1dc017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:16.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.221+0000 7fd1cffff700 1 -- 172.21.15.153:0/798694556 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd1d804d200 con 0x7fd1e806df10 2024-08-17T02:26:16.379 INFO:tasks.ceph.mds.b.smithi174.stderr:2024-08-17T02:26:16.375+0000 7fda21605700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:26:16.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.425+0000 7fd1ed1c8700 1 -- 172.21.15.153:0/798694556 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fd1e80643a0 con 0x7fd1e806df10 2024-08-17T02:26:16.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.433+0000 7fd1cffff700 1 -- 172.21.15.153:0/798694556 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+154539 (secure 0 0 0) 0x7fd1d8050820 con 0x7fd1e806df10 2024-08-17T02:26:16.437 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:16.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.433+0000 7fd1ed1c8700 1 -- 172.21.15.153:0/798694556 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd1d4060860 msgr2=0x7fd1d4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.433+0000 7fd1ed1c8700 1 --2- 172.21.15.153:0/798694556 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd1d4060860 0x7fd1d4062d10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd1e806c910 tx=0x7fd1dc017000 comp rx=0 tx=0).stop 2024-08-17T02:26:16.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.433+0000 7fd1ed1c8700 1 -- 172.21.15.153:0/798694556 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1e806df10 msgr2=0x7fd1e81697f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.433+0000 7fd1ed1c8700 1 --2- 172.21.15.153:0/798694556 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1e806df10 0x7fd1e81697f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd1d800e930 tx=0x7fd1d80091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.433+0000 7fd1ed1c8700 1 -- 172.21.15.153:0/798694556 shutdown_connections 2024-08-17T02:26:16.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.437+0000 7fd1ed1c8700 1 --2- 172.21.15.153:0/798694556 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd1d4060860 0x7fd1d4062d10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.437+0000 7fd1ed1c8700 1 --2- 172.21.15.153:0/798694556 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1e80ab540 0x7fd1e8149b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.437+0000 7fd1ed1c8700 1 --2- 172.21.15.153:0/798694556 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1e806ef10 0x7fd1e8147ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.437+0000 7fd1ed1c8700 1 --2- 172.21.15.153:0/798694556 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1e806df10 0x7fd1e81697f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.437+0000 7fd1ed1c8700 1 -- 172.21.15.153:0/798694556 >> 172.21.15.153:0/798694556 conn(0x7fd1e80678d0 msgr2=0x7fd1e8154530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:16.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.437+0000 7fd1ed1c8700 1 -- 172.21.15.153:0/798694556 shutdown_connections 2024-08-17T02:26:16.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.437+0000 7fd1ed1c8700 1 -- 172.21.15.153:0/798694556 wait complete. 2024-08-17T02:26:16.451 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":24147},{"type":"v1","addr":"172.21.15.153:6833","nonce":24147}]},"active_addr":"172.21.15.153:6833/24147","active_change":"2024-08-17T02:25:52.020428+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.153:0","nonce":85434852}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.153:0","nonce":2372453307}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.153:0","nonce":897045456}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.153:0","nonce":1785236778}]}]} 2024-08-17T02:26:16.455 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-08-17T02:26:16.455 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-08-17T02:26:16.455 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:16.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.561+0000 7f91f3701700 1 Processor -- start 2024-08-17T02:26:16.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.561+0000 7f91f3701700 1 -- start start 2024-08-17T02:26:16.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.561+0000 7f91f3701700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f91ec0aac50 0x7f91ec15aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.561+0000 7f91f3701700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91ec15b010 con 0x7f91ec0b3b30 2024-08-17T02:26:16.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.561+0000 7f91f3701700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91ec15b2f0 con 0x7f91ec15a2e0 2024-08-17T02:26:16.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.561+0000 7f91f3701700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91ec15bc90 con 0x7f91ec0aac50 2024-08-17T02:26:16.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.561+0000 7f91f1c9e700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f91ec0b3b30 0x7f91ec0b3f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35676/0 (socket says 172.21.15.153:35676) 2024-08-17T02:26:16.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.561+0000 7f91f1c9e700 1 -- 172.21.15.153:0/3972878955 learned_addr learned my addr 172.21.15.153:0/3972878955 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:16.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.561+0000 7f91f149d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f91ec0aac50 0x7f91ec15aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.561+0000 7f91e3fff700 1 -- 172.21.15.153:0/3972878955 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4105572361 0 0) 0x7f91ec15b010 con 0x7f91ec0b3b30 2024-08-17T02:26:16.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.561+0000 7f91e3fff700 1 -- 172.21.15.153:0/3972878955 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91d4003570 con 0x7f91ec0b3b30 2024-08-17T02:26:16.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.561+0000 7f91e3fff700 1 -- 172.21.15.153:0/3972878955 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4255518144 0 0) 0x7f91ec15b2f0 con 0x7f91ec15a2e0 2024-08-17T02:26:16.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.561+0000 7f91e3fff700 1 -- 172.21.15.153:0/3972878955 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91ec15b010 con 0x7f91ec15a2e0 2024-08-17T02:26:16.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.561+0000 7f91e3fff700 1 -- 172.21.15.153:0/3972878955 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2410142183 0 0) 0x7f91d4003570 con 0x7f91ec0b3b30 2024-08-17T02:26:16.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.561+0000 7f91f149d700 1 -- 172.21.15.153:0/3972878955 >> v1:172.21.15.174:6789/0 conn(0x7f91ec15a2e0 legacy=0x7f91ec1574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.561+0000 7f91f149d700 1 -- 172.21.15.153:0/3972878955 >> v1:172.21.15.153:6789/0 conn(0x7f91ec0b3b30 legacy=0x7f91ec0b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.561+0000 7f91f149d700 1 -- 172.21.15.153:0/3972878955 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ec15b5d0 con 0x7f91ec0aac50 2024-08-17T02:26:16.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.561+0000 7f91f149d700 1 --2- 172.21.15.153:0/3972878955 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91ec0aac50 0x7f91ec15aa30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f91dc0098d0 tx=0x7f91dc009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2d9ff6620b7b9b8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:16.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.565+0000 7f91e3fff700 1 -- 172.21.15.153:0/3972878955 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e4001470 con 0x7f91ec0aac50 2024-08-17T02:26:16.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.565+0000 7f91e3fff700 1 -- 172.21.15.153:0/3972878955 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91dc011420 con 0x7f91ec0aac50 2024-08-17T02:26:16.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.565+0000 7f91e3fff700 1 -- 172.21.15.153:0/3972878955 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91dc0117e0 con 0x7f91ec0aac50 2024-08-17T02:26:16.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.565+0000 7f91f3701700 1 -- 172.21.15.153:0/3972878955 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91ec0aac50 msgr2=0x7f91ec15aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.565+0000 7f91f3701700 1 --2- 172.21.15.153:0/3972878955 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91ec0aac50 0x7f91ec15aa30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f91dc0098d0 tx=0x7f91dc009120 comp rx=0 tx=0).stop 2024-08-17T02:26:16.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.565+0000 7f91f3701700 1 -- 172.21.15.153:0/3972878955 shutdown_connections 2024-08-17T02:26:16.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.565+0000 7f91f3701700 1 --2- 172.21.15.153:0/3972878955 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91ec0aac50 0x7f91ec15aa30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.565+0000 7f91f3701700 1 -- 172.21.15.153:0/3972878955 >> 172.21.15.153:0/3972878955 conn(0x7f91ec0994d0 msgr2=0x7f91ec0675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:16.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.565+0000 7f91f3701700 1 -- 172.21.15.153:0/3972878955 shutdown_connections 2024-08-17T02:26:16.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.565+0000 7f91f3701700 1 -- 172.21.15.153:0/3972878955 wait complete. 2024-08-17T02:26:16.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.565+0000 7f91f3701700 1 Processor -- start 2024-08-17T02:26:16.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.565+0000 7f91f3701700 1 -- start start 2024-08-17T02:26:16.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.569+0000 7f91f3701700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91ec0aac50 0x7f91ec1505c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.569+0000 7f91f3701700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91ec0b3b30 0x7f91ec15d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.569+0000 7f91f3701700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91ec15a2e0 0x7f91ec15d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.569+0000 7f91f3701700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec169470 con 0x7f91ec0b3b30 2024-08-17T02:26:16.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.569+0000 7f91f3701700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec169680 con 0x7f91ec0aac50 2024-08-17T02:26:16.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.569+0000 7f91f3701700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec169960 con 0x7f91ec15a2e0 2024-08-17T02:26:16.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.569+0000 7f91f0c9c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91ec0b3b30 0x7f91ec15d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.569+0000 7f91f0c9c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91ec0b3b30 0x7f91ec15d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57340/0 (socket says 172.21.15.153:57340) 2024-08-17T02:26:16.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.569+0000 7f91f0c9c700 1 -- 172.21.15.153:0/3318731248 learned_addr learned my addr 172.21.15.153:0/3318731248 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:16.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.569+0000 7f91f149d700 1 --2- 172.21.15.153:0/3318731248 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91ec0aac50 0x7f91ec1505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.569+0000 7f91f1c9e700 1 --2- 172.21.15.153:0/3318731248 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91ec15a2e0 0x7f91ec15d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.569+0000 7f91f0c9c700 1 -- 172.21.15.153:0/3318731248 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91ec15a2e0 msgr2=0x7f91ec15d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.569+0000 7f91f0c9c700 1 --2- 172.21.15.153:0/3318731248 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91ec15a2e0 0x7f91ec15d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.569+0000 7f91f0c9c700 1 -- 172.21.15.153:0/3318731248 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91ec0aac50 msgr2=0x7f91ec1505c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.569+0000 7f91f0c9c700 1 --2- 172.21.15.153:0/3318731248 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91ec0aac50 0x7f91ec1505c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.569+0000 7f91f0c9c700 1 -- 172.21.15.153:0/3318731248 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91dc0093c0 con 0x7f91ec0b3b30 2024-08-17T02:26:16.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.569+0000 7f91f1c9e700 1 --2- 172.21.15.153:0/3318731248 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91ec15a2e0 0x7f91ec15d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:16.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.569+0000 7f91f0c9c700 1 --2- 172.21.15.153:0/3318731248 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91ec0b3b30 0x7f91ec15d1d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f91e800c900 tx=0x7f91e8002780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:16.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.569+0000 7f91e17fa700 1 -- 172.21.15.153:0/3318731248 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e800cea0 con 0x7f91ec0b3b30 2024-08-17T02:26:16.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.569+0000 7f91e17fa700 1 -- 172.21.15.153:0/3318731248 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e800a7e0 con 0x7f91ec0b3b30 2024-08-17T02:26:16.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.569+0000 7f91f3701700 1 -- 172.21.15.153:0/3318731248 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91ec169c40 con 0x7f91ec0b3b30 2024-08-17T02:26:16.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.569+0000 7f91e17fa700 1 -- 172.21.15.153:0/3318731248 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e800aba0 con 0x7f91ec0b3b30 2024-08-17T02:26:16.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.569+0000 7f91f3701700 1 -- 172.21.15.153:0/3318731248 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91ec16a200 con 0x7f91ec0b3b30 2024-08-17T02:26:16.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.569+0000 7f91f3701700 1 -- 172.21.15.153:0/3318731248 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91ec16a420 con 0x7f91ec0b3b30 2024-08-17T02:26:16.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.569+0000 7f91e17fa700 1 -- 172.21.15.153:0/3318731248 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f91e8012420 con 0x7f91ec0b3b30 2024-08-17T02:26:16.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.573+0000 7f91e17fa700 1 --2- 172.21.15.153:0/3318731248 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f91d8060860 0x7f91d8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.573+0000 7f91e17fa700 1 -- 172.21.15.153:0/3318731248 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f91e807d090 con 0x7f91ec0b3b30 2024-08-17T02:26:16.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.573+0000 7f91f149d700 1 --2- 172.21.15.153:0/3318731248 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f91d8060860 0x7f91d8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.573+0000 7f91f149d700 1 --2- 172.21.15.153:0/3318731248 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f91d8060860 0x7f91d8062d10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f91dc009390 tx=0x7f91dc016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:16.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.577+0000 7f91e17fa700 1 -- 172.21.15.153:0/3318731248 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f91e804d4e0 con 0x7f91ec0b3b30 2024-08-17T02:26:16.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.741+0000 7f91f3701700 1 -- 172.21.15.153:0/3318731248 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91ec0645c0 con 0x7f91ec0b3b30 2024-08-17T02:26:16.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.745+0000 7f91e17fa700 1 -- 172.21.15.153:0/3318731248 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f91e8056020 con 0x7f91ec0b3b30 2024-08-17T02:26:16.747 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:16.747 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":21,"fsid":"56d41c33-b929-456d-96be-2aac4ecd299d","created":"2024-08-17T02:25:47.756085+0000","modified":"2024-08-17T02:26:13.759246+0000","last_up_change":"2024-08-17T02:25:58.643690+0000","last_in_change":"2024-08-17T02:25:49.809186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:58.093273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:09.856520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:11.080706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0736f8e6-818e-42e6-a0dc-8aaf813315d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":24234},{"type":"v1","addr":"172.21.15.153:6817","nonce":24234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":24234},{"type":"v1","addr":"172.21.15.153:6819","nonce":24234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":24234},{"type":"v1","addr":"172.21.15.153:6823","nonce":24234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":24234},{"type":"v1","addr":"172.21.15.153:6821","nonce":24234}]},"public_addr":"172.21.15.153:6817/24234","cluster_addr":"172.21.15.153:6819/24234","heartbeat_back_addr":"172.21.15.153:6823/24234","heartbeat_front_addr":"172.21.15.153:6821/24234","state":["exists","up"]},{"osd":1,"uuid":"011762e9-6c2d-441a-aa56-68474639d72f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":24232},{"type":"v1","addr":"172.21.15.153:6801","nonce":24232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":24232},{"type":"v1","addr":"172.21.15.153:6803","nonce":24232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":24232},{"type":"v1","addr":"172.21.15.153:6809","nonce":24232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":24232},{"type":"v1","addr":"172.21.15.153:6806","nonce":24232}]},"public_addr":"172.21.15.153:6801/24232","cluster_addr":"172.21.15.153:6803/24232","heartbeat_back_addr":"172.21.15.153:6809/24232","heartbeat_front_addr":"172.21.15.153:6806/24232","state":["exists","up"]},{"osd":2,"uuid":"b562cd97-aa12-455e-b46a-e720a2ec9d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":24235},{"type":"v1","addr":"172.21.15.153:6808","nonce":24235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":24235},{"type":"v1","addr":"172.21.15.153:6811","nonce":24235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":24235},{"type":"v1","addr":"172.21.15.153:6815","nonce":24235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":24235},{"type":"v1","addr":"172.21.15.153:6813","nonce":24235}]},"public_addr":"172.21.15.153:6808/24235","cluster_addr":"172.21.15.153:6811/24235","heartbeat_back_addr":"172.21.15.153:6815/24235","heartbeat_front_addr":"172.21.15.153:6813/24235","state":["exists","up"]},{"osd":3,"uuid":"222da52f-90c2-4132-a5d2-6f6cf83d4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":24236},{"type":"v1","addr":"172.21.15.153:6825","nonce":24236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":24236},{"type":"v1","addr":"172.21.15.153:6827","nonce":24236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":24236},{"type":"v1","addr":"172.21.15.153:6831","nonce":24236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":24236},{"type":"v1","addr":"172.21.15.153:6829","nonce":24236}]},"public_addr":"172.21.15.153:6825/24236","cluster_addr":"172.21.15.153:6827/24236","heartbeat_back_addr":"172.21.15.153:6831/24236","heartbeat_front_addr":"172.21.15.153:6829/24236","state":["exists","up"]},{"osd":4,"uuid":"a38a04cd-032b-4977-a260-1ef3567d0c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24456},{"type":"v1","addr":"172.21.15.174:6809","nonce":24456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24456},{"type":"v1","addr":"172.21.15.174:6811","nonce":24456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24456},{"type":"v1","addr":"172.21.15.174:6815","nonce":24456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24456},{"type":"v1","addr":"172.21.15.174:6813","nonce":24456}]},"public_addr":"172.21.15.174:6809/24456","cluster_addr":"172.21.15.174:6811/24456","heartbeat_back_addr":"172.21.15.174:6815/24456","heartbeat_front_addr":"172.21.15.174:6813/24456","state":["exists","up"]},{"osd":5,"uuid":"c7778084-e751-48da-87a1-ab8bbe85aa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24457},{"type":"v1","addr":"172.21.15.174:6825","nonce":24457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24457},{"type":"v1","addr":"172.21.15.174:6827","nonce":24457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24457},{"type":"v1","addr":"172.21.15.174:6831","nonce":24457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24457},{"type":"v1","addr":"172.21.15.174:6829","nonce":24457}]},"public_addr":"172.21.15.174:6825/24457","cluster_addr":"172.21.15.174:6827/24457","heartbeat_back_addr":"172.21.15.174:6831/24457","heartbeat_front_addr":"172.21.15.174:6829/24457","state":["exists","up"]},{"osd":6,"uuid":"2d8e0715-254f-442c-9625-50721d0bc858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24477},{"type":"v1","addr":"172.21.15.174:6801","nonce":24477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24477},{"type":"v1","addr":"172.21.15.174:6803","nonce":24477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24477},{"type":"v1","addr":"172.21.15.174:6807","nonce":24477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24477},{"type":"v1","addr":"172.21.15.174:6805","nonce":24477}]},"public_addr":"172.21.15.174:6801/24477","cluster_addr":"172.21.15.174:6803/24477","heartbeat_back_addr":"172.21.15.174:6807/24477","heartbeat_front_addr":"172.21.15.174:6805/24477","state":["exists","up"]},{"osd":7,"uuid":"dffda25a-4601-4ddb-9a27-b0be1cadde27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24455},{"type":"v1","addr":"172.21.15.174:6817","nonce":24455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24455},{"type":"v1","addr":"172.21.15.174:6819","nonce":24455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24455},{"type":"v1","addr":"172.21.15.174:6823","nonce":24455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24455},{"type":"v1","addr":"172.21.15.174:6821","nonce":24455}]},"public_addr":"172.21.15.174:6817/24455","cluster_addr":"172.21.15.174:6819/24455","heartbeat_back_addr":"172.21.15.174:6823/24455","heartbeat_front_addr":"172.21.15.174:6821/24455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.990117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.033862+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.748087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.112877+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.070448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.360961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.110940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.226377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:16.749 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.745+0000 7f91f3701700 1 -- 172.21.15.153:0/3318731248 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f91d8060860 msgr2=0x7f91d8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.749 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.745+0000 7f91f3701700 1 --2- 172.21.15.153:0/3318731248 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f91d8060860 0x7f91d8062d10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f91dc009390 tx=0x7f91dc016000 comp rx=0 tx=0).stop 2024-08-17T02:26:16.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.745+0000 7f91f3701700 1 -- 172.21.15.153:0/3318731248 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91ec0b3b30 msgr2=0x7f91ec15d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.745+0000 7f91f3701700 1 --2- 172.21.15.153:0/3318731248 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91ec0b3b30 0x7f91ec15d1d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f91e800c900 tx=0x7f91e8002780 comp rx=0 tx=0).stop 2024-08-17T02:26:16.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.745+0000 7f91f3701700 1 -- 172.21.15.153:0/3318731248 shutdown_connections 2024-08-17T02:26:16.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.745+0000 7f91f3701700 1 --2- 172.21.15.153:0/3318731248 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f91d8060860 0x7f91d8062d10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.745+0000 7f91f3701700 1 --2- 172.21.15.153:0/3318731248 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91ec15a2e0 0x7f91ec15d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.745+0000 7f91f3701700 1 --2- 172.21.15.153:0/3318731248 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91ec0b3b30 0x7f91ec15d1d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.745+0000 7f91f3701700 1 --2- 172.21.15.153:0/3318731248 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91ec0aac50 0x7f91ec1505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.745+0000 7f91f3701700 1 -- 172.21.15.153:0/3318731248 >> 172.21.15.153:0/3318731248 conn(0x7f91ec0994d0 msgr2=0x7f91ec0aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:16.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.745+0000 7f91f3701700 1 -- 172.21.15.153:0/3318731248 shutdown_connections 2024-08-17T02:26:16.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.745+0000 7f91f3701700 1 -- 172.21.15.153:0/3318731248 wait complete. 2024-08-17T02:26:16.761 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-08-17T02:26:16.762 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:16.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.865+0000 7f4539fe7700 1 Processor -- start 2024-08-17T02:26:16.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.865+0000 7f4539fe7700 1 -- start start 2024-08-17T02:26:16.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.865+0000 7f4539fe7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4534154900 0x7f45340b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.865+0000 7f4539fe7700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45340b1730 con 0x7f45340b12d0 2024-08-17T02:26:16.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.865+0000 7f4539fe7700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45340cbaa0 con 0x7f45340cb560 2024-08-17T02:26:16.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.865+0000 7f4539fe7700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4534068790 con 0x7f4534154900 2024-08-17T02:26:16.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.865+0000 7f4533fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f45340b12d0 0x7f45340cae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35686/0 (socket says 172.21.15.153:35686) 2024-08-17T02:26:16.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.865+0000 7f4533fff700 1 -- 172.21.15.153:0/3180011472 learned_addr learned my addr 172.21.15.153:0/3180011472 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:16.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.865+0000 7f4538fe5700 1 --2- 172.21.15.153:0/3180011472 >> v2:172.21.15.174:3300/0 conn(0x7f4534154900 0x7f45340b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.865+0000 7f45337fe700 1 -- 172.21.15.153:0/3180011472 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1827111832 0 0) 0x7f4528001110 con 0x7f45340b12d0 2024-08-17T02:26:16.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.865+0000 7f45337fe700 1 -- 172.21.15.153:0/3180011472 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f451c003570 con 0x7f45340b12d0 2024-08-17T02:26:16.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.865+0000 7f45337fe700 1 -- 172.21.15.153:0/3180011472 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1558871369 0 0) 0x7f45340cbaa0 con 0x7f45340cb560 2024-08-17T02:26:16.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.865+0000 7f45337fe700 1 -- 172.21.15.153:0/3180011472 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4528001110 con 0x7f45340cb560 2024-08-17T02:26:16.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.865+0000 7f45337fe700 1 -- 172.21.15.153:0/3180011472 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4226179788 0 0) 0x7f451c003570 con 0x7f45340b12d0 2024-08-17T02:26:16.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.865+0000 7f4538fe5700 1 -- 172.21.15.153:0/3180011472 >> v1:172.21.15.174:6789/0 conn(0x7f45340cb560 legacy=0x7f4534160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.865+0000 7f4538fe5700 1 -- 172.21.15.153:0/3180011472 >> v1:172.21.15.153:6789/0 conn(0x7f45340b12d0 legacy=0x7f45340cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.865+0000 7f4538fe5700 1 -- 172.21.15.153:0/3180011472 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4534157630 con 0x7f4534154900 2024-08-17T02:26:16.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.865+0000 7f4538fe5700 1 --2- 172.21.15.153:0/3180011472 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4534154900 0x7f45340b0d90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f45240098e0 tx=0x7f45240091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5efe9e7bc0dcad1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:16.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.865+0000 7f45337fe700 1 -- 172.21.15.153:0/3180011472 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4528001600 con 0x7f4534154900 2024-08-17T02:26:16.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.865+0000 7f45337fe700 1 -- 172.21.15.153:0/3180011472 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4524011420 con 0x7f4534154900 2024-08-17T02:26:16.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.865+0000 7f45337fe700 1 -- 172.21.15.153:0/3180011472 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45240117a0 con 0x7f4534154900 2024-08-17T02:26:16.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.865+0000 7f4539fe7700 1 -- 172.21.15.153:0/3180011472 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4534154900 msgr2=0x7f45340b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.865+0000 7f4539fe7700 1 --2- 172.21.15.153:0/3180011472 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4534154900 0x7f45340b0d90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f45240098e0 tx=0x7f45240091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.865+0000 7f4539fe7700 1 -- 172.21.15.153:0/3180011472 shutdown_connections 2024-08-17T02:26:16.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.865+0000 7f4539fe7700 1 --2- 172.21.15.153:0/3180011472 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4534154900 0x7f45340b0d90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.869+0000 7f4539fe7700 1 -- 172.21.15.153:0/3180011472 >> 172.21.15.153:0/3180011472 conn(0x7f45340678d0 msgr2=0x7f4534067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:16.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.869+0000 7f4539fe7700 1 -- 172.21.15.153:0/3180011472 shutdown_connections 2024-08-17T02:26:16.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.869+0000 7f4539fe7700 1 -- 172.21.15.153:0/3180011472 wait complete. 2024-08-17T02:26:16.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.869+0000 7f4539fe7700 1 Processor -- start 2024-08-17T02:26:16.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.869+0000 7f4539fe7700 1 -- start start 2024-08-17T02:26:16.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.869+0000 7f4539fe7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45340b12d0 0x7f45340a5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.869+0000 7f4539fe7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f45340cb560 0x7f4534142200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.869+0000 7f4539fe7700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4534154900 0x7f4534069f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.869+0000 7f4539fe7700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45340a63d0 con 0x7f45340b12d0 2024-08-17T02:26:16.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.869+0000 7f4539fe7700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45340a5e10 con 0x7f4534154900 2024-08-17T02:26:16.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.869+0000 7f4539fe7700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45340a60f0 con 0x7f45340cb560 2024-08-17T02:26:16.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.869+0000 7f4538fe5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45340b12d0 0x7f45340a5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.869+0000 7f4538fe5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45340b12d0 0x7f45340a5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57352/0 (socket says 172.21.15.153:57352) 2024-08-17T02:26:16.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.869+0000 7f4538fe5700 1 -- 172.21.15.153:0/1278235166 learned_addr learned my addr 172.21.15.153:0/1278235166 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:16.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.869+0000 7f4533fff700 1 --2- 172.21.15.153:0/1278235166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f45340cb560 0x7f4534142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.869+0000 7f45397e6700 1 --2- 172.21.15.153:0/1278235166 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4534154900 0x7f4534069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.869+0000 7f4538fe5700 1 -- 172.21.15.153:0/1278235166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f45340cb560 msgr2=0x7f4534142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.869+0000 7f4538fe5700 1 --2- 172.21.15.153:0/1278235166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f45340cb560 0x7f4534142200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.869+0000 7f4538fe5700 1 -- 172.21.15.153:0/1278235166 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4534154900 msgr2=0x7f4534069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.869+0000 7f4538fe5700 1 --2- 172.21.15.153:0/1278235166 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4534154900 0x7f4534069f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.869+0000 7f4538fe5700 1 -- 172.21.15.153:0/1278235166 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4524009420 con 0x7f45340b12d0 2024-08-17T02:26:16.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.869+0000 7f4538fe5700 1 --2- 172.21.15.153:0/1278235166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45340b12d0 0x7f45340a5450 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f45240093f0 tx=0x7f4524016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:16.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.873+0000 7f4530ff9700 1 -- 172.21.15.153:0/1278235166 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452401cc90 con 0x7f45340b12d0 2024-08-17T02:26:16.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.873+0000 7f4530ff9700 1 -- 172.21.15.153:0/1278235166 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f452401ce10 con 0x7f45340b12d0 2024-08-17T02:26:16.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.873+0000 7f4539fe7700 1 -- 172.21.15.153:0/1278235166 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45340a6b60 con 0x7f45340b12d0 2024-08-17T02:26:16.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.873+0000 7f4530ff9700 1 -- 172.21.15.153:0/1278235166 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452401a6a0 con 0x7f45340b12d0 2024-08-17T02:26:16.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.873+0000 7f4539fe7700 1 -- 172.21.15.153:0/1278235166 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f453414fea0 con 0x7f45340b12d0 2024-08-17T02:26:16.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.873+0000 7f4539fe7700 1 -- 172.21.15.153:0/1278235166 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4534150090 con 0x7f45340b12d0 2024-08-17T02:26:16.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.873+0000 7f4530ff9700 1 -- 172.21.15.153:0/1278235166 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f452401aa90 con 0x7f45340b12d0 2024-08-17T02:26:16.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.873+0000 7f4530ff9700 1 --2- 172.21.15.153:0/1278235166 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4520060860 0x7f4520062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.873+0000 7f4533fff700 1 --2- 172.21.15.153:0/1278235166 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4520060860 0x7f4520062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.873+0000 7f4530ff9700 1 -- 172.21.15.153:0/1278235166 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f452407e4c0 con 0x7f45340b12d0 2024-08-17T02:26:16.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.873+0000 7f4533fff700 1 --2- 172.21.15.153:0/1278235166 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4520060860 0x7f4520062d10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f45280010e0 tx=0x7f4528000bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:16.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:16.881+0000 7f4530ff9700 1 -- 172.21.15.153:0/1278235166 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f4534150090 con 0x7f45340b12d0 2024-08-17T02:26:17.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.045+0000 7f4539fe7700 1 -- 172.21.15.153:0/1278235166 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4534150090 con 0x7f45340b12d0 2024-08-17T02:26:17.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.045+0000 7f4530ff9700 1 -- 172.21.15.153:0/1278235166 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f4534150090 con 0x7f45340b12d0 2024-08-17T02:26:17.050 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:17.050 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":21,"fsid":"56d41c33-b929-456d-96be-2aac4ecd299d","created":"2024-08-17T02:25:47.756085+0000","modified":"2024-08-17T02:26:13.759246+0000","last_up_change":"2024-08-17T02:25:58.643690+0000","last_in_change":"2024-08-17T02:25:49.809186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:58.093273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:09.856520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:11.080706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0736f8e6-818e-42e6-a0dc-8aaf813315d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":24234},{"type":"v1","addr":"172.21.15.153:6817","nonce":24234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":24234},{"type":"v1","addr":"172.21.15.153:6819","nonce":24234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":24234},{"type":"v1","addr":"172.21.15.153:6823","nonce":24234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":24234},{"type":"v1","addr":"172.21.15.153:6821","nonce":24234}]},"public_addr":"172.21.15.153:6817/24234","cluster_addr":"172.21.15.153:6819/24234","heartbeat_back_addr":"172.21.15.153:6823/24234","heartbeat_front_addr":"172.21.15.153:6821/24234","state":["exists","up"]},{"osd":1,"uuid":"011762e9-6c2d-441a-aa56-68474639d72f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":24232},{"type":"v1","addr":"172.21.15.153:6801","nonce":24232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":24232},{"type":"v1","addr":"172.21.15.153:6803","nonce":24232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":24232},{"type":"v1","addr":"172.21.15.153:6809","nonce":24232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":24232},{"type":"v1","addr":"172.21.15.153:6806","nonce":24232}]},"public_addr":"172.21.15.153:6801/24232","cluster_addr":"172.21.15.153:6803/24232","heartbeat_back_addr":"172.21.15.153:6809/24232","heartbeat_front_addr":"172.21.15.153:6806/24232","state":["exists","up"]},{"osd":2,"uuid":"b562cd97-aa12-455e-b46a-e720a2ec9d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":24235},{"type":"v1","addr":"172.21.15.153:6808","nonce":24235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":24235},{"type":"v1","addr":"172.21.15.153:6811","nonce":24235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":24235},{"type":"v1","addr":"172.21.15.153:6815","nonce":24235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":24235},{"type":"v1","addr":"172.21.15.153:6813","nonce":24235}]},"public_addr":"172.21.15.153:6808/24235","cluster_addr":"172.21.15.153:6811/24235","heartbeat_back_addr":"172.21.15.153:6815/24235","heartbeat_front_addr":"172.21.15.153:6813/24235","state":["exists","up"]},{"osd":3,"uuid":"222da52f-90c2-4132-a5d2-6f6cf83d4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":24236},{"type":"v1","addr":"172.21.15.153:6825","nonce":24236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":24236},{"type":"v1","addr":"172.21.15.153:6827","nonce":24236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":24236},{"type":"v1","addr":"172.21.15.153:6831","nonce":24236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":24236},{"type":"v1","addr":"172.21.15.153:6829","nonce":24236}]},"public_addr":"172.21.15.153:6825/24236","cluster_addr":"172.21.15.153:6827/24236","heartbeat_back_addr":"172.21.15.153:6831/24236","heartbeat_front_addr":"172.21.15.153:6829/24236","state":["exists","up"]},{"osd":4,"uuid":"a38a04cd-032b-4977-a260-1ef3567d0c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24456},{"type":"v1","addr":"172.21.15.174:6809","nonce":24456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24456},{"type":"v1","addr":"172.21.15.174:6811","nonce":24456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24456},{"type":"v1","addr":"172.21.15.174:6815","nonce":24456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24456},{"type":"v1","addr":"172.21.15.174:6813","nonce":24456}]},"public_addr":"172.21.15.174:6809/24456","cluster_addr":"172.21.15.174:6811/24456","heartbeat_back_addr":"172.21.15.174:6815/24456","heartbeat_front_addr":"172.21.15.174:6813/24456","state":["exists","up"]},{"osd":5,"uuid":"c7778084-e751-48da-87a1-ab8bbe85aa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24457},{"type":"v1","addr":"172.21.15.174:6825","nonce":24457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24457},{"type":"v1","addr":"172.21.15.174:6827","nonce":24457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24457},{"type":"v1","addr":"172.21.15.174:6831","nonce":24457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24457},{"type":"v1","addr":"172.21.15.174:6829","nonce":24457}]},"public_addr":"172.21.15.174:6825/24457","cluster_addr":"172.21.15.174:6827/24457","heartbeat_back_addr":"172.21.15.174:6831/24457","heartbeat_front_addr":"172.21.15.174:6829/24457","state":["exists","up"]},{"osd":6,"uuid":"2d8e0715-254f-442c-9625-50721d0bc858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24477},{"type":"v1","addr":"172.21.15.174:6801","nonce":24477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24477},{"type":"v1","addr":"172.21.15.174:6803","nonce":24477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24477},{"type":"v1","addr":"172.21.15.174:6807","nonce":24477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24477},{"type":"v1","addr":"172.21.15.174:6805","nonce":24477}]},"public_addr":"172.21.15.174:6801/24477","cluster_addr":"172.21.15.174:6803/24477","heartbeat_back_addr":"172.21.15.174:6807/24477","heartbeat_front_addr":"172.21.15.174:6805/24477","state":["exists","up"]},{"osd":7,"uuid":"dffda25a-4601-4ddb-9a27-b0be1cadde27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24455},{"type":"v1","addr":"172.21.15.174:6817","nonce":24455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24455},{"type":"v1","addr":"172.21.15.174:6819","nonce":24455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24455},{"type":"v1","addr":"172.21.15.174:6823","nonce":24455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24455},{"type":"v1","addr":"172.21.15.174:6821","nonce":24455}]},"public_addr":"172.21.15.174:6817/24455","cluster_addr":"172.21.15.174:6819/24455","heartbeat_back_addr":"172.21.15.174:6823/24455","heartbeat_front_addr":"172.21.15.174:6821/24455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.990117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.033862+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.748087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.112877+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.070448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.360961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.110940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.226377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:17.052 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.049+0000 7f4539fe7700 1 -- 172.21.15.153:0/1278235166 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4520060860 msgr2=0x7f4520062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.052 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.049+0000 7f4539fe7700 1 --2- 172.21.15.153:0/1278235166 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4520060860 0x7f4520062d10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f45280010e0 tx=0x7f4528000bc0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.049+0000 7f4539fe7700 1 -- 172.21.15.153:0/1278235166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45340b12d0 msgr2=0x7f45340a5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.049+0000 7f4539fe7700 1 --2- 172.21.15.153:0/1278235166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45340b12d0 0x7f45340a5450 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f45240093f0 tx=0x7f4524016000 comp rx=0 tx=0).stop 2024-08-17T02:26:17.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.049+0000 7f4539fe7700 1 -- 172.21.15.153:0/1278235166 shutdown_connections 2024-08-17T02:26:17.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.049+0000 7f4539fe7700 1 --2- 172.21.15.153:0/1278235166 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4520060860 0x7f4520062d10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.049+0000 7f4539fe7700 1 --2- 172.21.15.153:0/1278235166 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4534154900 0x7f4534069f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.049+0000 7f4539fe7700 1 --2- 172.21.15.153:0/1278235166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f45340cb560 0x7f4534142200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.049+0000 7f4539fe7700 1 --2- 172.21.15.153:0/1278235166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45340b12d0 0x7f45340a5450 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.049+0000 7f4539fe7700 1 -- 172.21.15.153:0/1278235166 >> 172.21.15.153:0/1278235166 conn(0x7f45340678d0 msgr2=0x7f45341519e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.049+0000 7f4539fe7700 1 -- 172.21.15.153:0/1278235166 shutdown_connections 2024-08-17T02:26:17.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.049+0000 7f4539fe7700 1 -- 172.21.15.153:0/1278235166 wait complete. 2024-08-17T02:26:17.064 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-08-17T02:26:17.064 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-08-17T02:26:17.065 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-08-17T02:26:17.065 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-08-17T02:26:17.065 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-08-17T02:26:17.066 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-08-17T02:26:17.066 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-08-17T02:26:17.067 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-08-17T02:26:17.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.201+0000 7f5f57123700 1 Processor -- start 2024-08-17T02:26:17.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.201+0000 7f5f57123700 1 -- start start 2024-08-17T02:26:17.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7fe874f7b700 1 Processor -- start 2024-08-17T02:26:17.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f5ee55e1700 1 Processor -- start 2024-08-17T02:26:17.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f5ee55e1700 1 -- start start 2024-08-17T02:26:17.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7fe874f7b700 1 -- start start 2024-08-17T02:26:17.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f82a2342700 1 Processor -- start 2024-08-17T02:26:17.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f5f57123700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5f500ae2a0 0x7f5f500ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f5f57123700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5f500b0f10 0x7f5f500a95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f5f57123700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f500a9160 con 0x7f5f5015a620 2024-08-17T02:26:17.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f5f57123700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f500aff10 con 0x7f5f500b0f10 2024-08-17T02:26:17.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f5f57123700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f500b1680 con 0x7f5f500ae2a0 2024-08-17T02:26:17.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f82a2342700 1 -- start start 2024-08-17T02:26:17.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f5f4ffff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5f500ae2a0 0x7f5f500ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f5f4ffff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5f500ae2a0 0x7f5f500ab170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.153:49428/0 (socket says 172.21.15.153:49428) 2024-08-17T02:26:17.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f5f4ffff700 1 -- 172.21.15.153:0/3991395113 learned_addr learned my addr 172.21.15.153:0/3991395113 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:17.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f5f4ffff700 1 -- 172.21.15.153:0/3991395113 >> v2:172.21.15.153:3300/0 conn(0x7f5f500b0f10 msgr2=0x7f5f500a95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:17.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f5f4ffff700 1 --2- 172.21.15.153:0/3991395113 >> v2:172.21.15.153:3300/0 conn(0x7f5f500b0f10 0x7f5f500a95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f5f4ffff700 1 -- 172.21.15.153:0/3991395113 >> v1:172.21.15.153:6789/0 conn(0x7f5f5015a620 legacy=0x7f5f500adb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:17.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f5f4ffff700 1 -- 172.21.15.153:0/3991395113 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f500b1960 con 0x7f5f500ae2a0 2024-08-17T02:26:17.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f5ee55e1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5ee00ad0d0 0x7f5ee00ad4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7fe874f7b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8700adf10 0x7fe8700ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7fe874f7b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe87006e470 0x7fe87006e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7fe874f7b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8700cb890 con 0x7fe8700cad40 2024-08-17T02:26:17.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7fe874f7b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe870158290 con 0x7fe87006e470 2024-08-17T02:26:17.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7fe874f7b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8701610c0 con 0x7fe8700adf10 2024-08-17T02:26:17.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f5ee55e1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5ee00ac9b0 0x7f5ee01500f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f5ee55e1700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee00ab020 con 0x7f5ee00ac540 2024-08-17T02:26:17.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f5ee55e1700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee00ac0b0 con 0x7f5ee00ad0d0 2024-08-17T02:26:17.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f5ee55e1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee00ab780 con 0x7f5ee00ac9b0 2024-08-17T02:26:17.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f5edeffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5ee00ad0d0 0x7f5ee00ad4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f5edeffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5ee00ad0d0 0x7f5ee00ad4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57370/0 (socket says 172.21.15.153:57370) 2024-08-17T02:26:17.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f5edeffd700 1 -- 172.21.15.153:0/2760277525 learned_addr learned my addr 172.21.15.153:0/2760277525 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:17.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7fe86dd9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe87006e470 0x7fe87006e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f5f4ffff700 1 --2- 172.21.15.153:0/3991395113 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f500ae2a0 0x7f5f500ab170 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5f500aadf0 tx=0x7f5f40009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad4d4e4b276bc1a2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f82a2342700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f829c06e9c0 0x7f829c158260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f82a2342700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f829c157810 con 0x7f829c153e40 2024-08-17T02:26:17.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f5edeffd700 1 -- 172.21.15.153:0/2760277525 >> v2:172.21.15.174:3300/0 conn(0x7f5ee00ac9b0 msgr2=0x7f5ee01500f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:26:17.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f5edeffd700 1 --2- 172.21.15.153:0/2760277525 >> v2:172.21.15.174:3300/0 conn(0x7f5ee00ac9b0 0x7f5ee01500f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f5edeffd700 1 -- 172.21.15.153:0/2760277525 >> v1:172.21.15.174:6789/0 conn(0x7f5ee00ac540 legacy=0x7f5ee00aa440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:26:17.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f5edeffd700 1 -- 172.21.15.153:0/2760277525 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee00aba60 con 0x7f5ee00ad0d0 2024-08-17T02:26:17.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f82a2342700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f829c157dd0 con 0x7f829c153a70 2024-08-17T02:26:17.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f5f4f7fe700 1 -- 172.21.15.153:0/3991395113 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4000b820 con 0x7f5f500ae2a0 2024-08-17T02:26:17.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f5f4f7fe700 1 -- 172.21.15.153:0/3991395113 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4000b980 con 0x7f5f500ae2a0 2024-08-17T02:26:17.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f5f4f7fe700 1 -- 172.21.15.153:0/3991395113 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4000bd20 con 0x7f5f500ae2a0 2024-08-17T02:26:17.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f82a2342700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829c15a700 con 0x7f829c06e9c0 2024-08-17T02:26:17.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7fe86dd9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe87006e470 0x7fe87006e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57384/0 (socket says 172.21.15.153:57384) 2024-08-17T02:26:17.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7fe86dd9b700 1 -- 172.21.15.153:0/12384906 learned_addr learned my addr 172.21.15.153:0/12384906 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:17.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f829b7fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f829c153e40 0x7f829c06e2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35706/0 (socket says 172.21.15.153:35706) 2024-08-17T02:26:17.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f829b7fe700 1 -- 172.21.15.153:0/1349652672 learned_addr learned my addr 172.21.15.153:0/1349652672 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:17.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f82a08df700 1 --2- 172.21.15.153:0/1349652672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f829c06e9c0 0x7f829c158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7fe86e59c700 1 --2- 172.21.15.153:0/12384906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8700adf10 0x7fe8700ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f829affd700 1 -- 172.21.15.153:0/1349652672 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1415308953 0 0) 0x7f829c157810 con 0x7f829c153e40 2024-08-17T02:26:17.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.205+0000 7f829affd700 1 -- 172.21.15.153:0/1349652672 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8284003570 con 0x7f829c153e40 2024-08-17T02:26:17.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f5edeffd700 1 --2- 172.21.15.153:0/2760277525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ee00ad0d0 0x7f5ee00ad4a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5ee00ae830 tx=0x7f5ed8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=179e53355858c7d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7fe86dd9b700 1 -- 172.21.15.153:0/12384906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8700adf10 msgr2=0x7fe8700ae2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:17.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f82a08df700 1 -- 172.21.15.153:0/1349652672 >> v1:172.21.15.174:6789/0 conn(0x7f829c153a70 legacy=0x7f829c159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f82a08df700 1 -- 172.21.15.153:0/1349652672 >> v1:172.21.15.153:6789/0 conn(0x7f829c153e40 legacy=0x7f829c06e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f82a08df700 1 -- 172.21.15.153:0/1349652672 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829c15a9e0 con 0x7f829c06e9c0 2024-08-17T02:26:17.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7fe86dd9b700 1 --2- 172.21.15.153:0/12384906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8700adf10 0x7fe8700ae2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7fe86dd9b700 1 -- 172.21.15.153:0/12384906 >> v1:172.21.15.174:6789/0 conn(0x7fe8700cad40 legacy=0x7fe8700cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:17.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7fe86dd9b700 1 -- 172.21.15.153:0/12384906 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8700ae820 con 0x7fe87006e470 2024-08-17T02:26:17.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f5eddffb700 1 -- 172.21.15.153:0/2760277525 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed800e070 con 0x7f5ee00ad0d0 2024-08-17T02:26:17.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f5eddffb700 1 -- 172.21.15.153:0/2760277525 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed800ba10 con 0x7f5ee00ad0d0 2024-08-17T02:26:17.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f5eddffb700 1 -- 172.21.15.153:0/2760277525 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed80092e0 con 0x7f5ee00ad0d0 2024-08-17T02:26:17.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f5f57123700 1 -- 172.21.15.153:0/3991395113 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f500ae2a0 msgr2=0x7f5f500ab170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f5f57123700 1 --2- 172.21.15.153:0/3991395113 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f500ae2a0 0x7f5f500ab170 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5f500aadf0 tx=0x7f5f40009250 comp rx=0 tx=0).stop 2024-08-17T02:26:17.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7fe86e59c700 1 --2- 172.21.15.153:0/12384906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8700adf10 0x7fe8700ae2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:17.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f82a08df700 1 --2- 172.21.15.153:0/1349652672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f829c06e9c0 0x7f829c158260 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8294009e10 tx=0x7f8294009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfb47b4165418afa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f5f57123700 1 -- 172.21.15.153:0/3991395113 shutdown_connections 2024-08-17T02:26:17.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f5f57123700 1 --2- 172.21.15.153:0/3991395113 >> v2:172.21.15.153:3300/0 conn(0x7f5f500b0f10 0x7f5f500a95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f5f57123700 1 --2- 172.21.15.153:0/3991395113 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f500ae2a0 0x7f5f500ab170 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f5f57123700 1 -- 172.21.15.153:0/3991395113 >> 172.21.15.153:0/3991395113 conn(0x7f5f50067810 msgr2=0x7f5f50067c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f5f57123700 1 -- 172.21.15.153:0/3991395113 shutdown_connections 2024-08-17T02:26:17.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f5f57123700 1 -- 172.21.15.153:0/3991395113 wait complete. 2024-08-17T02:26:17.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f829affd700 1 -- 172.21.15.153:0/1349652672 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829400e070 con 0x7f829c06e9c0 2024-08-17T02:26:17.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7fe86dd9b700 1 --2- 172.21.15.153:0/12384906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe87006e470 0x7fe87006e8e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe87006c9d0 tx=0x7fe868009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70ad0ba99efed751 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f5ee55e1700 1 -- 172.21.15.153:0/2760277525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ee00ad0d0 msgr2=0x7f5ee00ad4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f5ee55e1700 1 --2- 172.21.15.153:0/2760277525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ee00ad0d0 0x7f5ee00ad4a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5ee00ae830 tx=0x7f5ed8009840 comp rx=0 tx=0).stop 2024-08-17T02:26:17.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f5ee55e1700 1 -- 172.21.15.153:0/2760277525 shutdown_connections 2024-08-17T02:26:17.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f5ee55e1700 1 --2- 172.21.15.153:0/2760277525 >> v2:172.21.15.174:3300/0 conn(0x7f5ee00ac9b0 0x7f5ee01500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f5ee55e1700 1 --2- 172.21.15.153:0/2760277525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ee00ad0d0 0x7f5ee00ad4a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f5ee55e1700 1 -- 172.21.15.153:0/2760277525 >> 172.21.15.153:0/2760277525 conn(0x7f5ee0068300 msgr2=0x7f5ee00a8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f75f2733700 1 Processor -- start 2024-08-17T02:26:17.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f95bfd8f700 1 Processor -- start 2024-08-17T02:26:17.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f95bfd8f700 1 -- start start 2024-08-17T02:26:17.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f5ee55e1700 1 -- 172.21.15.153:0/2760277525 shutdown_connections 2024-08-17T02:26:17.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f791ea67700 1 Processor -- start 2024-08-17T02:26:17.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f791ea67700 1 -- start start 2024-08-17T02:26:17.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f791ea67700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79180aa670 0x7f79180aaa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f791ea67700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f791815d1f0 0x7f791815d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f791ea67700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f791806a6d0 con 0x7f79180aed20 2024-08-17T02:26:17.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f791ea67700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f791806a9b0 con 0x7f791815d1f0 2024-08-17T02:26:17.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f791ea67700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7918069d30 con 0x7f79180aa670 2024-08-17T02:26:17.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f75f2733700 1 -- start start 2024-08-17T02:26:17.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f791d004700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f791815d1f0 0x7f791815d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f7917fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f79180aed20 0x7f7918069270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35708/0 (socket says 172.21.15.153:35708) 2024-08-17T02:26:17.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f7917fff700 1 -- 172.21.15.153:0/3505984251 learned_addr learned my addr 172.21.15.153:0/3505984251 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:17.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f791c803700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79180aa670 0x7f79180aaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f5f57123700 1 Processor -- start 2024-08-17T02:26:17.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f5ee55e1700 1 -- 172.21.15.153:0/2760277525 wait complete. 2024-08-17T02:26:17.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7fd18ae3f700 1 Processor -- start 2024-08-17T02:26:17.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f5f57123700 1 -- start start 2024-08-17T02:26:17.227 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f829affd700 1 -- 172.21.15.153:0/1349652672 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f829400bae0 con 0x7f829c06e9c0 2024-08-17T02:26:17.227 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f829affd700 1 -- 172.21.15.153:0/1349652672 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829400be60 con 0x7f829c06e9c0 2024-08-17T02:26:17.227 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7fd18ae3f700 1 -- start start 2024-08-17T02:26:17.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7fe86d59a700 1 -- 172.21.15.153:0/12384906 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86800e070 con 0x7fe87006e470 2024-08-17T02:26:17.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7fe86d59a700 1 -- 172.21.15.153:0/12384906 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86800ba10 con 0x7fe87006e470 2024-08-17T02:26:17.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7fe86d59a700 1 -- 172.21.15.153:0/12384906 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8680092e0 con 0x7fe87006e470 2024-08-17T02:26:17.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f75f2733700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f75ec154f50 0x7f75ec158160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f5f57123700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f500ae2a0 0x7f5f50154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f75f2733700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75ec0a91f0 0x7f75ec0aab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f75f2733700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75ec0ab4f0 con 0x7f75ec0ab0b0 2024-08-17T02:26:17.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f75f2733700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75ec0a9790 con 0x7f75ec154f50 2024-08-17T02:26:17.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f75f2733700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec0a9a70 con 0x7f75ec0a91f0 2024-08-17T02:26:17.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f82a2342700 1 -- 172.21.15.153:0/1349652672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f829c06e9c0 msgr2=0x7f829c158260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f82a2342700 1 --2- 172.21.15.153:0/1349652672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f829c06e9c0 0x7f829c158260 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8294009e10 tx=0x7f8294009780 comp rx=0 tx=0).stop 2024-08-17T02:26:17.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7fe874f7b700 1 -- 172.21.15.153:0/12384906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe87006e470 msgr2=0x7fe87006e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7fe874f7b700 1 --2- 172.21.15.153:0/12384906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe87006e470 0x7fe87006e8e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe87006c9d0 tx=0x7fe868009840 comp rx=0 tx=0).stop 2024-08-17T02:26:17.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f5f57123700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f500b0f10 0x7f5f500cad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f75f1f32700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f75ec0ab0b0 0x7f75ec15ad30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35716/0 (socket says 172.21.15.153:35716) 2024-08-17T02:26:17.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f75f1f32700 1 -- 172.21.15.153:0/3322879838 learned_addr learned my addr 172.21.15.153:0/3322879838 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:17.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f82a2342700 1 -- 172.21.15.153:0/1349652672 shutdown_connections 2024-08-17T02:26:17.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f5f54ebf700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f500ae2a0 0x7f5f50154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f5f54ebf700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f500ae2a0 0x7f5f50154d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57400/0 (socket says 172.21.15.153:57400) 2024-08-17T02:26:17.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f82a2342700 1 --2- 172.21.15.153:0/1349652672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f829c06e9c0 0x7f829c158260 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f82a2342700 1 -- 172.21.15.153:0/1349652672 >> 172.21.15.153:0/1349652672 conn(0x7f829c067810 msgr2=0x7f829c067c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5f57123700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f5015a620 0x7f5f5014f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5f54ebf700 1 -- 172.21.15.153:0/2242128261 learned_addr learned my addr 172.21.15.153:0/2242128261 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:17.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5f57123700 1 -- 172.21.15.153:0/2242128261 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f501552b0 con 0x7f5f500ae2a0 2024-08-17T02:26:17.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5f57123700 1 -- 172.21.15.153:0/2242128261 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f500c8150 con 0x7f5f5015a620 2024-08-17T02:26:17.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5f57123700 1 -- 172.21.15.153:0/2242128261 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f501548e0 con 0x7f5f500b0f10 2024-08-17T02:26:17.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f75f1731700 1 --2- 172.21.15.153:0/3322879838 >> v2:172.21.15.174:3300/0 conn(0x7f75ec154f50 0x7f75ec158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5ee55e1700 1 Processor -- start 2024-08-17T02:26:17.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5f4ffff700 1 --2- 172.21.15.153:0/2242128261 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f500b0f10 0x7f5f500cad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5f556c0700 1 --2- 172.21.15.153:0/2242128261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f5015a620 0x7f5f5014f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f791d004700 1 -- 172.21.15.153:0/3505984251 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79180aa670 msgr2=0x7f79180aaa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:17.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f791d004700 1 --2- 172.21.15.153:0/3505984251 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79180aa670 0x7f79180aaa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f791d004700 1 -- 172.21.15.153:0/3505984251 >> v1:172.21.15.153:6789/0 conn(0x7f79180aed20 legacy=0x7f7918069270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f791d004700 1 -- 172.21.15.153:0/3505984251 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f791806a010 con 0x7f791815d1f0 2024-08-17T02:26:17.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.209+0000 7f791d004700 1 --2- 172.21.15.153:0/3505984251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f791815d1f0 0x7f791815d670 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f790c009910 tx=0x7f790c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca279874b2784a2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5ee55e1700 1 -- start start 2024-08-17T02:26:17.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7fe874f7b700 1 -- 172.21.15.153:0/12384906 shutdown_connections 2024-08-17T02:26:17.235 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7fe874f7b700 1 --2- 172.21.15.153:0/12384906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe87006e470 0x7fe87006e8e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.235 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7fe874f7b700 1 --2- 172.21.15.153:0/12384906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8700adf10 0x7fe8700ae2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.235 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f75f0f30700 1 --2- 172.21.15.153:0/3322879838 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75ec0a91f0 0x7f75ec0aab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.235 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7fe874f7b700 1 -- 172.21.15.153:0/12384906 >> 172.21.15.153:0/12384906 conn(0x7fe870067810 msgr2=0x7fe870067c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.236 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f75e3fff700 1 -- 172.21.15.153:0/3322879838 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 607077653 0 0) 0x7f75ec0ab4f0 con 0x7f75ec0ab0b0 2024-08-17T02:26:17.236 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f75e3fff700 1 -- 172.21.15.153:0/3322879838 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75d8003570 con 0x7f75ec0ab0b0 2024-08-17T02:26:17.236 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f82a2342700 1 -- 172.21.15.153:0/1349652672 shutdown_connections 2024-08-17T02:26:17.236 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7fe874f7b700 1 -- 172.21.15.153:0/12384906 shutdown_connections 2024-08-17T02:26:17.236 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7fe874f7b700 1 -- 172.21.15.153:0/12384906 wait complete. 2024-08-17T02:26:17.236 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f79177fe700 1 -- 172.21.15.153:0/3505984251 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790c00b640 con 0x7f791815d1f0 2024-08-17T02:26:17.236 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f79177fe700 1 -- 172.21.15.153:0/3505984251 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f790c00b7a0 con 0x7f791815d1f0 2024-08-17T02:26:17.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f79177fe700 1 -- 172.21.15.153:0/3505984251 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790c00bb60 con 0x7f791815d1f0 2024-08-17T02:26:17.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f75f0f30700 1 -- 172.21.15.153:0/3322879838 >> v2:172.21.15.174:3300/0 conn(0x7f75ec154f50 msgr2=0x7f75ec158160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:17.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f75f0f30700 1 --2- 172.21.15.153:0/3322879838 >> v2:172.21.15.174:3300/0 conn(0x7f75ec154f50 0x7f75ec158160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f75f0f30700 1 -- 172.21.15.153:0/3322879838 >> v1:172.21.15.153:6789/0 conn(0x7f75ec0ab0b0 legacy=0x7f75ec15ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f75f0f30700 1 -- 172.21.15.153:0/3322879838 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ec0a9d50 con 0x7f75ec0a91f0 2024-08-17T02:26:17.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7fd18ae3f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd1840ad4a0 0x7fd1840aa440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7fd18ae3f700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1840ab020 con 0x7fd1840aa980 2024-08-17T02:26:17.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7fd18ae3f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1840ac0b0 con 0x7fd1840ad0d0 2024-08-17T02:26:17.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7fd18ae3f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1840acc50 con 0x7fd1840ad4a0 2024-08-17T02:26:17.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f95bfd8f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b814f850 0x7f95b80691f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f95bfd8f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f95b814fc20 0x7f95b8156200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f95bfd8f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f95b80ae5d0 0x7f95b80aa440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f95bfd8f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b8069a40 con 0x7f95b80ae5d0 2024-08-17T02:26:17.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f95bfd8f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b8069d20 con 0x7f95b814fc20 2024-08-17T02:26:17.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f95bfd8f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b806a000 con 0x7f95b814f850 2024-08-17T02:26:17.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5f556c0700 1 -- 172.21.15.153:0/2242128261 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f500b0f10 msgr2=0x7f5f500cad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5f556c0700 1 --2- 172.21.15.153:0/2242128261 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f500b0f10 0x7f5f500cad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5f556c0700 1 -- 172.21.15.153:0/2242128261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f500ae2a0 msgr2=0x7f5f50154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5f556c0700 1 --2- 172.21.15.153:0/2242128261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f500ae2a0 0x7f5f50154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5f556c0700 1 -- 172.21.15.153:0/2242128261 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f400094f0 con 0x7f5f5015a620 2024-08-17T02:26:17.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5f54ebf700 1 --2- 172.21.15.153:0/2242128261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f500ae2a0 0x7f5f50154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:17.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f95bdb2b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b814f850 0x7f95b80691f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f95bdb2b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b814f850 0x7f95b80691f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.153:34734/0 (socket says 172.21.15.153:34734) 2024-08-17T02:26:17.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f95bdb2b700 1 -- 172.21.15.153:0/3565472604 learned_addr learned my addr 172.21.15.153:0/3565472604 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:17.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f82a2342700 1 -- 172.21.15.153:0/1349652672 wait complete. 2024-08-17T02:26:17.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f95bd32a700 1 --2- 172.21.15.153:0/3565472604 >> v2:172.21.15.174:3300/0 conn(0x7f95b814fc20 0x7f95b8156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f75f0f30700 1 --2- 172.21.15.153:0/3322879838 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75ec0a91f0 0x7f75ec0aab70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f75dc00dd10 tx=0x7f75dc00d630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32a8b39ff8af8383 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5f556c0700 1 --2- 172.21.15.153:0/2242128261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f5015a620 0x7f5f5014f9a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5f4400b5e0 tx=0x7f5f44009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7fd183fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd1840ad4a0 0x7fd1840aa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7fd188bdb700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fd1840ad0d0 0x7fd1840ac540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.153:59984/0 (socket says 172.21.15.153:59984) 2024-08-17T02:26:17.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f95be32c700 1 --2- 172.21.15.153:0/3565472604 >> v2:172.21.15.153:3300/0 conn(0x7f95b80ae5d0 0x7f95b80aa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7fd188bdb700 1 -- 172.21.15.153:0/1201787551 learned_addr learned my addr 172.21.15.153:0/1201787551 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:17.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f75e3fff700 1 -- 172.21.15.153:0/3322879838 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75dc012070 con 0x7f75ec0a91f0 2024-08-17T02:26:17.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7fd183fff700 1 -- 172.21.15.153:0/1201787551 >> v1:172.21.15.174:6789/0 conn(0x7fd1840ad0d0 legacy=0x7fd1840ac540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7fd183fff700 1 -- 172.21.15.153:0/1201787551 >> v1:172.21.15.153:6789/0 conn(0x7fd1840aa980 legacy=0x7fd1841500f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:17.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7fd183fff700 1 -- 172.21.15.153:0/1201787551 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1840ab780 con 0x7fd1840ad4a0 2024-08-17T02:26:17.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f95be32c700 1 -- 172.21.15.153:0/3565472604 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b814f850 msgr2=0x7f95b80691f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:17.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f95be32c700 1 --2- 172.21.15.153:0/3565472604 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b814f850 0x7f95b80691f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f95be32c700 1 -- 172.21.15.153:0/3565472604 >> v2:172.21.15.174:3300/0 conn(0x7f95b814fc20 msgr2=0x7f95b8156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:17.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f95be32c700 1 --2- 172.21.15.153:0/3565472604 >> v2:172.21.15.174:3300/0 conn(0x7f95b814fc20 0x7f95b8156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f95be32c700 1 -- 172.21.15.153:0/3565472604 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b8155ce0 con 0x7f95b80ae5d0 2024-08-17T02:26:17.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5f4cff9700 1 -- 172.21.15.153:0/2242128261 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4400f510 con 0x7f5f5015a620 2024-08-17T02:26:17.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5f4cff9700 1 -- 172.21.15.153:0/2242128261 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4400f670 con 0x7f5f5015a620 2024-08-17T02:26:17.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5f57123700 1 -- 172.21.15.153:0/2242128261 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f50153cd0 con 0x7f5f5015a620 2024-08-17T02:26:17.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5f57123700 1 -- 172.21.15.153:0/2242128261 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f50154570 con 0x7f5f5015a620 2024-08-17T02:26:17.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5f4cff9700 1 -- 172.21.15.153:0/2242128261 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4400fa30 con 0x7f5f5015a620 2024-08-17T02:26:17.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f75e3fff700 1 -- 172.21.15.153:0/3322879838 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75dc00de70 con 0x7f75ec0a91f0 2024-08-17T02:26:17.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f75e3fff700 1 -- 172.21.15.153:0/3322879838 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75dc00fab0 con 0x7f75ec0a91f0 2024-08-17T02:26:17.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5ee55e1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ee00ac540 0x7f5ee00986f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5ee55e1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ee00ac9b0 0x7f5ee00a9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7fd183fff700 1 --2- 172.21.15.153:0/1201787551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1840ad4a0 0x7fd1840aa440 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd17c00d100 tx=0x7fd17c00b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8ea9f468355e8bf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7fe874f7b700 1 Processor -- start 2024-08-17T02:26:17.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5ee55e1700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ee00ad0d0 0x7f5ee006adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7fe874f7b700 1 -- start start 2024-08-17T02:26:17.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7fd1837fe700 1 -- 172.21.15.153:0/1201787551 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c010070 con 0x7fd1840ad4a0 2024-08-17T02:26:17.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7fd1837fe700 1 -- 172.21.15.153:0/1201787551 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17c00dda0 con 0x7fd1840ad4a0 2024-08-17T02:26:17.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f95be32c700 1 --2- 172.21.15.153:0/3565472604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95b80ae5d0 0x7f95b80aa440 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f95b8065660 tx=0x7f95b0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=927a1a5f52ccdfe6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5ee55e1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee0098260 con 0x7f5ee00ac9b0 2024-08-17T02:26:17.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5ede7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ee00ac9b0 0x7f5ee00a9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5ede7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ee00ac9b0 0x7f5ee00a9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57424/0 (socket says 172.21.15.153:57424) 2024-08-17T02:26:17.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5ede7fc700 1 -- 172.21.15.153:0/3207570274 learned_addr learned my addr 172.21.15.153:0/3207570274 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:17.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5ee55e1700 1 -- 172.21.15.153:0/3207570274 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee00973b0 con 0x7f5ee00ad0d0 2024-08-17T02:26:17.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5edf7fe700 1 --2- 172.21.15.153:0/3207570274 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ee00ad0d0 0x7f5ee006adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5ee55e1700 1 -- 172.21.15.153:0/3207570274 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee0097650 con 0x7f5ee00ac540 2024-08-17T02:26:17.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5edeffd700 1 --2- 172.21.15.153:0/3207570274 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ee00ac540 0x7f5ee00986f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f75f2733700 1 -- 172.21.15.153:0/3322879838 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75ec0a91f0 msgr2=0x7f75ec0aab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f75f2733700 1 --2- 172.21.15.153:0/3322879838 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75ec0a91f0 0x7f75ec0aab70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f75dc00dd10 tx=0x7f75dc00d630 comp rx=0 tx=0).stop 2024-08-17T02:26:17.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f95bcb29700 1 -- 172.21.15.153:0/3565472604 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b000e070 con 0x7f95b80ae5d0 2024-08-17T02:26:17.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f82a2342700 1 Processor -- start 2024-08-17T02:26:17.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7fe874f7b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe87006e470 0x7fe87016ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7fe874f7b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8700adf10 0x7fe870143950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7fe874f7b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8700cad40 0x7fe8700aed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7fe874f7b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe870171090 con 0x7fe8700cad40 2024-08-17T02:26:17.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7fe874f7b700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe870154750 con 0x7fe87006e470 2024-08-17T02:26:17.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7fe874f7b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8700b18b0 con 0x7fe8700adf10 2024-08-17T02:26:17.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7fe86ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8700cad40 0x7fe8700aed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7fe86ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8700cad40 0x7fe8700aed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57434/0 (socket says 172.21.15.153:57434) 2024-08-17T02:26:17.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7fe86ed9d700 1 -- 172.21.15.153:0/2813226536 learned_addr learned my addr 172.21.15.153:0/2813226536 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:17.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7fe86e59c700 1 --2- 172.21.15.153:0/2813226536 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe87006e470 0x7fe87016ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7fe86dd9b700 1 --2- 172.21.15.153:0/2813226536 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8700adf10 0x7fe870143950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7fe86ed9d700 1 -- 172.21.15.153:0/2813226536 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8700adf10 msgr2=0x7fe870143950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7fe86ed9d700 1 --2- 172.21.15.153:0/2813226536 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8700adf10 0x7fe870143950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7fe86ed9d700 1 -- 172.21.15.153:0/2813226536 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe87006e470 msgr2=0x7fe87016ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7fe86ed9d700 1 --2- 172.21.15.153:0/2813226536 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe87006e470 0x7fe87016ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7fe86ed9d700 1 -- 172.21.15.153:0/2813226536 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe868009ae0 con 0x7fe8700cad40 2024-08-17T02:26:17.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f791ea67700 1 -- 172.21.15.153:0/3505984251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f791815d1f0 msgr2=0x7f791815d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f791ea67700 1 --2- 172.21.15.153:0/3505984251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f791815d1f0 0x7f791815d670 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f790c009910 tx=0x7f790c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f791ea67700 1 -- 172.21.15.153:0/3505984251 shutdown_connections 2024-08-17T02:26:17.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f791ea67700 1 --2- 172.21.15.153:0/3505984251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f791815d1f0 0x7f791815d670 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f791ea67700 1 --2- 172.21.15.153:0/3505984251 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79180aa670 0x7f79180aaa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f791ea67700 1 -- 172.21.15.153:0/3505984251 >> 172.21.15.153:0/3505984251 conn(0x7f7918068300 msgr2=0x7f79180a8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f791ea67700 1 -- 172.21.15.153:0/3505984251 shutdown_connections 2024-08-17T02:26:17.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f791ea67700 1 -- 172.21.15.153:0/3505984251 wait complete. 2024-08-17T02:26:17.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5ede7fc700 1 -- 172.21.15.153:0/3207570274 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ee00ac540 msgr2=0x7f5ee00986f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5ede7fc700 1 --2- 172.21.15.153:0/3207570274 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ee00ac540 0x7f5ee00986f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5ede7fc700 1 -- 172.21.15.153:0/3207570274 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ee00ad0d0 msgr2=0x7f5ee006adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5ede7fc700 1 --2- 172.21.15.153:0/3207570274 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ee00ad0d0 0x7f5ee006adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5ede7fc700 1 -- 172.21.15.153:0/3207570274 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed8009ae0 con 0x7f5ee00ac9b0 2024-08-17T02:26:17.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5ede7fc700 1 --2- 172.21.15.153:0/3207570274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ee00ac9b0 0x7f5ee00a9b40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5ed400b600 tx=0x7f5ed40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5ec6ffd700 1 -- 172.21.15.153:0/3207570274 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed400f510 con 0x7f5ee00ac9b0 2024-08-17T02:26:17.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f5ee55e1700 1 -- 172.21.15.153:0/3207570274 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee0097930 con 0x7f5ee00ac9b0 2024-08-17T02:26:17.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7fd18ae3f700 1 -- 172.21.15.153:0/1201787551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1840ad4a0 msgr2=0x7fd1840aa440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7fd18ae3f700 1 --2- 172.21.15.153:0/1201787551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1840ad4a0 0x7fd1840aa440 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd17c00d100 tx=0x7fd17c00b990 comp rx=0 tx=0).stop 2024-08-17T02:26:17.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7fd18ae3f700 1 -- 172.21.15.153:0/1201787551 shutdown_connections 2024-08-17T02:26:17.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7fd18ae3f700 1 --2- 172.21.15.153:0/1201787551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1840ad4a0 0x7fd1840aa440 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7fd18ae3f700 1 -- 172.21.15.153:0/1201787551 >> 172.21.15.153:0/1201787551 conn(0x7fd184068300 msgr2=0x7fd1840a8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7fd18ae3f700 1 -- 172.21.15.153:0/1201787551 shutdown_connections 2024-08-17T02:26:17.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7fd18ae3f700 1 -- 172.21.15.153:0/1201787551 wait complete. 2024-08-17T02:26:17.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f95bcb29700 1 -- 172.21.15.153:0/3565472604 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b000bab0 con 0x7f95b80ae5d0 2024-08-17T02:26:17.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f95bcb29700 1 -- 172.21.15.153:0/3565472604 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b000be70 con 0x7f95b80ae5d0 2024-08-17T02:26:17.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f95bfd8f700 1 -- 172.21.15.153:0/3565472604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95b80ae5d0 msgr2=0x7f95b80aa440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f95bfd8f700 1 --2- 172.21.15.153:0/3565472604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95b80ae5d0 0x7f95b80aa440 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f95b8065660 tx=0x7f95b0009780 comp rx=0 tx=0).stop 2024-08-17T02:26:17.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.213+0000 7f5f57123700 1 -- 172.21.15.153:0/2242128261 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5f500645c0 con 0x7f5f5015a620 2024-08-17T02:26:17.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7fe86ed9d700 1 --2- 172.21.15.153:0/2813226536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8700cad40 0x7fe8700aed20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe86000b4e0 tx=0x7fe860006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f5ec6ffd700 1 -- 172.21.15.153:0/3207570274 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed400f690 con 0x7f5ee00ac9b0 2024-08-17T02:26:17.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f75f2733700 1 -- 172.21.15.153:0/3322879838 shutdown_connections 2024-08-17T02:26:17.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f75f2733700 1 --2- 172.21.15.153:0/3322879838 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75ec0a91f0 0x7f75ec0aab70 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f75f2733700 1 --2- 172.21.15.153:0/3322879838 >> v2:172.21.15.174:3300/0 conn(0x7f75ec154f50 0x7f75ec158160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f75f2733700 1 -- 172.21.15.153:0/3322879838 >> 172.21.15.153:0/3322879838 conn(0x7f75ec066e00 msgr2=0x7f75ec067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f95bfd8f700 1 -- 172.21.15.153:0/3565472604 shutdown_connections 2024-08-17T02:26:17.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f95bfd8f700 1 --2- 172.21.15.153:0/3565472604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95b80ae5d0 0x7f95b80aa440 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f95bfd8f700 1 --2- 172.21.15.153:0/3565472604 >> v2:172.21.15.174:3300/0 conn(0x7f95b814fc20 0x7f95b8156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f95bfd8f700 1 --2- 172.21.15.153:0/3565472604 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b814f850 0x7f95b80691f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f95bfd8f700 1 -- 172.21.15.153:0/3565472604 >> 172.21.15.153:0/3565472604 conn(0x7f95b8068300 msgr2=0x7f95b80a8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7fe85e7fc700 1 -- 172.21.15.153:0/2813226536 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86000f5e0 con 0x7fe8700cad40 2024-08-17T02:26:17.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7fe85e7fc700 1 -- 172.21.15.153:0/2813226536 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86000f740 con 0x7fe8700cad40 2024-08-17T02:26:17.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7fe85e7fc700 1 -- 172.21.15.153:0/2813226536 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86000fb00 con 0x7fe8700cad40 2024-08-17T02:26:17.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7fe874f7b700 1 -- 172.21.15.153:0/2813226536 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8700b1b90 con 0x7fe8700cad40 2024-08-17T02:26:17.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7fe874f7b700 1 -- 172.21.15.153:0/2813226536 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe870069570 con 0x7fe8700cad40 2024-08-17T02:26:17.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7fd18ae3f700 1 Processor -- start 2024-08-17T02:26:17.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f5f4cff9700 1 -- 172.21.15.153:0/2242128261 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5f4401a400 con 0x7f5f5015a620 2024-08-17T02:26:17.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f5f4cff9700 1 --2- 172.21.15.153:0/2242128261 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f5f3c0691c0 0x7f5f3c06b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f5f4cff9700 1 -- 172.21.15.153:0/2242128261 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5f4407c620 con 0x7f5f5015a620 2024-08-17T02:26:17.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f5f54ebf700 1 --2- 172.21.15.153:0/2242128261 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f5f3c0691c0 0x7f5f3c06b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f5f4cff9700 1 --2- 172.21.15.153:0/2242128261 >> [v2:172.21.15.174:6816/24455,v1:172.21.15.174:6817/24455] conn(0x7f5f3c0713d0 0x7f5f3c0737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f5f4cff9700 1 -- 172.21.15.153:0/2242128261 --> [v2:172.21.15.174:6816/24455,v1:172.21.15.174:6817/24455] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5f3c073e90 con 0x7f5f3c0713d0 2024-08-17T02:26:17.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f5f4cff9700 1 -- 172.21.15.153:0/2242128261 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f4407ebc0 con 0x7f5f5015a620 2024-08-17T02:26:17.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f82a2342700 1 -- start start 2024-08-17T02:26:17.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f82a2342700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f829c06e9c0 0x7f829c152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f82a2342700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f829c153a70 0x7f829c06d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f95bfd8f700 1 -- 172.21.15.153:0/3565472604 shutdown_connections 2024-08-17T02:26:17.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f82a2342700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f829c153e40 0x7f829c14a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f82a2342700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829c099530 con 0x7f829c153a70 2024-08-17T02:26:17.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f82a2342700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829c0ad330 con 0x7f829c153e40 2024-08-17T02:26:17.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f82a2342700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829c0ac6b0 con 0x7f829c06e9c0 2024-08-17T02:26:17.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f82a08df700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f829c153e40 0x7f829c14a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f82a08df700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f829c153e40 0x7f829c14a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.153:49508/0 (socket says 172.21.15.153:49508) 2024-08-17T02:26:17.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f82a08df700 1 -- 172.21.15.153:0/3861222617 learned_addr learned my addr 172.21.15.153:0/3861222617 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:17.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f5ec6ffd700 1 -- 172.21.15.153:0/3207570274 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed400fa50 con 0x7f5ee00ac9b0 2024-08-17T02:26:17.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f5ee55e1700 1 -- 172.21.15.153:0/3207570274 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee0097ef0 con 0x7f5ee00ac9b0 2024-08-17T02:26:17.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f5f4ffff700 1 --2- 172.21.15.153:0/2242128261 >> [v2:172.21.15.174:6816/24455,v1:172.21.15.174:6817/24455] conn(0x7f5f3c0713d0 0x7f5f3c0737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f95bfd8f700 1 -- 172.21.15.153:0/3565472604 wait complete. 2024-08-17T02:26:17.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f75f2733700 1 -- 172.21.15.153:0/3322879838 shutdown_connections 2024-08-17T02:26:17.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f5ec6ffd700 1 -- 172.21.15.153:0/3207570274 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5ed401a400 con 0x7f5ee00ac9b0 2024-08-17T02:26:17.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f829bfff700 1 --2- 172.21.15.153:0/3861222617 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f829c06e9c0 0x7f829c152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f82a08df700 1 -- 172.21.15.153:0/3861222617 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f829c06e9c0 msgr2=0x7f829c152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f82a08df700 1 --2- 172.21.15.153:0/3861222617 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f829c06e9c0 0x7f829c152bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f82a08df700 1 -- 172.21.15.153:0/3861222617 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f829c153a70 msgr2=0x7f829c06d440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:26:17.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f82a08df700 1 --2- 172.21.15.153:0/3861222617 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f829c153a70 0x7f829c06d440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f82a08df700 1 -- 172.21.15.153:0/3861222617 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8294009a20 con 0x7f829c153e40 2024-08-17T02:26:17.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7fd18ae3f700 1 -- start start 2024-08-17T02:26:17.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7fd18ae3f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1840aa980 0x7fd1840c1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7fd18ae3f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1840ad0d0 0x7fd1840cae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7fd18ae3f700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1840c2450 0x7fd1840cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f82a08df700 1 --2- 172.21.15.153:0/3861222617 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f829c153e40 0x7f829c14a170 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8294003000 tx=0x7f8294018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f5ec6ffd700 1 --2- 172.21.15.153:0/3207570274 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f5ecc0609b0 0x7f5ecc062e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f75f2733700 1 -- 172.21.15.153:0/3322879838 wait complete. 2024-08-17T02:26:17.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7fd188bdb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1840aa980 0x7fd1840c1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7fd18ae3f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd184142340 con 0x7fd1840aa980 2024-08-17T02:26:17.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7fd18ae3f700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd184142620 con 0x7fd1840c2450 2024-08-17T02:26:17.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7fd18ae3f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd184142900 con 0x7fd1840ad0d0 2024-08-17T02:26:17.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7fd188bdb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1840aa980 0x7fd1840c1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57442/0 (socket says 172.21.15.153:57442) 2024-08-17T02:26:17.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7fd188bdb700 1 -- 172.21.15.153:0/3385792175 learned_addr learned my addr 172.21.15.153:0/3385792175 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:17.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7fd183fff700 1 --2- 172.21.15.153:0/3385792175 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1840ad0d0 0x7fd1840cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7fd1893dc700 1 --2- 172.21.15.153:0/3385792175 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1840c2450 0x7fd1840cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f5f4ffff700 1 --2- 172.21.15.153:0/2242128261 >> [v2:172.21.15.174:6816/24455,v1:172.21.15.174:6817/24455] conn(0x7f5f3c0713d0 0x7f5f3c0737e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7fd188bdb700 1 -- 172.21.15.153:0/3385792175 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1840ad0d0 msgr2=0x7fd1840cae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7fd188bdb700 1 --2- 172.21.15.153:0/3385792175 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1840ad0d0 0x7fd1840cae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7fd188bdb700 1 -- 172.21.15.153:0/3385792175 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1840c2450 msgr2=0x7fd1840cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7fd188bdb700 1 --2- 172.21.15.153:0/3385792175 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1840c2450 0x7fd1840cb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7fd188bdb700 1 -- 172.21.15.153:0/3385792175 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd17c00bc30 con 0x7fd1840aa980 2024-08-17T02:26:17.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f791ea67700 1 Processor -- start 2024-08-17T02:26:17.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7f791ea67700 1 -- start start 2024-08-17T02:26:17.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f5ee55e1700 1 -- 172.21.15.153:0/3207570274 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5ee0070360 con 0x7f5ee00ac9b0 2024-08-17T02:26:17.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f8283fff700 1 -- 172.21.15.153:0/3861222617 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8294026460 con 0x7f829c153e40 2024-08-17T02:26:17.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7fd188bdb700 1 --2- 172.21.15.153:0/3385792175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1840aa980 0x7fd1840c1f10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd17800c560 tx=0x7fd178007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f5ec6ffd700 1 -- 172.21.15.153:0/3207570274 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5ed4050740 con 0x7f5ee00ac9b0 2024-08-17T02:26:17.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f95bfd8f700 1 Processor -- start 2024-08-17T02:26:17.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f5edeffd700 1 --2- 172.21.15.153:0/3207570274 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f5ecc0609b0 0x7f5ecc062e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f95bfd8f700 1 -- start start 2024-08-17T02:26:17.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f5f54ebf700 1 --2- 172.21.15.153:0/2242128261 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f5f3c0691c0 0x7f5f3c06b670 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5f480076e0 tx=0x7f5f48009840 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f791ea67700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79180aa670 0x7f7918098680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7fe85e7fc700 1 -- 172.21.15.153:0/2813226536 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe86001a400 con 0x7fe8700cad40 2024-08-17T02:26:17.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7fe874f7b700 1 -- 172.21.15.153:0/2813226536 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe8700645c0 con 0x7fe8700cad40 2024-08-17T02:26:17.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.217+0000 7fe85e7fc700 1 --2- 172.21.15.153:0/2813226536 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fe8500609b0 0x7fe850062e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7fe85e7fc700 1 -- 172.21.15.153:0/2813226536 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe86007c760 con 0x7fe8700cad40 2024-08-17T02:26:17.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7fe85e7fc700 1 --2- 172.21.15.153:0/2813226536 >> [v2:172.21.15.153:6800/24232,v1:172.21.15.153:6801/24232] conn(0x7fe850068b40 0x7fe85006af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7fe85e7fc700 1 -- 172.21.15.153:0/2813226536 --> [v2:172.21.15.153:6800/24232,v1:172.21.15.153:6801/24232] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe85006b600 con 0x7fe850068b40 2024-08-17T02:26:17.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7fe86dd9b700 1 --2- 172.21.15.153:0/2813226536 >> [v2:172.21.15.153:6800/24232,v1:172.21.15.153:6801/24232] conn(0x7fe850068b40 0x7fe85006af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7fe86e59c700 1 --2- 172.21.15.153:0/2813226536 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fe8500609b0 0x7fe850062e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f791ea67700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79180aed20 0x7f79180969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f5ec6ffd700 1 --2- 172.21.15.153:0/3207570274 >> [v2:172.21.15.153:6824/24236,v1:172.21.15.153:6825/24236] conn(0x7f5ecc068bc0 0x7f5ecc06afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f791ea67700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f791815d1f0 0x7f791814c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f791ea67700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791814c710 con 0x7f79180aed20 2024-08-17T02:26:17.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f791ea67700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791814c9f0 con 0x7f791815d1f0 2024-08-17T02:26:17.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f791ea67700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79180af260 con 0x7f79180aa670 2024-08-17T02:26:17.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f7917fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79180aed20 0x7f79180969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f791c803700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79180aa670 0x7f7918098680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f791c803700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79180aa670 0x7f7918098680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.153:34766/0 (socket says 172.21.15.153:34766) 2024-08-17T02:26:17.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f7917fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79180aed20 0x7f79180969f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57456/0 (socket says 172.21.15.153:57456) 2024-08-17T02:26:17.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f791c803700 1 -- 172.21.15.153:0/3312976001 learned_addr learned my addr 172.21.15.153:0/3312976001 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:17.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f5edf7fe700 1 --2- 172.21.15.153:0/3207570274 >> [v2:172.21.15.153:6824/24236,v1:172.21.15.153:6825/24236] conn(0x7f5ecc068bc0 0x7f5ecc06afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f75f2733700 1 Processor -- start 2024-08-17T02:26:17.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f5f4cff9700 1 -- 172.21.15.153:0/2242128261 <== osd.7 v2:172.21.15.174:6816/24455 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f5f3c073e90 con 0x7f5f3c0713d0 2024-08-17T02:26:17.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f75f2733700 1 -- start start 2024-08-17T02:26:17.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f791d004700 1 --2- 172.21.15.153:0/3312976001 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f791815d1f0 0x7f791814c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7fe86e59c700 1 --2- 172.21.15.153:0/2813226536 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fe8500609b0 0x7fe850062e60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe864006f00 tx=0x7fe864008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7fe86dd9b700 1 --2- 172.21.15.153:0/2813226536 >> [v2:172.21.15.153:6800/24232,v1:172.21.15.153:6801/24232] conn(0x7fe850068b40 0x7fe85006af50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f95bfd8f700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95b80ae5d0 0x7f95b8152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f95bfd8f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95b814f850 0x7f95b8151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f95bfd8f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b814fc20 0x7f95b80a9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f5edf7fe700 1 --2- 172.21.15.153:0/3207570274 >> [v2:172.21.15.153:6824/24236,v1:172.21.15.153:6825/24236] conn(0x7f5ecc068bc0 0x7f5ecc06afd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f95bfd8f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b80b1b90 con 0x7f95b814f850 2024-08-17T02:26:17.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f95bfd8f700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b8150c90 con 0x7f95b80ae5d0 2024-08-17T02:26:17.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f95bfd8f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b8150f70 con 0x7f95b814fc20 2024-08-17T02:26:17.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7fe85e7fc700 1 -- 172.21.15.153:0/2813226536 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe86004cc10 con 0x7fe8700cad40 2024-08-17T02:26:17.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f95be32c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b814fc20 0x7f95b80a9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f8283fff700 1 -- 172.21.15.153:0/3861222617 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8294026600 con 0x7f829c153e40 2024-08-17T02:26:17.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f8283fff700 1 -- 172.21.15.153:0/3861222617 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82940269c0 con 0x7f829c153e40 2024-08-17T02:26:17.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f82a2342700 1 -- 172.21.15.153:0/3861222617 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f829c0ac990 con 0x7f829c153e40 2024-08-17T02:26:17.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f82a2342700 1 -- 172.21.15.153:0/3861222617 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f829c0acf50 con 0x7f829c153e40 2024-08-17T02:26:17.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f95be32c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b814fc20 0x7f95b80a9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.153:34776/0 (socket says 172.21.15.153:34776) 2024-08-17T02:26:17.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f95be32c700 1 -- 172.21.15.153:0/835165603 learned_addr learned my addr 172.21.15.153:0/835165603 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:17.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7fd180ff9700 1 -- 172.21.15.153:0/3385792175 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd178005b30 con 0x7fd1840aa980 2024-08-17T02:26:17.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7fd180ff9700 1 -- 172.21.15.153:0/3385792175 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd178005cb0 con 0x7fd1840aa980 2024-08-17T02:26:17.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7fd18ae3f700 1 -- 172.21.15.153:0/3385792175 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd184142be0 con 0x7fd1840aa980 2024-08-17T02:26:17.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7fd180ff9700 1 -- 172.21.15.153:0/3385792175 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd178007320 con 0x7fd1840aa980 2024-08-17T02:26:17.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7fd18ae3f700 1 -- 172.21.15.153:0/3385792175 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1840cb900 con 0x7fd1840aa980 2024-08-17T02:26:17.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f75f2733700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75ec0a91f0 0x7f75ec171aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f75f2733700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75ec0ab0b0 0x7f75ec14ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f75f2733700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75ec154f50 0x7f75ec155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f75f2733700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec0afc20 con 0x7f75ec0ab0b0 2024-08-17T02:26:17.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f75f2733700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec0af730 con 0x7f75ec154f50 2024-08-17T02:26:17.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f75f2733700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec14f390 con 0x7f75ec0a91f0 2024-08-17T02:26:17.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7fe85e7fc700 1 -- 172.21.15.153:0/2813226536 <== osd.1 v2:172.21.15.153:6800/24232 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fe85006b600 con 0x7fe850068b40 2024-08-17T02:26:17.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f75f1f32700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75ec154f50 0x7f75ec155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f75f1f32700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75ec154f50 0x7f75ec155ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.153:49552/0 (socket says 172.21.15.153:49552) 2024-08-17T02:26:17.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f75f1f32700 1 -- 172.21.15.153:0/683184477 learned_addr learned my addr 172.21.15.153:0/683184477 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:17.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f82a2342700 1 -- 172.21.15.153:0/3861222617 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f829c0645c0 con 0x7f829c153e40 2024-08-17T02:26:17.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f791c803700 1 -- 172.21.15.153:0/3312976001 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f791815d1f0 msgr2=0x7f791814c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f791c803700 1 --2- 172.21.15.153:0/3312976001 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f791815d1f0 0x7f791814c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f791c803700 1 -- 172.21.15.153:0/3312976001 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79180aed20 msgr2=0x7f79180969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f791c803700 1 --2- 172.21.15.153:0/3312976001 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79180aed20 0x7f79180969f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f791c803700 1 -- 172.21.15.153:0/3312976001 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790c009420 con 0x7f79180aa670 2024-08-17T02:26:17.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f791c803700 1 --2- 172.21.15.153:0/3312976001 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79180aa670 0x7f7918098680 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7910009f10 tx=0x7f791000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f7914ff9700 1 -- 172.21.15.153:0/3312976001 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791000cc20 con 0x7f79180aa670 2024-08-17T02:26:17.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f7914ff9700 1 -- 172.21.15.153:0/3312976001 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791000f040 con 0x7f79180aa670 2024-08-17T02:26:17.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f7914ff9700 1 -- 172.21.15.153:0/3312976001 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7910014480 con 0x7f79180aa670 2024-08-17T02:26:17.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f791ea67700 1 -- 172.21.15.153:0/3312976001 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79180af540 con 0x7f79180aa670 2024-08-17T02:26:17.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f791ea67700 1 -- 172.21.15.153:0/3312976001 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7918099300 con 0x7f79180aa670 2024-08-17T02:26:17.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.225+0000 7f5ec6ffd700 1 -- 172.21.15.153:0/3207570274 --> [v2:172.21.15.153:6824/24236,v1:172.21.15.153:6825/24236] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5ecc06b680 con 0x7f5ecc068bc0 2024-08-17T02:26:17.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.225+0000 7f5ec6ffd700 1 -- 172.21.15.153:0/3207570274 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ed404c340 con 0x7f5ee00ac9b0 2024-08-17T02:26:17.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.225+0000 7f75f0f30700 1 --2- 172.21.15.153:0/683184477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75ec0ab0b0 0x7f75ec14ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f95bdb2b700 1 --2- 172.21.15.153:0/835165603 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95b80ae5d0 0x7f95b8152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f95be32c700 1 -- 172.21.15.153:0/835165603 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95b80ae5d0 msgr2=0x7f95b8152b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f95be32c700 1 --2- 172.21.15.153:0/835165603 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95b80ae5d0 0x7f95b8152b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f95be32c700 1 -- 172.21.15.153:0/835165603 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95b814f850 msgr2=0x7f95b8151d30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:26:17.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f95be32c700 1 --2- 172.21.15.153:0/835165603 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95b814f850 0x7f95b8151d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.221+0000 7f95be32c700 1 -- 172.21.15.153:0/835165603 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b0009a20 con 0x7f95b814fc20 2024-08-17T02:26:17.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.225+0000 7f75f0f30700 1 -- 172.21.15.153:0/683184477 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75ec0a91f0 msgr2=0x7f75ec171aa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:26:17.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.225+0000 7f75f0f30700 1 --2- 172.21.15.153:0/683184477 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75ec0a91f0 0x7f75ec171aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.225+0000 7f75f0f30700 1 -- 172.21.15.153:0/683184477 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75ec154f50 msgr2=0x7f75ec155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.225+0000 7f75f0f30700 1 --2- 172.21.15.153:0/683184477 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75ec154f50 0x7f75ec155ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.225+0000 7f75f0f30700 1 -- 172.21.15.153:0/683184477 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75dc00d8d0 con 0x7f75ec0ab0b0 2024-08-17T02:26:17.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.225+0000 7fd180ff9700 1 -- 172.21.15.153:0/3385792175 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd178007690 con 0x7fd1840aa980 2024-08-17T02:26:17.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.225+0000 7fd180ff9700 1 --2- 172.21.15.153:0/3385792175 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd170060930 0x7fd170062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.225+0000 7fd180ff9700 1 -- 172.21.15.153:0/3385792175 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd17807bfb0 con 0x7fd1840aa980 2024-08-17T02:26:17.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.225+0000 7fd183fff700 1 --2- 172.21.15.153:0/3385792175 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd170060930 0x7fd170062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.225+0000 7f5edeffd700 1 --2- 172.21.15.153:0/3207570274 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f5ecc0609b0 0x7f5ecc062e60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8009ab0 tx=0x7f5ed8017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.225+0000 7f7914ff9700 1 -- 172.21.15.153:0/3312976001 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7910014830 con 0x7f79180aa670 2024-08-17T02:26:17.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.225+0000 7f75f0f30700 1 --2- 172.21.15.153:0/683184477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75ec0ab0b0 0x7f75ec14ee50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f75dc019000 tx=0x7f75dc01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.225+0000 7f8283fff700 1 -- 172.21.15.153:0/3861222617 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f829401d420 con 0x7f829c153e40 2024-08-17T02:26:17.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.225+0000 7f8283fff700 1 --2- 172.21.15.153:0/3861222617 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8288060930 0x7f8288062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.225+0000 7f8283fff700 1 -- 172.21.15.153:0/3861222617 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f829407f0a0 con 0x7f829c153e40 2024-08-17T02:26:17.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.225+0000 7f829bfff700 1 --2- 172.21.15.153:0/3861222617 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8288060930 0x7f8288062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.225+0000 7f8283fff700 1 --2- 172.21.15.153:0/3861222617 >> [v2:172.21.15.153:6816/24234,v1:172.21.15.153:6817/24234] conn(0x7f82880689d0 0x7f828806ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.225+0000 7f95be32c700 1 --2- 172.21.15.153:0/835165603 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b814fc20 0x7f95b80a9d30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f95b00097c0 tx=0x7f95b0019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.225+0000 7f8283fff700 1 -- 172.21.15.153:0/3861222617 --> [v2:172.21.15.153:6816/24234,v1:172.21.15.153:6817/24234] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f828806b490 con 0x7f82880689d0 2024-08-17T02:26:17.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.225+0000 7f8283fff700 1 -- 172.21.15.153:0/3861222617 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8294081580 con 0x7f829c153e40 2024-08-17T02:26:17.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.225+0000 7f5ec6ffd700 1 -- 172.21.15.153:0/3207570274 <== osd.3 v2:172.21.15.153:6824/24236 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f5ecc06b680 con 0x7f5ecc068bc0 2024-08-17T02:26:17.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.225+0000 7f95b5ffb700 1 -- 172.21.15.153:0/835165603 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b0027470 con 0x7f95b814fc20 2024-08-17T02:26:17.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.225+0000 7f75e17fa700 1 -- 172.21.15.153:0/683184477 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75dc016900 con 0x7f75ec0ab0b0 2024-08-17T02:26:17.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.225+0000 7f75e17fa700 1 -- 172.21.15.153:0/683184477 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75dc016a80 con 0x7f75ec0ab0b0 2024-08-17T02:26:17.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.225+0000 7f75e17fa700 1 -- 172.21.15.153:0/683184477 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75dc016e40 con 0x7f75ec0ab0b0 2024-08-17T02:26:17.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.225+0000 7f75f2733700 1 -- 172.21.15.153:0/683184477 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75ec152a10 con 0x7f75ec0ab0b0 2024-08-17T02:26:17.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.225+0000 7f75f2733700 1 -- 172.21.15.153:0/683184477 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75ec0af940 con 0x7f75ec0ab0b0 2024-08-17T02:26:17.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.225+0000 7fd183fff700 1 --2- 172.21.15.153:0/3385792175 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd170060930 0x7fd170062de0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd17c00b580 tx=0x7fd17c019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.225+0000 7f829bfff700 1 --2- 172.21.15.153:0/3861222617 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8288060930 0x7f8288062de0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f828c000f80 tx=0x7f828c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.225+0000 7f7914ff9700 1 --2- 172.21.15.153:0/3312976001 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f79040609b0 0x7f7904062e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.225+0000 7f7917fff700 1 --2- 172.21.15.153:0/3312976001 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f79040609b0 0x7f7904062e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.225+0000 7f7914ff9700 1 -- 172.21.15.153:0/3312976001 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f791007d5b0 con 0x7f79180aa670 2024-08-17T02:26:17.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.225+0000 7f7917fff700 1 --2- 172.21.15.153:0/3312976001 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f79040609b0 0x7f7904062e60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f79180b0ec0 tx=0x7f7908007eb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.225+0000 7f95b5ffb700 1 -- 172.21.15.153:0/835165603 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b00275f0 con 0x7f95b814fc20 2024-08-17T02:26:17.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.225+0000 7f95b5ffb700 1 -- 172.21.15.153:0/835165603 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b00279b0 con 0x7f95b814fc20 2024-08-17T02:26:17.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.229+0000 7fd18ae3f700 1 --2- 172.21.15.153:0/3385792175 >> [v2:172.21.15.174:6824/24457,v1:172.21.15.174:6825/24457] conn(0x7fd1840c0ca0 0x7fd1840c1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.229+0000 7fd18ae3f700 1 -- 172.21.15.153:0/3385792175 --> [v2:172.21.15.174:6824/24457,v1:172.21.15.174:6825/24457] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd1840645c0 con 0x7fd1840c0ca0 2024-08-17T02:26:17.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.229+0000 7f829b7fe700 1 --2- 172.21.15.153:0/3861222617 >> [v2:172.21.15.153:6816/24234,v1:172.21.15.153:6817/24234] conn(0x7f82880689d0 0x7f828806ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.229+0000 7f791ea67700 1 --2- 172.21.15.153:0/3312976001 >> [v2:172.21.15.153:6805/24235,v1:172.21.15.153:6808/24235] conn(0x7f7918099550 0x7f79181383c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.229+0000 7f791ea67700 1 -- 172.21.15.153:0/3312976001 --> [v2:172.21.15.153:6805/24235,v1:172.21.15.153:6808/24235] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f79180645c0 con 0x7f7918099550 2024-08-17T02:26:17.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.229+0000 7f95bfd8f700 1 -- 172.21.15.153:0/835165603 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b8151250 con 0x7f95b814fc20 2024-08-17T02:26:17.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.229+0000 7f95bfd8f700 1 -- 172.21.15.153:0/835165603 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b8151810 con 0x7f95b814fc20 2024-08-17T02:26:17.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.229+0000 7fd1893dc700 1 --2- 172.21.15.153:0/3385792175 >> [v2:172.21.15.174:6824/24457,v1:172.21.15.174:6825/24457] conn(0x7fd1840c0ca0 0x7fd1840c1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.229+0000 7f75e17fa700 1 -- 172.21.15.153:0/683184477 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f75dc01e600 con 0x7f75ec0ab0b0 2024-08-17T02:26:17.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.229+0000 7f75e17fa700 1 --2- 172.21.15.153:0/683184477 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f75d0060860 0x7f75d0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.229+0000 7f75e17fa700 1 -- 172.21.15.153:0/683184477 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f75dc07cbd0 con 0x7f75ec0ab0b0 2024-08-17T02:26:17.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.229+0000 7f829b7fe700 1 --2- 172.21.15.153:0/3861222617 >> [v2:172.21.15.153:6816/24234,v1:172.21.15.153:6817/24234] conn(0x7f82880689d0 0x7f828806ade0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.229+0000 7f791d004700 1 --2- 172.21.15.153:0/3312976001 >> [v2:172.21.15.153:6805/24235,v1:172.21.15.153:6808/24235] conn(0x7f7918099550 0x7f79181383c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.229+0000 7fd1893dc700 1 --2- 172.21.15.153:0/3385792175 >> [v2:172.21.15.174:6824/24457,v1:172.21.15.174:6825/24457] conn(0x7fd1840c0ca0 0x7fd1840c1070 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.229+0000 7f95bfd8f700 1 -- 172.21.15.153:0/835165603 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f95b80645c0 con 0x7f95b814fc20 2024-08-17T02:26:17.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.229+0000 7f791d004700 1 --2- 172.21.15.153:0/3312976001 >> [v2:172.21.15.153:6805/24235,v1:172.21.15.153:6808/24235] conn(0x7f7918099550 0x7f79181383c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.229+0000 7f8283fff700 1 -- 172.21.15.153:0/3861222617 <== osd.0 v2:172.21.15.153:6816/24234 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f828806b490 con 0x7f82880689d0 2024-08-17T02:26:17.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.229+0000 7f7914ff9700 1 -- 172.21.15.153:0/3312976001 <== osd.2 v2:172.21.15.153:6805/24235 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f79180645c0 con 0x7f7918099550 2024-08-17T02:26:17.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.229+0000 7fd180ff9700 1 -- 172.21.15.153:0/3385792175 <== osd.5 v2:172.21.15.174:6824/24457 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fd1840645c0 con 0x7fd1840c0ca0 2024-08-17T02:26:17.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.229+0000 7f95b5ffb700 1 -- 172.21.15.153:0/835165603 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f95b0024070 con 0x7f95b814fc20 2024-08-17T02:26:17.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.229+0000 7f95b5ffb700 1 --2- 172.21.15.153:0/835165603 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f95a4060930 0x7f95a4062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.229+0000 7f95b5ffb700 1 -- 172.21.15.153:0/835165603 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f95b007f9e0 con 0x7f95b814fc20 2024-08-17T02:26:17.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.229+0000 7f95bdb2b700 1 --2- 172.21.15.153:0/835165603 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f95a4060930 0x7f95a4062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.229+0000 7f95b5ffb700 1 --2- 172.21.15.153:0/835165603 >> [v2:172.21.15.174:6800/24477,v1:172.21.15.174:6801/24477] conn(0x7f95a4068b40 0x7f95a406af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.229+0000 7f95b5ffb700 1 -- 172.21.15.153:0/835165603 --> [v2:172.21.15.174:6800/24477,v1:172.21.15.174:6801/24477] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f95a406b600 con 0x7f95a4068b40 2024-08-17T02:26:17.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.229+0000 7f95b5ffb700 1 -- 172.21.15.153:0/835165603 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95b007fdb0 con 0x7f95b814fc20 2024-08-17T02:26:17.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.233+0000 7f75f1731700 1 --2- 172.21.15.153:0/683184477 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f75d0060860 0x7f75d0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.233+0000 7f75f1731700 1 --2- 172.21.15.153:0/683184477 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f75d0060860 0x7f75d0062d10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f75e8009b10 tx=0x7f75e80091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.237+0000 7f75f2733700 1 --2- 172.21.15.153:0/683184477 >> [v2:172.21.15.174:6808/24456,v1:172.21.15.174:6809/24456] conn(0x7f75ec1560e0 0x7f75ec063060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.237+0000 7f75f2733700 1 -- 172.21.15.153:0/683184477 --> [v2:172.21.15.174:6808/24456,v1:172.21.15.174:6809/24456] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f75ec067780 con 0x7f75ec1560e0 2024-08-17T02:26:17.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.237+0000 7f75f1f32700 1 --2- 172.21.15.153:0/683184477 >> [v2:172.21.15.174:6808/24456,v1:172.21.15.174:6809/24456] conn(0x7f75ec1560e0 0x7f75ec063060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.237+0000 7f75f1f32700 1 --2- 172.21.15.153:0/683184477 >> [v2:172.21.15.174:6808/24456,v1:172.21.15.174:6809/24456] conn(0x7f75ec1560e0 0x7f75ec063060 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.237+0000 7f75e17fa700 1 -- 172.21.15.153:0/683184477 <== osd.4 v2:172.21.15.174:6808/24456 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f75ec067780 con 0x7f75ec1560e0 2024-08-17T02:26:17.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.241+0000 7f95bd32a700 1 --2- 172.21.15.153:0/835165603 >> [v2:172.21.15.174:6800/24477,v1:172.21.15.174:6801/24477] conn(0x7f95a4068b40 0x7f95a406af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.241+0000 7f95bdb2b700 1 --2- 172.21.15.153:0/835165603 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f95a4060930 0x7f95a4062de0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f95ac006fd0 tx=0x7f95ac00b4f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.241+0000 7f95bd32a700 1 --2- 172.21.15.153:0/835165603 >> [v2:172.21.15.174:6800/24477,v1:172.21.15.174:6801/24477] conn(0x7f95a4068b40 0x7f95a406af50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.241+0000 7f95b5ffb700 1 -- 172.21.15.153:0/835165603 <== osd.6 v2:172.21.15.174:6800/24477 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f95a406b600 con 0x7f95a4068b40 2024-08-17T02:26:17.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.245+0000 7f5f57123700 1 -- 172.21.15.153:0/2242128261 --> [v2:172.21.15.174:6816/24455,v1:172.21.15.174:6817/24455] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5f5006a080 con 0x7f5f3c0713d0 2024-08-17T02:26:17.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.245+0000 7f5f4cff9700 1 -- 172.21.15.153:0/2242128261 <== osd.7 v2:172.21.15.174:6816/24455 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5f5006a080 con 0x7f5f3c0713d0 2024-08-17T02:26:17.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.249+0000 7f5f367fc700 1 -- 172.21.15.153:0/2242128261 >> [v2:172.21.15.174:6816/24455,v1:172.21.15.174:6817/24455] conn(0x7f5f3c0713d0 msgr2=0x7f5f3c0737e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.249+0000 7f5f367fc700 1 --2- 172.21.15.153:0/2242128261 >> [v2:172.21.15.174:6816/24455,v1:172.21.15.174:6817/24455] conn(0x7f5f3c0713d0 0x7f5f3c0737e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.249+0000 7f5f367fc700 1 -- 172.21.15.153:0/2242128261 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f5f3c0691c0 msgr2=0x7f5f3c06b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.249+0000 7f5f367fc700 1 --2- 172.21.15.153:0/2242128261 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f5f3c0691c0 0x7f5f3c06b670 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5f480076e0 tx=0x7f5f48009840 comp rx=0 tx=0).stop 2024-08-17T02:26:17.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.249+0000 7f5f367fc700 1 -- 172.21.15.153:0/2242128261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f5015a620 msgr2=0x7f5f5014f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.249+0000 7f5f367fc700 1 --2- 172.21.15.153:0/2242128261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f5015a620 0x7f5f5014f9a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5f4400b5e0 tx=0x7f5f44009120 comp rx=0 tx=0).stop 2024-08-17T02:26:17.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.249+0000 7f5f556c0700 1 -- 172.21.15.153:0/2242128261 reap_dead start 2024-08-17T02:26:17.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.249+0000 7f5f367fc700 1 -- 172.21.15.153:0/2242128261 shutdown_connections 2024-08-17T02:26:17.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.249+0000 7f5f367fc700 1 -- 172.21.15.153:0/2242128261 >> 172.21.15.153:0/2242128261 conn(0x7f5f50067810 msgr2=0x7f5f5006ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.249+0000 7f5f367fc700 1 -- 172.21.15.153:0/2242128261 shutdown_connections 2024-08-17T02:26:17.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.249+0000 7f5f367fc700 1 -- 172.21.15.153:0/2242128261 wait complete. 2024-08-17T02:26:17.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.249+0000 7fe874f7b700 1 -- 172.21.15.153:0/2813226536 --> [v2:172.21.15.153:6800/24232,v1:172.21.15.153:6801/24232] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe870069910 con 0x7fe850068b40 2024-08-17T02:26:17.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.249+0000 7fe85e7fc700 1 -- 172.21.15.153:0/2813226536 <== osd.1 v2:172.21.15.153:6800/24232 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe870069910 con 0x7fe850068b40 2024-08-17T02:26:17.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.249+0000 7fe84ffff700 1 -- 172.21.15.153:0/2813226536 >> [v2:172.21.15.153:6800/24232,v1:172.21.15.153:6801/24232] conn(0x7fe850068b40 msgr2=0x7fe85006af50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.249+0000 7fe84ffff700 1 --2- 172.21.15.153:0/2813226536 >> [v2:172.21.15.153:6800/24232,v1:172.21.15.153:6801/24232] conn(0x7fe850068b40 0x7fe85006af50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.249+0000 7f5ee55e1700 1 -- 172.21.15.153:0/3207570274 --> [v2:172.21.15.153:6824/24236,v1:172.21.15.153:6825/24236] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5ee00645c0 con 0x7f5ecc068bc0 2024-08-17T02:26:17.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.249+0000 7f5ec6ffd700 1 -- 172.21.15.153:0/3207570274 <== osd.3 v2:172.21.15.153:6824/24236 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5ee00645c0 con 0x7f5ecc068bc0 2024-08-17T02:26:17.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.253+0000 7fe84ffff700 1 -- 172.21.15.153:0/2813226536 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fe8500609b0 msgr2=0x7fe850062e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.253+0000 7fe84ffff700 1 --2- 172.21.15.153:0/2813226536 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fe8500609b0 0x7fe850062e60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe864006f00 tx=0x7fe864008040 comp rx=0 tx=0).stop 2024-08-17T02:26:17.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.253+0000 7fe84ffff700 1 -- 172.21.15.153:0/2813226536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8700cad40 msgr2=0x7fe8700aed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.253+0000 7fe84ffff700 1 --2- 172.21.15.153:0/2813226536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8700cad40 0x7fe8700aed20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe86000b4e0 tx=0x7fe860006f90 comp rx=0 tx=0).stop 2024-08-17T02:26:17.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.253+0000 7fe86ed9d700 1 -- 172.21.15.153:0/2813226536 reap_dead start 2024-08-17T02:26:17.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.253+0000 7fe84ffff700 1 -- 172.21.15.153:0/2813226536 shutdown_connections 2024-08-17T02:26:17.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.253+0000 7fe84ffff700 1 -- 172.21.15.153:0/2813226536 >> 172.21.15.153:0/2813226536 conn(0x7fe870067810 msgr2=0x7fe87015d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.253+0000 7fe84ffff700 1 -- 172.21.15.153:0/2813226536 shutdown_connections 2024-08-17T02:26:17.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.253+0000 7fe84ffff700 1 -- 172.21.15.153:0/2813226536 wait complete. 2024-08-17T02:26:17.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.253+0000 7f791ea67700 1 -- 172.21.15.153:0/3312976001 --> [v2:172.21.15.153:6805/24235,v1:172.21.15.153:6808/24235] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f79180ab290 con 0x7f7918099550 2024-08-17T02:26:17.299 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.253+0000 7f5ee55e1700 1 -- 172.21.15.153:0/3207570274 >> [v2:172.21.15.153:6824/24236,v1:172.21.15.153:6825/24236] conn(0x7f5ecc068bc0 msgr2=0x7f5ecc06afd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.299 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.253+0000 7f5ee55e1700 1 --2- 172.21.15.153:0/3207570274 >> [v2:172.21.15.153:6824/24236,v1:172.21.15.153:6825/24236] conn(0x7f5ecc068bc0 0x7f5ecc06afd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.299 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.253+0000 7f7914ff9700 1 -- 172.21.15.153:0/3312976001 <== osd.2 v2:172.21.15.153:6805/24235 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f79180ab290 con 0x7f7918099550 2024-08-17T02:26:17.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.253+0000 7f78fe7fc700 1 -- 172.21.15.153:0/3312976001 >> [v2:172.21.15.153:6805/24235,v1:172.21.15.153:6808/24235] conn(0x7f7918099550 msgr2=0x7f79181383c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.253+0000 7f78fe7fc700 1 --2- 172.21.15.153:0/3312976001 >> [v2:172.21.15.153:6805/24235,v1:172.21.15.153:6808/24235] conn(0x7f7918099550 0x7f79181383c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.253+0000 7f82a2342700 1 -- 172.21.15.153:0/3861222617 --> [v2:172.21.15.153:6816/24234,v1:172.21.15.153:6817/24234] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f829c0acb50 con 0x7f82880689d0 2024-08-17T02:26:17.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.253+0000 7f8283fff700 1 -- 172.21.15.153:0/3861222617 <== osd.0 v2:172.21.15.153:6816/24234 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8290001270 con 0x7f82880689d0 2024-08-17T02:26:17.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.253+0000 7f82a2342700 1 -- 172.21.15.153:0/3861222617 >> [v2:172.21.15.153:6816/24234,v1:172.21.15.153:6817/24234] conn(0x7f82880689d0 msgr2=0x7f828806ade0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.253+0000 7f82a2342700 1 --2- 172.21.15.153:0/3861222617 >> [v2:172.21.15.153:6816/24234,v1:172.21.15.153:6817/24234] conn(0x7f82880689d0 0x7f828806ade0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.253+0000 7f82a2342700 1 -- 172.21.15.153:0/3861222617 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8288060930 msgr2=0x7f8288062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.253+0000 7f82a2342700 1 --2- 172.21.15.153:0/3861222617 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8288060930 0x7f8288062de0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f828c000f80 tx=0x7f828c009040 comp rx=0 tx=0).stop 2024-08-17T02:26:17.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.253+0000 7f82a2342700 1 -- 172.21.15.153:0/3861222617 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f829c153e40 msgr2=0x7f829c14a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.253+0000 7f82a2342700 1 --2- 172.21.15.153:0/3861222617 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f829c153e40 0x7f829c14a170 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8294003000 tx=0x7f8294018000 comp rx=0 tx=0).stop 2024-08-17T02:26:17.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.253+0000 7f82a08df700 1 -- 172.21.15.153:0/3861222617 reap_dead start 2024-08-17T02:26:17.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.253+0000 7f82a2342700 1 -- 172.21.15.153:0/3861222617 shutdown_connections 2024-08-17T02:26:17.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.253+0000 7f82a2342700 1 -- 172.21.15.153:0/3861222617 >> 172.21.15.153:0/3861222617 conn(0x7f829c067810 msgr2=0x7f829c155850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.253+0000 7f82a2342700 1 -- 172.21.15.153:0/3861222617 shutdown_connections 2024-08-17T02:26:17.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.253+0000 7f82a2342700 1 -- 172.21.15.153:0/3861222617 wait complete. 2024-08-17T02:26:17.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.257+0000 7fd18ae3f700 1 -- 172.21.15.153:0/3385792175 --> [v2:172.21.15.174:6824/24457,v1:172.21.15.174:6825/24457] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd1840ab250 con 0x7fd1840c0ca0 2024-08-17T02:26:17.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.257+0000 7fd180ff9700 1 -- 172.21.15.153:0/3385792175 <== osd.5 v2:172.21.15.174:6824/24457 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd1840ab250 con 0x7fd1840c0ca0 2024-08-17T02:26:17.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.257+0000 7fd18ae3f700 1 -- 172.21.15.153:0/3385792175 >> [v2:172.21.15.174:6824/24457,v1:172.21.15.174:6825/24457] conn(0x7fd1840c0ca0 msgr2=0x7fd1840c1070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.257+0000 7fd18ae3f700 1 --2- 172.21.15.153:0/3385792175 >> [v2:172.21.15.174:6824/24457,v1:172.21.15.174:6825/24457] conn(0x7fd1840c0ca0 0x7fd1840c1070 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.257+0000 7fd18ae3f700 1 -- 172.21.15.153:0/3385792175 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd170060930 msgr2=0x7fd170062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.257+0000 7fd18ae3f700 1 --2- 172.21.15.153:0/3385792175 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd170060930 0x7fd170062de0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd17c00b580 tx=0x7fd17c019000 comp rx=0 tx=0).stop 2024-08-17T02:26:17.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.257+0000 7fd18ae3f700 1 -- 172.21.15.153:0/3385792175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1840aa980 msgr2=0x7fd1840c1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.257+0000 7fd18ae3f700 1 --2- 172.21.15.153:0/3385792175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1840aa980 0x7fd1840c1f10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd17800c560 tx=0x7fd178007f60 comp rx=0 tx=0).stop 2024-08-17T02:26:17.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.257+0000 7fd1893dc700 1 -- 172.21.15.153:0/3385792175 reap_dead start 2024-08-17T02:26:17.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.257+0000 7fd18ae3f700 1 -- 172.21.15.153:0/3385792175 shutdown_connections 2024-08-17T02:26:17.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.257+0000 7fd18ae3f700 1 -- 172.21.15.153:0/3385792175 >> 172.21.15.153:0/3385792175 conn(0x7fd184068300 msgr2=0x7fd1840b0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.257+0000 7fd18ae3f700 1 -- 172.21.15.153:0/3385792175 shutdown_connections 2024-08-17T02:26:17.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.257+0000 7fd18ae3f700 1 -- 172.21.15.153:0/3385792175 wait complete. 2024-08-17T02:26:17.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.261+0000 7f5ee55e1700 1 -- 172.21.15.153:0/3207570274 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f5ecc0609b0 msgr2=0x7f5ecc062e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.261+0000 7f5ee55e1700 1 --2- 172.21.15.153:0/3207570274 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f5ecc0609b0 0x7f5ecc062e60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8009ab0 tx=0x7f5ed8017000 comp rx=0 tx=0).stop 2024-08-17T02:26:17.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.261+0000 7f5ee55e1700 1 -- 172.21.15.153:0/3207570274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ee00ac9b0 msgr2=0x7f5ee00a9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.261+0000 7f5ee55e1700 1 --2- 172.21.15.153:0/3207570274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ee00ac9b0 0x7f5ee00a9b40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5ed400b600 tx=0x7f5ed40091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.261+0000 7f5edf7fe700 1 -- 172.21.15.153:0/3207570274 reap_dead start 2024-08-17T02:26:17.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.265+0000 7f75f2733700 1 -- 172.21.15.153:0/683184477 --> [v2:172.21.15.174:6808/24456,v1:172.21.15.174:6809/24456] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f75ec0a8fd0 con 0x7f75ec1560e0 2024-08-17T02:26:17.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.265+0000 7f78fe7fc700 1 -- 172.21.15.153:0/3312976001 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f79040609b0 msgr2=0x7f7904062e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.265+0000 7f78fe7fc700 1 --2- 172.21.15.153:0/3312976001 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f79040609b0 0x7f7904062e60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f79180b0ec0 tx=0x7f7908007eb0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.265+0000 7f5ee55e1700 1 -- 172.21.15.153:0/3207570274 shutdown_connections 2024-08-17T02:26:17.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.265+0000 7f5ee55e1700 1 -- 172.21.15.153:0/3207570274 >> 172.21.15.153:0/3207570274 conn(0x7f5ee0068300 msgr2=0x7f5ee006e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.265+0000 7f78fe7fc700 1 -- 172.21.15.153:0/3312976001 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79180aa670 msgr2=0x7f7918098680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.265+0000 7f78fe7fc700 1 --2- 172.21.15.153:0/3312976001 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79180aa670 0x7f7918098680 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7910009f10 tx=0x7f791000b040 comp rx=0 tx=0).stop 2024-08-17T02:26:17.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.265+0000 7f791d004700 1 -- 172.21.15.153:0/3312976001 reap_dead start 2024-08-17T02:26:17.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.265+0000 7f78fe7fc700 1 -- 172.21.15.153:0/3312976001 shutdown_connections 2024-08-17T02:26:17.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.265+0000 7f78fe7fc700 1 -- 172.21.15.153:0/3312976001 >> 172.21.15.153:0/3312976001 conn(0x7f7918068300 msgr2=0x7f79180a8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.265+0000 7f5ee55e1700 1 -- 172.21.15.153:0/3207570274 shutdown_connections 2024-08-17T02:26:17.308 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.265+0000 7f5ee55e1700 1 -- 172.21.15.153:0/3207570274 wait complete. 2024-08-17T02:26:17.308 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.265+0000 7f78fe7fc700 1 -- 172.21.15.153:0/3312976001 shutdown_connections 2024-08-17T02:26:17.308 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.265+0000 7f78fe7fc700 1 -- 172.21.15.153:0/3312976001 wait complete. 2024-08-17T02:26:17.308 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.265+0000 7f75e17fa700 1 -- 172.21.15.153:0/683184477 <== osd.4 v2:172.21.15.174:6808/24456 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f75ec0a8fd0 con 0x7f75ec1560e0 2024-08-17T02:26:17.309 INFO:teuthology.orchestra.run.smithi153.stdout:64424509447 2024-08-17T02:26:17.310 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-17T02:26:17.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.269+0000 7f75f2733700 1 -- 172.21.15.153:0/683184477 >> [v2:172.21.15.174:6808/24456,v1:172.21.15.174:6809/24456] conn(0x7f75ec1560e0 msgr2=0x7f75ec063060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.269+0000 7f75f2733700 1 --2- 172.21.15.153:0/683184477 >> [v2:172.21.15.174:6808/24456,v1:172.21.15.174:6809/24456] conn(0x7f75ec1560e0 0x7f75ec063060 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.269+0000 7f75f2733700 1 -- 172.21.15.153:0/683184477 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f75d0060860 msgr2=0x7f75d0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.269+0000 7f75f2733700 1 --2- 172.21.15.153:0/683184477 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f75d0060860 0x7f75d0062d10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f75e8009b10 tx=0x7f75e80091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.269+0000 7f75f2733700 1 -- 172.21.15.153:0/683184477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75ec0ab0b0 msgr2=0x7f75ec14ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.269+0000 7f75f2733700 1 --2- 172.21.15.153:0/683184477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75ec0ab0b0 0x7f75ec14ee50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f75dc019000 tx=0x7f75dc01c000 comp rx=0 tx=0).stop 2024-08-17T02:26:17.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.269+0000 7f75f1f32700 1 -- 172.21.15.153:0/683184477 reap_dead start 2024-08-17T02:26:17.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.269+0000 7f75f2733700 1 -- 172.21.15.153:0/683184477 shutdown_connections 2024-08-17T02:26:17.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.269+0000 7f75f2733700 1 -- 172.21.15.153:0/683184477 >> 172.21.15.153:0/683184477 conn(0x7f75ec066e00 msgr2=0x7f75ec0aa270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.311 INFO:teuthology.orchestra.run.smithi153.stdout:64424509446 2024-08-17T02:26:17.312 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-17T02:26:17.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.273+0000 7f75f2733700 1 -- 172.21.15.153:0/683184477 shutdown_connections 2024-08-17T02:26:17.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.273+0000 7f75f2733700 1 -- 172.21.15.153:0/683184477 wait complete. 2024-08-17T02:26:17.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.273+0000 7f95bfd8f700 1 -- 172.21.15.153:0/835165603 --> [v2:172.21.15.174:6800/24477,v1:172.21.15.174:6801/24477] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f95b81510b0 con 0x7f95a4068b40 2024-08-17T02:26:17.313 INFO:teuthology.orchestra.run.smithi153.stdout:60129542151 2024-08-17T02:26:17.314 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-17T02:26:17.314 INFO:teuthology.orchestra.run.smithi153.stdout:64424509446 2024-08-17T02:26:17.315 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-17T02:26:17.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.277+0000 7f95b5ffb700 1 -- 172.21.15.153:0/835165603 <== osd.6 v2:172.21.15.174:6800/24477 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f95b81510b0 con 0x7f95a4068b40 2024-08-17T02:26:17.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.277+0000 7f95bfd8f700 1 -- 172.21.15.153:0/835165603 >> [v2:172.21.15.174:6800/24477,v1:172.21.15.174:6801/24477] conn(0x7f95a4068b40 msgr2=0x7f95a406af50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.277+0000 7f95bfd8f700 1 --2- 172.21.15.153:0/835165603 >> [v2:172.21.15.174:6800/24477,v1:172.21.15.174:6801/24477] conn(0x7f95a4068b40 0x7f95a406af50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.277+0000 7f95bfd8f700 1 -- 172.21.15.153:0/835165603 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f95a4060930 msgr2=0x7f95a4062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.277+0000 7f95bfd8f700 1 --2- 172.21.15.153:0/835165603 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f95a4060930 0x7f95a4062de0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f95ac006fd0 tx=0x7f95ac00b4f0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.277+0000 7f95bfd8f700 1 -- 172.21.15.153:0/835165603 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b814fc20 msgr2=0x7f95b80a9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.277+0000 7f95bfd8f700 1 --2- 172.21.15.153:0/835165603 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b814fc20 0x7f95b80a9d30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f95b00097c0 tx=0x7f95b0019000 comp rx=0 tx=0).stop 2024-08-17T02:26:17.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.277+0000 7f95be32c700 1 -- 172.21.15.153:0/835165603 reap_dead start 2024-08-17T02:26:17.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.277+0000 7f95bfd8f700 1 -- 172.21.15.153:0/835165603 shutdown_connections 2024-08-17T02:26:17.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.277+0000 7f95bfd8f700 1 -- 172.21.15.153:0/835165603 >> 172.21.15.153:0/835165603 conn(0x7f95b8068300 msgr2=0x7f95b8154490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.277+0000 7f95bfd8f700 1 -- 172.21.15.153:0/835165603 shutdown_connections 2024-08-17T02:26:17.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.277+0000 7f95bfd8f700 1 -- 172.21.15.153:0/835165603 wait complete. 2024-08-17T02:26:17.317 INFO:teuthology.orchestra.run.smithi153.stdout:64424509447 2024-08-17T02:26:17.318 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-17T02:26:17.319 INFO:teuthology.orchestra.run.smithi153.stdout:60129542151 2024-08-17T02:26:17.319 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-17T02:26:17.320 INFO:teuthology.orchestra.run.smithi153.stdout:64424509448 2024-08-17T02:26:17.320 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-17T02:26:17.321 INFO:teuthology.orchestra.run.smithi153.stdout:64424509447 2024-08-17T02:26:17.321 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-17T02:26:17.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.493+0000 7f07c9a13700 1 Processor -- start 2024-08-17T02:26:17.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.493+0000 7f07c9a13700 1 -- start start 2024-08-17T02:26:17.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.493+0000 7f30a56b0700 1 Processor -- start 2024-08-17T02:26:17.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.493+0000 7f566c223700 1 Processor -- start 2024-08-17T02:26:17.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.493+0000 7f30a56b0700 1 -- start start 2024-08-17T02:26:17.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.493+0000 7f9fbe421700 1 Processor -- start 2024-08-17T02:26:17.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.493+0000 7f9fbe421700 1 -- start start 2024-08-17T02:26:17.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.493+0000 7f07c9a13700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07c40aae80 0x7f07c406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.493+0000 7f07c9a13700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f07c406e850 0x7f07c415e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.493+0000 7f07c9a13700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07c406e3c0 con 0x7f07c40ab250 2024-08-17T02:26:17.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.493+0000 7f07c9a13700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07c406d7b0 con 0x7f07c406e850 2024-08-17T02:26:17.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.493+0000 7f07c9a13700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c406da90 con 0x7f07c40aae80 2024-08-17T02:26:17.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.493+0000 7f07c9212700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f07c406e850 0x7f07c415e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.493+0000 7f07c9212700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f07c406e850 0x7f07c415e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57484/0 (socket says 172.21.15.153:57484) 2024-08-17T02:26:17.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.493+0000 7f07c9212700 1 -- 172.21.15.153:0/786044629 learned_addr learned my addr 172.21.15.153:0/786044629 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:17.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.493+0000 7f566c223700 1 -- start start 2024-08-17T02:26:17.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f566c223700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f566413b630 0x7f56640b1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f566c223700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f566413bf10 0x7f5664158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f566c223700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56640b1950 0x7f56641592f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f566c223700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f566413cf90 con 0x7f566413bf10 2024-08-17T02:26:17.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f566c223700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f566413c380 con 0x7f566413b630 2024-08-17T02:26:17.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f566c223700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f566413c660 con 0x7f56640b1950 2024-08-17T02:26:17.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f9fbe421700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9fb80adf10 0x7f9fb80ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f9fbe421700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fb80cb450 0x7f9fb806e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f9fbe421700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fb80cb870 con 0x7f9fb806e470 2024-08-17T02:26:17.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f9fbe421700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fb8158290 con 0x7f9fb80adf10 2024-08-17T02:26:17.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f9fbe421700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb81610c0 con 0x7f9fb80cb450 2024-08-17T02:26:17.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f30a56b0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f30a00cb450 0x7f30a006e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f30a56b0700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30a00cb870 con 0x7f30a006e470 2024-08-17T02:26:17.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f30a56b0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30a01610c0 con 0x7f30a00adf10 2024-08-17T02:26:17.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f30a56b0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30a0158290 con 0x7f30a00cb450 2024-08-17T02:26:17.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f566a7c0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56640b1950 0x7f56641592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f07c8a11700 1 --2- 172.21.15.153:0/786044629 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07c40aae80 0x7f07c406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f07c9212700 1 -- 172.21.15.153:0/786044629 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07c40aae80 msgr2=0x7f07c406d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:17.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f07c9212700 1 --2- 172.21.15.153:0/786044629 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07c40aae80 0x7f07c406d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f07c9212700 1 -- 172.21.15.153:0/786044629 >> v1:172.21.15.153:6789/0 conn(0x7f07c40ab250 legacy=0x7f07c4161d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f07c9212700 1 -- 172.21.15.153:0/786044629 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c406dd70 con 0x7f07c406e850 2024-08-17T02:26:17.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f566a7c0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56640b1950 0x7f56641592f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.153:34798/0 (socket says 172.21.15.153:34798) 2024-08-17T02:26:17.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f566a7c0700 1 -- 172.21.15.153:0/1133889785 learned_addr learned my addr 172.21.15.153:0/1133889785 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:17.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f5669fbf700 1 --2- 172.21.15.153:0/1133889785 >> v2:172.21.15.174:3300/0 conn(0x7f566413b630 0x7f56640b1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f56697be700 1 --2- 172.21.15.153:0/1133889785 >> v2:172.21.15.153:3300/0 conn(0x7f566413bf10 0x7f5664158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f9fb7fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9fb80adf10 0x7f9fb80ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f9fb7fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9fb80adf10 0x7f9fb80ae2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57488/0 (socket says 172.21.15.153:57488) 2024-08-17T02:26:17.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f9fb7fff700 1 -- 172.21.15.153:0/910353853 learned_addr learned my addr 172.21.15.153:0/910353853 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:17.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f309effd700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f30a00adf10 0x7f30a00ae2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.153:59992/0 (socket says 172.21.15.153:59992) 2024-08-17T02:26:17.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f309effd700 1 -- 172.21.15.153:0/1593444826 learned_addr learned my addr 172.21.15.153:0/1593444826 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:17.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f07c9212700 1 --2- 172.21.15.153:0/786044629 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07c406e850 0x7f07c415e170 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f07bc009f20 tx=0x7f07bc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeda200f2977b1e1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f9fb7fff700 1 -- 172.21.15.153:0/910353853 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fb80cb450 msgr2=0x7f9fb806e910 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:26:17.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f9fb7fff700 1 --2- 172.21.15.153:0/910353853 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fb80cb450 0x7f9fb806e910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f9fb7fff700 1 -- 172.21.15.153:0/910353853 >> v1:172.21.15.174:6789/0 conn(0x7f9fb806e470 legacy=0x7f9fb80cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f9fb7fff700 1 -- 172.21.15.153:0/910353853 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb80ae820 con 0x7f9fb80adf10 2024-08-17T02:26:17.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f56697be700 1 -- 172.21.15.153:0/1133889785 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56640b1950 msgr2=0x7f56641592f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:17.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f56697be700 1 --2- 172.21.15.153:0/1133889785 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56640b1950 0x7f56641592f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f56697be700 1 -- 172.21.15.153:0/1133889785 >> v2:172.21.15.174:3300/0 conn(0x7f566413b630 msgr2=0x7f56640b1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:17.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f56697be700 1 --2- 172.21.15.153:0/1133889785 >> v2:172.21.15.174:3300/0 conn(0x7f566413b630 0x7f56640b1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f56697be700 1 -- 172.21.15.153:0/1133889785 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566413c940 con 0x7f566413bf10 2024-08-17T02:26:17.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f7ba2f75700 1 Processor -- start 2024-08-17T02:26:17.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f7ba2f75700 1 -- start start 2024-08-17T02:26:17.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f309f7fe700 1 --2- 172.21.15.153:0/1593444826 >> v2:172.21.15.174:3300/0 conn(0x7f30a00cb450 0x7f30a006e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f07c37fe700 1 -- 172.21.15.153:0/786044629 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07bc00e070 con 0x7f07c406e850 2024-08-17T02:26:17.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f07c37fe700 1 -- 172.21.15.153:0/786044629 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07bc00b9d0 con 0x7f07c406e850 2024-08-17T02:26:17.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f07c37fe700 1 -- 172.21.15.153:0/786044629 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07bc0092e0 con 0x7f07c406e850 2024-08-17T02:26:17.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f309dffb700 1 -- 172.21.15.153:0/1593444826 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2515853177 0 0) 0x7f30a00cb870 con 0x7f30a006e470 2024-08-17T02:26:17.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f309dffb700 1 -- 172.21.15.153:0/1593444826 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3088003570 con 0x7f30a006e470 2024-08-17T02:26:17.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f309dffb700 1 -- 172.21.15.153:0/1593444826 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2096601269 0 0) 0x7f30a01610c0 con 0x7f30a00adf10 2024-08-17T02:26:17.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f309dffb700 1 -- 172.21.15.153:0/1593444826 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30a00cb870 con 0x7f30a00adf10 2024-08-17T02:26:17.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f9fb7fff700 1 --2- 172.21.15.153:0/910353853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9fb80adf10 0x7f9fb80ae2e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0009f20 tx=0x7f9fb0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a720508fd8937099 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f56697be700 1 --2- 172.21.15.153:0/1133889785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f566413bf10 0x7f5664158db0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f566406c070 tx=0x7f56600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b6a00892aff65f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f309f7fe700 1 -- 172.21.15.153:0/1593444826 >> v1:172.21.15.174:6789/0 conn(0x7f30a00adf10 legacy=0x7f30a00ae2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f309f7fe700 1 -- 172.21.15.153:0/1593444826 >> v1:172.21.15.153:6789/0 conn(0x7f30a006e470 legacy=0x7f30a00cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f309f7fe700 1 -- 172.21.15.153:0/1593444826 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a015dff0 con 0x7f30a00cb450 2024-08-17T02:26:17.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f5668fbd700 1 -- 172.21.15.153:0/1133889785 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5660011630 con 0x7f566413bf10 2024-08-17T02:26:17.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f5668fbd700 1 -- 172.21.15.153:0/1133889785 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56600117b0 con 0x7f566413bf10 2024-08-17T02:26:17.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f5668fbd700 1 -- 172.21.15.153:0/1133889785 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5660011b70 con 0x7f566413bf10 2024-08-17T02:26:17.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f309f7fe700 1 --2- 172.21.15.153:0/1593444826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30a00cb450 0x7f30a006e910 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f30900098e0 tx=0x7f30900091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9449af4d9203b88d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f9fb6ffd700 1 -- 172.21.15.153:0/910353853 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb000e070 con 0x7f9fb80adf10 2024-08-17T02:26:17.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f9fb6ffd700 1 -- 172.21.15.153:0/910353853 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb000ba80 con 0x7f9fb80adf10 2024-08-17T02:26:17.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f9fb6ffd700 1 -- 172.21.15.153:0/910353853 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb00092e0 con 0x7f9fb80adf10 2024-08-17T02:26:17.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f07c9a13700 1 -- 172.21.15.153:0/786044629 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07c406e850 msgr2=0x7f07c415e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f07c9a13700 1 --2- 172.21.15.153:0/786044629 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07c406e850 0x7f07c415e170 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f07bc009f20 tx=0x7f07bc009840 comp rx=0 tx=0).stop 2024-08-17T02:26:17.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f6d89606700 1 Processor -- start 2024-08-17T02:26:17.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f7ba2f75700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7b9c06df10 0x7f7b9c165ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f7ba2f75700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7b9c06e2e0 0x7f7b9c0b1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f7ba2f75700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b9c169880 0x7f7b9c169cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f7ba2f75700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b9c0af2d0 con 0x7f7b9c06e2e0 2024-08-17T02:26:17.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f7ba2f75700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b9c166420 con 0x7f7b9c06df10 2024-08-17T02:26:17.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f7ba2f75700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c1666d0 con 0x7f7b9c169880 2024-08-17T02:26:17.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f7ba1772700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7b9c06e2e0 0x7f7b9c0b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f07c9a13700 1 -- 172.21.15.153:0/786044629 shutdown_connections 2024-08-17T02:26:17.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f07c9a13700 1 --2- 172.21.15.153:0/786044629 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07c406e850 0x7f07c415e170 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f07c9a13700 1 --2- 172.21.15.153:0/786044629 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07c40aae80 0x7f07c406d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f07c9a13700 1 -- 172.21.15.153:0/786044629 >> 172.21.15.153:0/786044629 conn(0x7f07c4066e00 msgr2=0x7f07c4067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f7ba1772700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7b9c06e2e0 0x7f7b9c0b1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57502/0 (socket says 172.21.15.153:57502) 2024-08-17T02:26:17.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f7ba1772700 1 -- 172.21.15.153:0/367511193 learned_addr learned my addr 172.21.15.153:0/367511193 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:17.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f7ba2774700 1 --2- 172.21.15.153:0/367511193 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b9c169880 0x7f7b9c169cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f7ba1f73700 1 --2- 172.21.15.153:0/367511193 >> v2:172.21.15.174:3300/0 conn(0x7f7b9c06df10 0x7f7b9c165ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f9fbe421700 1 -- 172.21.15.153:0/910353853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9fb80adf10 msgr2=0x7f9fb80ae2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f9fbe421700 1 --2- 172.21.15.153:0/910353853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9fb80adf10 0x7f9fb80ae2e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0009f20 tx=0x7f9fb0009840 comp rx=0 tx=0).stop 2024-08-17T02:26:17.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f9fbe421700 1 -- 172.21.15.153:0/910353853 shutdown_connections 2024-08-17T02:26:17.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f9fbe421700 1 --2- 172.21.15.153:0/910353853 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fb80cb450 0x7f9fb806e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f9fbe421700 1 --2- 172.21.15.153:0/910353853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9fb80adf10 0x7f9fb80ae2e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f9fbe421700 1 -- 172.21.15.153:0/910353853 >> 172.21.15.153:0/910353853 conn(0x7f9fb8067810 msgr2=0x7f9fb8067c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f566c223700 1 -- 172.21.15.153:0/1133889785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f566413bf10 msgr2=0x7f5664158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f566c223700 1 --2- 172.21.15.153:0/1133889785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f566413bf10 0x7f5664158db0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f566406c070 tx=0x7f56600091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f309dffb700 1 -- 172.21.15.153:0/1593444826 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30980017f0 con 0x7f30a00cb450 2024-08-17T02:26:17.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f309dffb700 1 -- 172.21.15.153:0/1593444826 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3090011420 con 0x7f30a00cb450 2024-08-17T02:26:17.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f9fbe421700 1 -- 172.21.15.153:0/910353853 shutdown_connections 2024-08-17T02:26:17.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f566c223700 1 -- 172.21.15.153:0/1133889785 shutdown_connections 2024-08-17T02:26:17.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f566c223700 1 --2- 172.21.15.153:0/1133889785 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56640b1950 0x7f56641592f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f566c223700 1 --2- 172.21.15.153:0/1133889785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f566413bf10 0x7f5664158db0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f566c223700 1 --2- 172.21.15.153:0/1133889785 >> v2:172.21.15.174:3300/0 conn(0x7f566413b630 0x7f56640b1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f566c223700 1 -- 172.21.15.153:0/1133889785 >> 172.21.15.153:0/1133889785 conn(0x7f56640678d0 msgr2=0x7f5664067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f7ba1772700 1 -- 172.21.15.153:0/367511193 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b9c169880 msgr2=0x7f7b9c169cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:17.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f7ba1772700 1 --2- 172.21.15.153:0/367511193 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b9c169880 0x7f7b9c169cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f7ba1772700 1 -- 172.21.15.153:0/367511193 >> v2:172.21.15.174:3300/0 conn(0x7f7b9c06df10 msgr2=0x7f7b9c165ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:17.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f7ba1772700 1 --2- 172.21.15.153:0/367511193 >> v2:172.21.15.174:3300/0 conn(0x7f7b9c06df10 0x7f7b9c165ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f9fbe421700 1 -- 172.21.15.153:0/910353853 wait complete. 2024-08-17T02:26:17.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f7ba1772700 1 -- 172.21.15.153:0/367511193 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b9c1669b0 con 0x7f7b9c06e2e0 2024-08-17T02:26:17.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f30a56b0700 1 -- 172.21.15.153:0/1593444826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30a00cb450 msgr2=0x7f30a006e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f30a56b0700 1 --2- 172.21.15.153:0/1593444826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30a00cb450 0x7f30a006e910 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f30900098e0 tx=0x7f30900091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f07c9a13700 1 -- 172.21.15.153:0/786044629 shutdown_connections 2024-08-17T02:26:17.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f566c223700 1 -- 172.21.15.153:0/1133889785 shutdown_connections 2024-08-17T02:26:17.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f566c223700 1 -- 172.21.15.153:0/1133889785 wait complete. 2024-08-17T02:26:17.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f30a56b0700 1 -- 172.21.15.153:0/1593444826 shutdown_connections 2024-08-17T02:26:17.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f30a56b0700 1 --2- 172.21.15.153:0/1593444826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30a00cb450 0x7f30a006e910 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f30a56b0700 1 -- 172.21.15.153:0/1593444826 >> 172.21.15.153:0/1593444826 conn(0x7f30a0067810 msgr2=0x7f30a0067c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f6d89606700 1 -- start start 2024-08-17T02:26:17.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f6d89606700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6d8413e6b0 0x7f6d840b1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.497+0000 7f6d89606700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6d8413ea80 0x7f6d84156b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f6d89606700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d84156700 con 0x7f6d84155670 2024-08-17T02:26:17.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f6d89606700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d84155af0 con 0x7f6d8413ea80 2024-08-17T02:26:17.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f6d89606700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d84155dd0 con 0x7f6d8413e6b0 2024-08-17T02:26:17.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f6d83fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6d8413e6b0 0x7f6d840b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7fbffc9c4700 1 Processor -- start 2024-08-17T02:26:17.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7fbffc9c4700 1 -- start start 2024-08-17T02:26:17.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f07c9a13700 1 -- 172.21.15.153:0/786044629 wait complete. 2024-08-17T02:26:17.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f6d88e05700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6d8413ea80 0x7f6d84156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f6d88e05700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6d8413ea80 0x7f6d84156b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.153:49598/0 (socket says 172.21.15.153:49598) 2024-08-17T02:26:17.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f6d88e05700 1 -- 172.21.15.153:0/616411351 learned_addr learned my addr 172.21.15.153:0/616411351 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:17.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f7ba1772700 1 --2- 172.21.15.153:0/367511193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b9c06e2e0 0x7f7b9c0b1550 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c070ee0 tx=0x7f7b9400ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e77cd853cce3100 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f6d88e05700 1 -- 172.21.15.153:0/616411351 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6d8413e6b0 msgr2=0x7f6d840b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:17.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f6d88e05700 1 --2- 172.21.15.153:0/616411351 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6d8413e6b0 0x7f6d840b1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f6d88e05700 1 -- 172.21.15.153:0/616411351 >> v1:172.21.15.174:6789/0 conn(0x7f6d84155670 legacy=0x7f6d8406df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:17.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f6d88e05700 1 -- 172.21.15.153:0/616411351 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d841560b0 con 0x7f6d8413ea80 2024-08-17T02:26:17.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f7ba0f71700 1 -- 172.21.15.153:0/367511193 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9400bea0 con 0x7f7b9c06e2e0 2024-08-17T02:26:17.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f7ba0f71700 1 -- 172.21.15.153:0/367511193 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b9401f430 con 0x7f7b9c06e2e0 2024-08-17T02:26:17.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f7ba0f71700 1 -- 172.21.15.153:0/367511193 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9401f7f0 con 0x7f7b9c06e2e0 2024-08-17T02:26:17.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f6d88e05700 1 --2- 172.21.15.153:0/616411351 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d8413ea80 0x7f6d84156b90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c009f20 tx=0x7f6d7c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c3b5d840a05fff4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f9fbe421700 1 Processor -- start 2024-08-17T02:26:17.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7fbffc9c4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbff8155050 0x7fbff806a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7fbffc9c4700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbff80aab50 0x7fbff80aef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7fbffc9c4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbff806b800 con 0x7fbff80ae370 2024-08-17T02:26:17.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7fbffc9c4700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbff806abf0 con 0x7fbff80aab50 2024-08-17T02:26:17.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7fbffc9c4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff806aed0 con 0x7fbff8155050 2024-08-17T02:26:17.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f566c223700 1 Processor -- start 2024-08-17T02:26:17.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7fbff6d9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbff80aab50 0x7fbff80aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7fbff6d9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbff80aab50 0x7fbff80aef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57516/0 (socket says 172.21.15.153:57516) 2024-08-17T02:26:17.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f6d82ffd700 1 -- 172.21.15.153:0/616411351 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c00e070 con 0x7f6d8413ea80 2024-08-17T02:26:17.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7fbff6d9d700 1 -- 172.21.15.153:0/2684180569 learned_addr learned my addr 172.21.15.153:0/2684180569 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:17.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f566c223700 1 -- start start 2024-08-17T02:26:17.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f30a56b0700 1 -- 172.21.15.153:0/1593444826 shutdown_connections 2024-08-17T02:26:17.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f6d82ffd700 1 -- 172.21.15.153:0/616411351 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7c00b990 con 0x7f6d8413ea80 2024-08-17T02:26:17.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f6d82ffd700 1 -- 172.21.15.153:0/616411351 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c0092e0 con 0x7f6d8413ea80 2024-08-17T02:26:17.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f7ba2f75700 1 -- 172.21.15.153:0/367511193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b9c06e2e0 msgr2=0x7f7b9c0b1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f7ba2f75700 1 --2- 172.21.15.153:0/367511193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b9c06e2e0 0x7f7b9c0b1550 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c070ee0 tx=0x7f7b9400ad30 comp rx=0 tx=0).stop 2024-08-17T02:26:17.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f566c223700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56640b1950 0x7f56641485e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f566c223700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f566413b630 0x7f5664136920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f566c223700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f566413bf10 0x7f566414bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f566c223700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566414afa0 con 0x7f566413b630 2024-08-17T02:26:17.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f566c223700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566414c750 con 0x7f56640b1950 2024-08-17T02:26:17.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f566c223700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f566414dd40 con 0x7f566413bf10 2024-08-17T02:26:17.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f5669fbf700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56640b1950 0x7f56641485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f5669fbf700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56640b1950 0x7f56641485e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.153:49604/0 (socket says 172.21.15.153:49604) 2024-08-17T02:26:17.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f5669fbf700 1 -- 172.21.15.153:0/2183826407 learned_addr learned my addr 172.21.15.153:0/2183826407 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:17.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f566a7c0700 1 --2- 172.21.15.153:0/2183826407 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f566413bf10 0x7f566414bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f56697be700 1 --2- 172.21.15.153:0/2183826407 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f566413b630 0x7f5664136920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f7ba2f75700 1 -- 172.21.15.153:0/367511193 shutdown_connections 2024-08-17T02:26:17.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f7ba2f75700 1 --2- 172.21.15.153:0/367511193 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b9c169880 0x7f7b9c169cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f7ba2f75700 1 --2- 172.21.15.153:0/367511193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b9c06e2e0 0x7f7b9c0b1550 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f7ba2f75700 1 --2- 172.21.15.153:0/367511193 >> v2:172.21.15.174:3300/0 conn(0x7f7b9c06df10 0x7f7b9c165ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f7ba2f75700 1 -- 172.21.15.153:0/367511193 >> 172.21.15.153:0/367511193 conn(0x7f7b9c0678d0 msgr2=0x7f7b9c067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f7ba2f75700 1 -- 172.21.15.153:0/367511193 shutdown_connections 2024-08-17T02:26:17.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f7ba2f75700 1 -- 172.21.15.153:0/367511193 wait complete. 2024-08-17T02:26:17.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f30a56b0700 1 -- 172.21.15.153:0/1593444826 wait complete. 2024-08-17T02:26:17.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f6d89606700 1 -- 172.21.15.153:0/616411351 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d8413ea80 msgr2=0x7f6d84156b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f6d89606700 1 --2- 172.21.15.153:0/616411351 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d8413ea80 0x7f6d84156b90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c009f20 tx=0x7f6d7c009840 comp rx=0 tx=0).stop 2024-08-17T02:26:17.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f6d89606700 1 -- 172.21.15.153:0/616411351 shutdown_connections 2024-08-17T02:26:17.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f6d89606700 1 --2- 172.21.15.153:0/616411351 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d8413ea80 0x7f6d84156b90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f6d89606700 1 --2- 172.21.15.153:0/616411351 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6d8413e6b0 0x7f6d840b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f6d89606700 1 -- 172.21.15.153:0/616411351 >> 172.21.15.153:0/616411351 conn(0x7f6d840678d0 msgr2=0x7f6d84067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f6d89606700 1 -- 172.21.15.153:0/616411351 shutdown_connections 2024-08-17T02:26:17.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f9fbe421700 1 -- start start 2024-08-17T02:26:17.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f9fbe421700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9fb806e470 0x7f9fb8155730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f9fbe421700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fb80adf10 0x7f9fb8098c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f9fbe421700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fb80cb450 0x7f9fb8099140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f9fbe421700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb80ab870 con 0x7f9fb806e470 2024-08-17T02:26:17.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f9fbe421700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb80aaca0 con 0x7f9fb80adf10 2024-08-17T02:26:17.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f9fbe421700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb80aaf40 con 0x7f9fb80cb450 2024-08-17T02:26:17.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f9fb77fe700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fb80adf10 0x7f9fb8098c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f9fbc9be700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fb80cb450 0x7f9fb8099140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f9fbc9be700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fb80cb450 0x7f9fb8099140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.153:34854/0 (socket says 172.21.15.153:34854) 2024-08-17T02:26:17.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f9fb77fe700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fb80adf10 0x7f9fb8098c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.153:49608/0 (socket says 172.21.15.153:49608) 2024-08-17T02:26:17.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f9fbc9be700 1 -- 172.21.15.153:0/2434667884 learned_addr learned my addr 172.21.15.153:0/2434667884 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:17.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f9fb7fff700 1 --2- 172.21.15.153:0/2434667884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9fb806e470 0x7f9fb8155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7fbff6d9d700 1 -- 172.21.15.153:0/2684180569 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbff8155050 msgr2=0x7fbff806a2f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:26:17.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7fbff6d9d700 1 --2- 172.21.15.153:0/2684180569 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbff8155050 0x7fbff806a2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7fbff6d9d700 1 -- 172.21.15.153:0/2684180569 >> v1:172.21.15.174:6789/0 conn(0x7fbff80ae370 legacy=0x7fbff80aa440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7fbff6d9d700 1 -- 172.21.15.153:0/2684180569 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff806b1b0 con 0x7fbff80aab50 2024-08-17T02:26:17.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7fbff6d9d700 1 --2- 172.21.15.153:0/2684180569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbff80aab50 0x7fbff80aef60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbff0009f20 tx=0x7fbff0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e4237164154e11b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7fbff559a700 1 -- 172.21.15.153:0/2684180569 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff00092e0 con 0x7fbff80aab50 2024-08-17T02:26:17.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7fbff559a700 1 -- 172.21.15.153:0/2684180569 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff000ba80 con 0x7fbff80aab50 2024-08-17T02:26:17.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7fbff559a700 1 -- 172.21.15.153:0/2684180569 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff000be40 con 0x7fbff80aab50 2024-08-17T02:26:17.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7fbffc9c4700 1 -- 172.21.15.153:0/2684180569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbff80aab50 msgr2=0x7fbff80aef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7fbffc9c4700 1 --2- 172.21.15.153:0/2684180569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbff80aab50 0x7fbff80aef60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbff0009f20 tx=0x7fbff0009840 comp rx=0 tx=0).stop 2024-08-17T02:26:17.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f1c4ffff700 1 Processor -- start 2024-08-17T02:26:17.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f1c4ffff700 1 -- start start 2024-08-17T02:26:17.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f07c9a13700 1 Processor -- start 2024-08-17T02:26:17.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f07c9a13700 1 -- start start 2024-08-17T02:26:17.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f07c9a13700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07c406e850 0x7f07c40ae250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f07c9a13700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07c40aae80 0x7f07c4158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f07c9a13700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07c40ab250 0x7f07c40699c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f07c9a13700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c40ad590 con 0x7f07c40aae80 2024-08-17T02:26:17.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f07c9a13700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c40ae790 con 0x7f07c40ab250 2024-08-17T02:26:17.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f07c9a13700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c40ac980 con 0x7f07c406e850 2024-08-17T02:26:17.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f07c3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07c40aae80 0x7f07c4158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f07c3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07c40aae80 0x7f07c4158b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57534/0 (socket says 172.21.15.153:57534) 2024-08-17T02:26:17.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f07c3fff700 1 -- 172.21.15.153:0/2909351715 learned_addr learned my addr 172.21.15.153:0/2909351715 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:17.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f5669fbf700 1 -- 172.21.15.153:0/2183826407 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f566413bf10 msgr2=0x7f566414bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f5669fbf700 1 --2- 172.21.15.153:0/2183826407 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f566413bf10 0x7f566414bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.501+0000 7f5669fbf700 1 -- 172.21.15.153:0/2183826407 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f566413b630 msgr2=0x7f5664136920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f5669fbf700 1 --2- 172.21.15.153:0/2183826407 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f566413b630 0x7f5664136920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f5669fbf700 1 -- 172.21.15.153:0/2183826407 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5660009420 con 0x7f56640b1950 2024-08-17T02:26:17.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f566a7c0700 1 --2- 172.21.15.153:0/2183826407 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f566413bf10 0x7f566414bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:17.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f6d89606700 1 -- 172.21.15.153:0/616411351 wait complete. 2024-08-17T02:26:17.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7fbffc9c4700 1 -- 172.21.15.153:0/2684180569 shutdown_connections 2024-08-17T02:26:17.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7fbffc9c4700 1 --2- 172.21.15.153:0/2684180569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbff80aab50 0x7fbff80aef60 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7fbffc9c4700 1 --2- 172.21.15.153:0/2684180569 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbff8155050 0x7fbff806a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7fbffc9c4700 1 -- 172.21.15.153:0/2684180569 >> 172.21.15.153:0/2684180569 conn(0x7fbff8068320 msgr2=0x7fbff80a8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f9fb77fe700 1 -- 172.21.15.153:0/2434667884 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fb80cb450 msgr2=0x7f9fb8099140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f9fb77fe700 1 --2- 172.21.15.153:0/2434667884 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fb80cb450 0x7f9fb8099140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f9fb77fe700 1 -- 172.21.15.153:0/2434667884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9fb806e470 msgr2=0x7f9fb8155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f9fb77fe700 1 --2- 172.21.15.153:0/2434667884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9fb806e470 0x7f9fb8155730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f9fb77fe700 1 -- 172.21.15.153:0/2434667884 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb0009ae0 con 0x7f9fb80adf10 2024-08-17T02:26:17.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f07c9212700 1 --2- 172.21.15.153:0/2909351715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07c40ab250 0x7f07c40699c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f30a56b0700 1 Processor -- start 2024-08-17T02:26:17.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f07c3fff700 1 -- 172.21.15.153:0/2909351715 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07c406e850 msgr2=0x7f07c40ae250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f07c3fff700 1 --2- 172.21.15.153:0/2909351715 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07c406e850 0x7f07c40ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f07c3fff700 1 -- 172.21.15.153:0/2909351715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07c40ab250 msgr2=0x7f07c40699c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f5669fbf700 1 --2- 172.21.15.153:0/2183826407 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56640b1950 0x7f56641485e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f565400ec80 tx=0x7f56540091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f9fb77fe700 1 --2- 172.21.15.153:0/2434667884 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fb80adf10 0x7f9fb8098c00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9fac00c590 tx=0x7f9fac007ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f07c3fff700 1 --2- 172.21.15.153:0/2909351715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07c40ab250 0x7f07c40699c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f07c3fff700 1 -- 172.21.15.153:0/2909351715 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07bc009ae0 con 0x7f07c40aae80 2024-08-17T02:26:17.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f07c3fff700 1 --2- 172.21.15.153:0/2909351715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07c40aae80 0x7f07c4158b40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f07b800c510 tx=0x7f07b800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.537 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f1c4ffff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1c50156d80 0x7f1c50157150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.537 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f1c4ffff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1c500b0d90 0x7f1c500b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.537 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f1c4ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1c500ad750 0x7f1c500adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.537 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f1c4ffff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c501580e0 con 0x7f1c500ad750 2024-08-17T02:26:17.537 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f1c4ffff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c500b1720 con 0x7f1c500b0d90 2024-08-17T02:26:17.537 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f1c4ffff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c501577b0 con 0x7f1c50156d80 2024-08-17T02:26:17.537 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f9f9ffff700 1 -- 172.21.15.153:0/2434667884 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac011590 con 0x7f9fb80adf10 2024-08-17T02:26:17.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f9f9ffff700 1 -- 172.21.15.153:0/2434667884 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fac0116f0 con 0x7f9fb80adf10 2024-08-17T02:26:17.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f07c0ff9700 1 -- 172.21.15.153:0/2909351715 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b8011590 con 0x7f07c40aae80 2024-08-17T02:26:17.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f9f9ffff700 1 -- 172.21.15.153:0/2434667884 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac011ab0 con 0x7f9fb80adf10 2024-08-17T02:26:17.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f9fbe421700 1 -- 172.21.15.153:0/2434667884 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fb80ab220 con 0x7f9fb80adf10 2024-08-17T02:26:17.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f07c9a13700 1 -- 172.21.15.153:0/2909351715 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07c40acc60 con 0x7f07c40aae80 2024-08-17T02:26:17.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f07c9a13700 1 -- 172.21.15.153:0/2909351715 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c40ad220 con 0x7f07c40aae80 2024-08-17T02:26:17.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f9fbe421700 1 -- 172.21.15.153:0/2434667884 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fb8155c70 con 0x7f9fb80adf10 2024-08-17T02:26:17.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f7ba2f75700 1 Processor -- start 2024-08-17T02:26:17.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f1c4effd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1c50156d80 0x7f1c50157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f1c4effd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1c50156d80 0x7f1c50157150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.153:34874/0 (socket says 172.21.15.153:34874) 2024-08-17T02:26:17.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f1c4effd700 1 -- 172.21.15.153:0/56817394 learned_addr learned my addr 172.21.15.153:0/56817394 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:17.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f07c0ff9700 1 -- 172.21.15.153:0/2909351715 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b8011710 con 0x7f07c40aae80 2024-08-17T02:26:17.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f07c0ff9700 1 -- 172.21.15.153:0/2909351715 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b8011ad0 con 0x7f07c40aae80 2024-08-17T02:26:17.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f6d89606700 1 Processor -- start 2024-08-17T02:26:17.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f30a56b0700 1 -- start start 2024-08-17T02:26:17.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f7ba2f75700 1 -- start start 2024-08-17T02:26:17.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f7ba2f75700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b9c06df10 0x7f7b9c0874d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f7ba2f75700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b9c06e2e0 0x7f7b9c15a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f7ba2f75700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b9c169880 0x7f7b9c15aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f7ba2f75700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c17c380 con 0x7f7b9c06df10 2024-08-17T02:26:17.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f7ba2f75700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c17c660 con 0x7f7b9c06e2e0 2024-08-17T02:26:17.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f7ba2f75700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c17c940 con 0x7f7b9c169880 2024-08-17T02:26:17.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f7ba2774700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b9c169880 0x7f7b9c15aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f7ba2774700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b9c169880 0x7f7b9c15aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.153:34888/0 (socket says 172.21.15.153:34888) 2024-08-17T02:26:17.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f7ba2774700 1 -- 172.21.15.153:0/1189532479 learned_addr learned my addr 172.21.15.153:0/1189532479 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:17.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f7ba1772700 1 --2- 172.21.15.153:0/1189532479 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b9c06e2e0 0x7f7b9c15a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f5659ffb700 1 -- 172.21.15.153:0/2183826407 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565400c850 con 0x7f56640b1950 2024-08-17T02:26:17.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f5659ffb700 1 -- 172.21.15.153:0/2183826407 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565400c9b0 con 0x7f56640b1950 2024-08-17T02:26:17.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f5659ffb700 1 -- 172.21.15.153:0/2183826407 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565400cd50 con 0x7f56640b1950 2024-08-17T02:26:17.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f566c223700 1 -- 172.21.15.153:0/2183826407 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f566414d410 con 0x7f56640b1950 2024-08-17T02:26:17.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f566c223700 1 -- 172.21.15.153:0/2183826407 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f566414d9d0 con 0x7f56640b1950 2024-08-17T02:26:17.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f30a56b0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30a006e470 0x7f30a015ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f30a56b0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f30a00adf10 0x7f30a00afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f30a56b0700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30a00cb450 0x7f30a0159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f30a56b0700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a015a300 con 0x7f30a006e470 2024-08-17T02:26:17.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f30a56b0700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a015b450 con 0x7f30a00cb450 2024-08-17T02:26:17.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f30a56b0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a00aee30 con 0x7f30a00adf10 2024-08-17T02:26:17.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f309e7fc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f30a00adf10 0x7f30a00afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f6d89606700 1 -- start start 2024-08-17T02:26:17.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f6d89606700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d8413e6b0 0x7f6d8413d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f6d89606700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6d8413ea80 0x7f6d840c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f6d89606700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d840c3170 0x7f6d84170e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f6d89606700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8413d820 con 0x7f6d8413e6b0 2024-08-17T02:26:17.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f6d89606700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d840c36f0 con 0x7f6d840c3170 2024-08-17T02:26:17.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f6d89606700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d840c39d0 con 0x7f6d8413ea80 2024-08-17T02:26:17.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f6d88e05700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d840c3170 0x7f6d84170e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f6d837fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6d8413ea80 0x7f6d840c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f6d88e05700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d840c3170 0x7f6d84170e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.153:49628/0 (socket says 172.21.15.153:49628) 2024-08-17T02:26:17.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f6d88e05700 1 -- 172.21.15.153:0/264208460 learned_addr learned my addr 172.21.15.153:0/264208460 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:17.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f6d83fff700 1 --2- 172.21.15.153:0/264208460 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d8413e6b0 0x7f6d8413d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f9fbe421700 1 -- 172.21.15.153:0/2434667884 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fb80aba20 con 0x7f9fb80adf10 2024-08-17T02:26:17.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7fbffc9c4700 1 -- 172.21.15.153:0/2684180569 shutdown_connections 2024-08-17T02:26:17.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7fbffc9c4700 1 -- 172.21.15.153:0/2684180569 wait complete. 2024-08-17T02:26:17.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f1c4e7fc700 1 --2- 172.21.15.153:0/56817394 >> v2:172.21.15.174:3300/0 conn(0x7f1c500b0d90 0x7f1c500b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f1c4effd700 1 -- 172.21.15.153:0/56817394 >> v2:172.21.15.174:3300/0 conn(0x7f1c500b0d90 msgr2=0x7f1c500b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:17.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f1c4f7fe700 1 --2- 172.21.15.153:0/56817394 >> v2:172.21.15.153:3300/0 conn(0x7f1c500ad750 0x7f1c500adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f1c4effd700 1 --2- 172.21.15.153:0/56817394 >> v2:172.21.15.174:3300/0 conn(0x7f1c500b0d90 0x7f1c500b11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f1c4effd700 1 -- 172.21.15.153:0/56817394 >> v2:172.21.15.153:3300/0 conn(0x7f1c500ad750 msgr2=0x7f1c500adbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:17.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f1c4effd700 1 --2- 172.21.15.153:0/56817394 >> v2:172.21.15.153:3300/0 conn(0x7f1c500ad750 0x7f1c500adbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f1c4effd700 1 -- 172.21.15.153:0/56817394 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c50157a90 con 0x7f1c50156d80 2024-08-17T02:26:17.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f1c4e7fc700 1 --2- 172.21.15.153:0/56817394 >> v2:172.21.15.174:3300/0 conn(0x7f1c500b0d90 0x7f1c500b11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:17.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f1c4f7fe700 1 --2- 172.21.15.153:0/56817394 >> v2:172.21.15.153:3300/0 conn(0x7f1c500ad750 0x7f1c500adbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:17.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f1c4effd700 1 --2- 172.21.15.153:0/56817394 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1c50156d80 0x7f1c50157150 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1c50070f40 tx=0x7f1c44009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c5b0afc28f27c5b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.547 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f309e7fc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f30a00adf10 0x7f30a00afbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.153:34906/0 (socket says 172.21.15.153:34906) 2024-08-17T02:26:17.547 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f309e7fc700 1 -- 172.21.15.153:0/1896062054 learned_addr learned my addr 172.21.15.153:0/1896062054 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:17.547 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f309effd700 1 --2- 172.21.15.153:0/1896062054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30a006e470 0x7f30a015ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.547 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f1c4dffb700 1 -- 172.21.15.153:0/56817394 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4400b860 con 0x7f1c50156d80 2024-08-17T02:26:17.547 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f1c4dffb700 1 -- 172.21.15.153:0/56817394 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4400b9c0 con 0x7f1c50156d80 2024-08-17T02:26:17.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f1c4dffb700 1 -- 172.21.15.153:0/56817394 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4400bd60 con 0x7f1c50156d80 2024-08-17T02:26:17.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f6d88e05700 1 -- 172.21.15.153:0/264208460 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6d8413ea80 msgr2=0x7f6d840c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f6d88e05700 1 --2- 172.21.15.153:0/264208460 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6d8413ea80 0x7f6d840c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f6d88e05700 1 -- 172.21.15.153:0/264208460 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d8413e6b0 msgr2=0x7f6d8413d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f6d88e05700 1 --2- 172.21.15.153:0/264208460 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d8413e6b0 0x7f6d8413d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f6d88e05700 1 -- 172.21.15.153:0/264208460 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d7c009ae0 con 0x7f6d840c3170 2024-08-17T02:26:17.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f6d83fff700 1 --2- 172.21.15.153:0/264208460 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d8413e6b0 0x7f6d8413d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:17.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f07c9a13700 1 -- 172.21.15.153:0/2909351715 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07a40052b0 con 0x7f07c40aae80 2024-08-17T02:26:17.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f7ba1f73700 1 --2- 172.21.15.153:0/1189532479 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b9c06df10 0x7f7b9c0874d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f7ba2774700 1 -- 172.21.15.153:0/1189532479 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b9c06e2e0 msgr2=0x7f7b9c15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f309f7fe700 1 --2- 172.21.15.153:0/1896062054 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30a00cb450 0x7f30a0159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f7ba2774700 1 --2- 172.21.15.153:0/1189532479 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b9c06e2e0 0x7f7b9c15a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f7ba2774700 1 -- 172.21.15.153:0/1189532479 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b9c06df10 msgr2=0x7f7b9c0874d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f7ba2774700 1 --2- 172.21.15.153:0/1189532479 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b9c06df10 0x7f7b9c0874d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f7ba2774700 1 -- 172.21.15.153:0/1189532479 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b940077a0 con 0x7f7b9c169880 2024-08-17T02:26:17.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.505+0000 7f7ba1772700 1 --2- 172.21.15.153:0/1189532479 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b9c06e2e0 0x7f7b9c15a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:17.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f7ba2774700 1 --2- 172.21.15.153:0/1189532479 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b9c169880 0x7f7b9c15aa80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7b9800bb10 tx=0x7f7b9800f040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f7b91ffb700 1 -- 172.21.15.153:0/1189532479 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b980087b0 con 0x7f7b9c169880 2024-08-17T02:26:17.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f7b91ffb700 1 -- 172.21.15.153:0/1189532479 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b98008910 con 0x7f7b9c169880 2024-08-17T02:26:17.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f7ba2f75700 1 -- 172.21.15.153:0/1189532479 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b9c17cc20 con 0x7f7b9c169880 2024-08-17T02:26:17.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7fbffc9c4700 1 Processor -- start 2024-08-17T02:26:17.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7fbffc9c4700 1 -- start start 2024-08-17T02:26:17.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f309effd700 1 -- 172.21.15.153:0/1896062054 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f30a00adf10 msgr2=0x7f30a00afbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f309effd700 1 --2- 172.21.15.153:0/1896062054 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f30a00adf10 0x7f30a00afbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f309effd700 1 -- 172.21.15.153:0/1896062054 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30a00cb450 msgr2=0x7f30a0159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f309effd700 1 --2- 172.21.15.153:0/1896062054 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30a00cb450 0x7f30a0159dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f309effd700 1 -- 172.21.15.153:0/1896062054 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3090009420 con 0x7f30a006e470 2024-08-17T02:26:17.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f309f7fe700 1 --2- 172.21.15.153:0/1896062054 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30a00cb450 0x7f30a0159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:17.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f566c223700 1 -- 172.21.15.153:0/2183826407 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56640643a0 con 0x7f56640b1950 2024-08-17T02:26:17.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f9f9ffff700 1 -- 172.21.15.153:0/2434667884 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9fac012420 con 0x7f9fb80adf10 2024-08-17T02:26:17.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f07c0ff9700 1 -- 172.21.15.153:0/2909351715 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f07b801b3b0 con 0x7f07c40aae80 2024-08-17T02:26:17.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f07c0ff9700 1 --2- 172.21.15.153:0/2909351715 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f07b00608e0 0x7f07b0062d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f07c0ff9700 1 -- 172.21.15.153:0/2909351715 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f07b807c120 con 0x7f07c40aae80 2024-08-17T02:26:17.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f1c4ffff700 1 -- 172.21.15.153:0/56817394 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1c50156d80 msgr2=0x7f1c50157150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f1c4ffff700 1 --2- 172.21.15.153:0/56817394 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1c50156d80 0x7f1c50157150 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1c50070f40 tx=0x7f1c44009250 comp rx=0 tx=0).stop 2024-08-17T02:26:17.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f07c8a11700 1 --2- 172.21.15.153:0/2909351715 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f07b00608e0 0x7f07b0062d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f7ba2f75700 1 -- 172.21.15.153:0/1189532479 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b9c160210 con 0x7f7b9c169880 2024-08-17T02:26:17.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f309effd700 1 --2- 172.21.15.153:0/1896062054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30a006e470 0x7f30a015ae00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f30940011e0 tx=0x7f3094007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f7b91ffb700 1 -- 172.21.15.153:0/1189532479 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b98008cd0 con 0x7f7b9c169880 2024-08-17T02:26:17.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f9f9ffff700 1 --2- 172.21.15.153:0/2434667884 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9fa4060860 0x7f9fa4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7fbffc9c4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbff80aab50 0x7fbff80993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7fbffc9c4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbff80ae370 0x7fbff80969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7fbffc9c4700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbff8155050 0x7fbff80972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7fbffc9c4700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff8096f30 con 0x7fbff80ae370 2024-08-17T02:26:17.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7fbffc9c4700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff8099a60 con 0x7fbff8155050 2024-08-17T02:26:17.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7fbffc9c4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff80af9c0 con 0x7fbff80aab50 2024-08-17T02:26:17.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f1c4ffff700 1 -- 172.21.15.153:0/56817394 shutdown_connections 2024-08-17T02:26:17.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f1c4ffff700 1 --2- 172.21.15.153:0/56817394 >> v2:172.21.15.153:3300/0 conn(0x7f1c500ad750 0x7f1c500adbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f1c4ffff700 1 --2- 172.21.15.153:0/56817394 >> v2:172.21.15.174:3300/0 conn(0x7f1c500b0d90 0x7f1c500b11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f1c4ffff700 1 --2- 172.21.15.153:0/56817394 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1c50156d80 0x7f1c50157150 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f1c4ffff700 1 -- 172.21.15.153:0/56817394 >> 172.21.15.153:0/56817394 conn(0x7f1c500678d0 msgr2=0x7f1c50067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f9f9ffff700 1 -- 172.21.15.153:0/2434667884 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9fac07c410 con 0x7f9fb80adf10 2024-08-17T02:26:17.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f07c8a11700 1 --2- 172.21.15.153:0/2909351715 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f07b00608e0 0x7f07b0062d90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f07b4009bb0 tx=0x7f07b40091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7fbff6d9d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbff8155050 0x7fbff80972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7fbff659c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbff80aab50 0x7fbff80993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7fbff6d9d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbff8155050 0x7fbff80972c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.153:49652/0 (socket says 172.21.15.153:49652) 2024-08-17T02:26:17.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7fbff659c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbff80aab50 0x7fbff80993a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.153:34918/0 (socket says 172.21.15.153:34918) 2024-08-17T02:26:17.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7fbff6d9d700 1 -- 172.21.15.153:0/2437953763 learned_addr learned my addr 172.21.15.153:0/2437953763 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:17.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f6d88e05700 1 --2- 172.21.15.153:0/264208460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d840c3170 0x7f6d84170e10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c003000 tx=0x7f6d7c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f7ba2f75700 1 -- 172.21.15.153:0/1189532479 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b9c0643a0 con 0x7f7b9c169880 2024-08-17T02:26:17.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f7b91ffb700 1 -- 172.21.15.153:0/1189532479 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7b98005a00 con 0x7f7b9c169880 2024-08-17T02:26:17.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f9fb7fff700 1 --2- 172.21.15.153:0/2434667884 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9fa4060860 0x7f9fa4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f1c4ffff700 1 -- 172.21.15.153:0/56817394 shutdown_connections 2024-08-17T02:26:17.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7fbff6d9d700 1 -- 172.21.15.153:0/2437953763 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbff80aab50 msgr2=0x7fbff80993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7fbff6d9d700 1 --2- 172.21.15.153:0/2437953763 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbff80aab50 0x7fbff80993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7fbff6d9d700 1 -- 172.21.15.153:0/2437953763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbff80ae370 msgr2=0x7fbff80969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7fbff6d9d700 1 --2- 172.21.15.153:0/2437953763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbff80ae370 0x7fbff80969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7fbff6d9d700 1 -- 172.21.15.153:0/2437953763 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff0009ae0 con 0x7fbff8155050 2024-08-17T02:26:17.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f1c4ffff700 1 -- 172.21.15.153:0/56817394 wait complete. 2024-08-17T02:26:17.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f7b91ffb700 1 --2- 172.21.15.153:0/1189532479 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7b80060860 0x7f7b80062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f7b91ffb700 1 -- 172.21.15.153:0/1189532479 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7b9807c160 con 0x7f7b9c169880 2024-08-17T02:26:17.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7fbff6d9d700 1 --2- 172.21.15.153:0/2437953763 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbff8155050 0x7fbff80972c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbff000d000 tx=0x7fbff001c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f7ba1f73700 1 --2- 172.21.15.153:0/1189532479 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7b80060860 0x7f7b80062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f9fb7fff700 1 --2- 172.21.15.153:0/2434667884 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9fa4060860 0x7f9fa4062d10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0009880 tx=0x7f9fb0018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.509+0000 7f7ba1f73700 1 --2- 172.21.15.153:0/1189532479 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7b80060860 0x7f7b80062d10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c009d40 tx=0x7f7b8c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.513+0000 7f1c4ffff700 1 Processor -- start 2024-08-17T02:26:17.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.513+0000 7f1c4ffff700 1 -- start start 2024-08-17T02:26:17.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.513+0000 7f1c4ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c500ad750 0x7f1c5016b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.513+0000 7f1c4ffff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1c500b0d90 0x7f1c500c71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.513+0000 7f1c4ffff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1c50156d80 0x7f1c500a80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.513+0000 7f1c4ffff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c500a9010 con 0x7f1c500ad750 2024-08-17T02:26:17.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.513+0000 7f1c4ffff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5016b230 con 0x7f1c50156d80 2024-08-17T02:26:17.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.513+0000 7f1c4ffff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c500a8a50 con 0x7f1c500b0d90 2024-08-17T02:26:17.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.513+0000 7f1c4effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c500ad750 0x7f1c5016b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.513+0000 7f1c4effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c500ad750 0x7f1c5016b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57572/0 (socket says 172.21.15.153:57572) 2024-08-17T02:26:17.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.513+0000 7f1c4effd700 1 -- 172.21.15.153:0/3696200840 learned_addr learned my addr 172.21.15.153:0/3696200840 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:17.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.513+0000 7f1c4f7fe700 1 --2- 172.21.15.153:0/3696200840 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1c50156d80 0x7f1c500a80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.513+0000 7f1c4e7fc700 1 --2- 172.21.15.153:0/3696200840 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1c500b0d90 0x7f1c500c71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.513+0000 7f1c4effd700 1 -- 172.21.15.153:0/3696200840 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1c500b0d90 msgr2=0x7f1c500c71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.513+0000 7f1c4effd700 1 --2- 172.21.15.153:0/3696200840 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1c500b0d90 0x7f1c500c71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.513+0000 7f1c4effd700 1 -- 172.21.15.153:0/3696200840 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1c50156d80 msgr2=0x7f1c500a80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.513+0000 7f1c4effd700 1 --2- 172.21.15.153:0/3696200840 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1c50156d80 0x7f1c500a80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.513+0000 7f1c4effd700 1 -- 172.21.15.153:0/3696200840 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c440094f0 con 0x7f1c500ad750 2024-08-17T02:26:17.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.513+0000 7f1c4f7fe700 1 --2- 172.21.15.153:0/3696200840 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1c50156d80 0x7f1c500a80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:17.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.513+0000 7f1c4effd700 1 --2- 172.21.15.153:0/3696200840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c500ad750 0x7f1c5016b6c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1c501578f0 tx=0x7f1c44017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.513+0000 7f1c36ffd700 1 -- 172.21.15.153:0/3696200840 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c44011e20 con 0x7f1c500ad750 2024-08-17T02:26:17.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.513+0000 7f1c36ffd700 1 -- 172.21.15.153:0/3696200840 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4401a630 con 0x7f1c500ad750 2024-08-17T02:26:17.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.513+0000 7f1c4ffff700 1 -- 172.21.15.153:0/3696200840 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c500a8d30 con 0x7f1c500ad750 2024-08-17T02:26:17.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.513+0000 7f3086ffd700 1 -- 172.21.15.153:0/1896062054 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3094005b30 con 0x7f30a006e470 2024-08-17T02:26:17.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.513+0000 7f07c0ff9700 1 -- 172.21.15.153:0/2909351715 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f07b804c4d0 con 0x7f07c40aae80 2024-08-17T02:26:17.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.513+0000 7f3086ffd700 1 -- 172.21.15.153:0/1896062054 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3094005c90 con 0x7f30a006e470 2024-08-17T02:26:17.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.513+0000 7f3086ffd700 1 -- 172.21.15.153:0/1896062054 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3094007320 con 0x7f30a006e470 2024-08-17T02:26:17.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.513+0000 7f1c4ffff700 1 -- 172.21.15.153:0/3696200840 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c5016bc00 con 0x7f1c500ad750 2024-08-17T02:26:17.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.513+0000 7f30a56b0700 1 -- 172.21.15.153:0/1896062054 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30a00af110 con 0x7f30a006e470 2024-08-17T02:26:17.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.513+0000 7f30a56b0700 1 -- 172.21.15.153:0/1896062054 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30a00af6d0 con 0x7f30a006e470 2024-08-17T02:26:17.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.513+0000 7f1c36ffd700 1 -- 172.21.15.153:0/3696200840 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4401a9f0 con 0x7f1c500ad750 2024-08-17T02:26:17.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.513+0000 7f30a56b0700 1 -- 172.21.15.153:0/1896062054 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30a00af8f0 con 0x7f30a006e470 2024-08-17T02:26:17.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.517+0000 7f1c36ffd700 1 -- 172.21.15.153:0/3696200840 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1c4402d440 con 0x7f1c500ad750 2024-08-17T02:26:17.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.517+0000 7f1c36ffd700 1 --2- 172.21.15.153:0/3696200840 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1c3c060890 0x7f1c3c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.517+0000 7f1c4ffff700 1 -- 172.21.15.153:0/3696200840 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c300052b0 con 0x7f1c500ad750 2024-08-17T02:26:17.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.517+0000 7f1c36ffd700 1 -- 172.21.15.153:0/3696200840 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1c4407e590 con 0x7f1c500ad750 2024-08-17T02:26:17.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.517+0000 7f1c4e7fc700 1 --2- 172.21.15.153:0/3696200840 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1c3c060890 0x7f1c3c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.517+0000 7f1c4e7fc700 1 --2- 172.21.15.153:0/3696200840 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1c3c060890 0x7f1c3c062d40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1c5016acf0 tx=0x7f1c48007710 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.517+0000 7f3086ffd700 1 -- 172.21.15.153:0/1896062054 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f3094012400 con 0x7f30a006e470 2024-08-17T02:26:17.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.517+0000 7f3086ffd700 1 --2- 172.21.15.153:0/1896062054 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f308c060860 0x7f308c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.517+0000 7f309e7fc700 1 --2- 172.21.15.153:0/1896062054 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f308c060860 0x7f308c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.517+0000 7f3086ffd700 1 -- 172.21.15.153:0/1896062054 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f309407bef0 con 0x7f30a006e470 2024-08-17T02:26:17.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.517+0000 7f309e7fc700 1 --2- 172.21.15.153:0/1896062054 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f308c060860 0x7f308c062d10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f30a015a670 tx=0x7f3098009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.521+0000 7f1c36ffd700 1 -- 172.21.15.153:0/3696200840 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1c440524b0 con 0x7f1c500ad750 2024-08-17T02:26:17.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.521+0000 7f9f9ffff700 1 -- 172.21.15.153:0/2434667884 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f9fac04c990 con 0x7f9fb80adf10 2024-08-17T02:26:17.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.521+0000 7f6d6bfff700 1 -- 172.21.15.153:0/264208460 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c012af0 con 0x7f6d840c3170 2024-08-17T02:26:17.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.521+0000 7f6d6bfff700 1 -- 172.21.15.153:0/264208460 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7c012c70 con 0x7f6d840c3170 2024-08-17T02:26:17.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.521+0000 7f6d89606700 1 -- 172.21.15.153:0/264208460 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d840c3cb0 con 0x7f6d840c3170 2024-08-17T02:26:17.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.521+0000 7f6d6bfff700 1 -- 172.21.15.153:0/264208460 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c01d420 con 0x7f6d840c3170 2024-08-17T02:26:17.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.521+0000 7f6d89606700 1 -- 172.21.15.153:0/264208460 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d84171b90 con 0x7f6d840c3170 2024-08-17T02:26:17.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.521+0000 7f5659ffb700 1 -- 172.21.15.153:0/2183826407 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5654013680 con 0x7f56640b1950 2024-08-17T02:26:17.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.525+0000 7f5659ffb700 1 --2- 172.21.15.153:0/2183826407 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f5648060930 0x7f5648062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.525+0000 7f5659ffb700 1 -- 172.21.15.153:0/2183826407 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f565407d590 con 0x7f56640b1950 2024-08-17T02:26:17.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.525+0000 7f56697be700 1 --2- 172.21.15.153:0/2183826407 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f5648060930 0x7f5648062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.525+0000 7f56697be700 1 --2- 172.21.15.153:0/2183826407 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f5648060930 0x7f5648062de0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f566406c070 tx=0x7f5660017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.525+0000 7f3086ffd700 1 -- 172.21.15.153:0/1896062054 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f309404a480 con 0x7f30a006e470 2024-08-17T02:26:17.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.525+0000 7f5659ffb700 1 -- 172.21.15.153:0/2183826407 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f565404da40 con 0x7f56640b1950 2024-08-17T02:26:17.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.529+0000 7fbfe67fc700 1 -- 172.21.15.153:0/2437953763 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff0007610 con 0x7fbff8155050 2024-08-17T02:26:17.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.529+0000 7fbfe67fc700 1 -- 172.21.15.153:0/2437953763 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff0007770 con 0x7fbff8155050 2024-08-17T02:26:17.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.529+0000 7fbfe67fc700 1 -- 172.21.15.153:0/2437953763 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff0007b30 con 0x7fbff8155050 2024-08-17T02:26:17.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.529+0000 7fbffc9c4700 1 -- 172.21.15.153:0/2437953763 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbff80af090 con 0x7fbff8155050 2024-08-17T02:26:17.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.529+0000 7fbffc9c4700 1 -- 172.21.15.153:0/2437953763 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff80af650 con 0x7fbff8155050 2024-08-17T02:26:17.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.529+0000 7fbfe67fc700 1 -- 172.21.15.153:0/2437953763 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fbff0003040 con 0x7fbff8155050 2024-08-17T02:26:17.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.529+0000 7fbfe67fc700 1 --2- 172.21.15.153:0/2437953763 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fbfd80609b0 0x7fbfd8062e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.529+0000 7fbff659c700 1 --2- 172.21.15.153:0/2437953763 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fbfd80609b0 0x7fbfd8062e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.529+0000 7fbfe67fc700 1 -- 172.21.15.153:0/2437953763 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbff0016070 con 0x7fbff8155050 2024-08-17T02:26:17.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.529+0000 7fbff659c700 1 --2- 172.21.15.153:0/2437953763 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fbfd80609b0 0x7fbfd8062e60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8006fd0 tx=0x7fbfe8009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.533+0000 7f7b91ffb700 1 -- 172.21.15.153:0/1189532479 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f7b9804c5f0 con 0x7f7b9c169880 2024-08-17T02:26:17.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.529+0000 7f6d6bfff700 1 -- 172.21.15.153:0/264208460 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6d7c01d7f0 con 0x7f6d840c3170 2024-08-17T02:26:17.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.529+0000 7f6d89606700 1 -- 172.21.15.153:0/264208460 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d8415d800 con 0x7f6d840c3170 2024-08-17T02:26:17.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.529+0000 7f6d6bfff700 1 --2- 172.21.15.153:0/264208460 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6d70060890 0x7f6d70062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.529+0000 7f6d6bfff700 1 -- 172.21.15.153:0/264208460 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6d7c07e300 con 0x7f6d840c3170 2024-08-17T02:26:17.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.529+0000 7f6d83fff700 1 --2- 172.21.15.153:0/264208460 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6d70060890 0x7f6d70062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.529+0000 7f6d83fff700 1 --2- 172.21.15.153:0/264208460 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6d70060890 0x7f6d70062d40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6d7400a9d0 tx=0x7f6d7400c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.533+0000 7f6d6bfff700 1 -- 172.21.15.153:0/264208460 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f6d8415d800 con 0x7f6d840c3170 2024-08-17T02:26:17.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.541+0000 7fbffc9c4700 1 -- 172.21.15.153:0/2437953763 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfdc0052b0 con 0x7fbff8155050 2024-08-17T02:26:17.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.549+0000 7fbfe67fc700 1 -- 172.21.15.153:0/2437953763 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fbff004eb50 con 0x7fbff8155050 2024-08-17T02:26:17.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.813+0000 7f30a56b0700 1 -- 172.21.15.153:0/1896062054 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f30a00645c0 con 0x7f30a006e470 2024-08-17T02:26:17.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.817+0000 7f3086ffd700 1 -- 172.21.15.153:0/1896062054 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3094017090 con 0x7f30a006e470 2024-08-17T02:26:17.821 INFO:teuthology.orchestra.run.smithi153.stdout:60129542150 2024-08-17T02:26:17.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.817+0000 7f07c9a13700 1 -- 172.21.15.153:0/2909351715 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f07a4005560 con 0x7f07c40aae80 2024-08-17T02:26:17.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.817+0000 7f07c0ff9700 1 -- 172.21.15.153:0/2909351715 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f07b8017020 con 0x7f07c40aae80 2024-08-17T02:26:17.822 INFO:teuthology.orchestra.run.smithi153.stdout:64424509446 2024-08-17T02:26:17.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.821+0000 7f30a56b0700 1 -- 172.21.15.153:0/1896062054 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f308c060860 msgr2=0x7f308c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.821+0000 7f30a56b0700 1 --2- 172.21.15.153:0/1896062054 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f308c060860 0x7f308c062d10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f30a015a670 tx=0x7f3098009040 comp rx=0 tx=0).stop 2024-08-17T02:26:17.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.821+0000 7f30a56b0700 1 -- 172.21.15.153:0/1896062054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30a006e470 msgr2=0x7f30a015ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.821+0000 7f30a56b0700 1 --2- 172.21.15.153:0/1896062054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30a006e470 0x7f30a015ae00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f30940011e0 tx=0x7f3094007d10 comp rx=0 tx=0).stop 2024-08-17T02:26:17.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.821+0000 7f30a56b0700 1 -- 172.21.15.153:0/1896062054 shutdown_connections 2024-08-17T02:26:17.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.821+0000 7f30a56b0700 1 --2- 172.21.15.153:0/1896062054 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f308c060860 0x7f308c062d10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.821+0000 7f30a56b0700 1 --2- 172.21.15.153:0/1896062054 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30a00cb450 0x7f30a0159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.821+0000 7f30a56b0700 1 --2- 172.21.15.153:0/1896062054 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f30a00adf10 0x7f30a00afbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.821+0000 7f30a56b0700 1 --2- 172.21.15.153:0/1896062054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30a006e470 0x7f30a015ae00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.821+0000 7f30a56b0700 1 -- 172.21.15.153:0/1896062054 >> 172.21.15.153:0/1896062054 conn(0x7f30a0067810 msgr2=0x7f30a006a550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.821+0000 7f30a56b0700 1 -- 172.21.15.153:0/1896062054 shutdown_connections 2024-08-17T02:26:17.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.821+0000 7f30a56b0700 1 -- 172.21.15.153:0/1896062054 wait complete. 2024-08-17T02:26:17.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.821+0000 7f07c9a13700 1 -- 172.21.15.153:0/2909351715 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f07b00608e0 msgr2=0x7f07b0062d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.821+0000 7f07c9a13700 1 --2- 172.21.15.153:0/2909351715 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f07b00608e0 0x7f07b0062d90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f07b4009bb0 tx=0x7f07b40091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.821+0000 7f07c9a13700 1 -- 172.21.15.153:0/2909351715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07c40aae80 msgr2=0x7f07c4158b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.821+0000 7f07c9a13700 1 --2- 172.21.15.153:0/2909351715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07c40aae80 0x7f07c4158b40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f07b800c510 tx=0x7f07b800c8d0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.821+0000 7f07c9a13700 1 -- 172.21.15.153:0/2909351715 shutdown_connections 2024-08-17T02:26:17.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.821+0000 7f07c9a13700 1 --2- 172.21.15.153:0/2909351715 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f07b00608e0 0x7f07b0062d90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.821+0000 7f07c9a13700 1 --2- 172.21.15.153:0/2909351715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07c40ab250 0x7f07c40699c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.821+0000 7f07c9a13700 1 --2- 172.21.15.153:0/2909351715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07c40aae80 0x7f07c4158b40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.821+0000 7f07c9a13700 1 --2- 172.21.15.153:0/2909351715 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07c406e850 0x7f07c40ae250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.821+0000 7f07c9a13700 1 -- 172.21.15.153:0/2909351715 >> 172.21.15.153:0/2909351715 conn(0x7f07c4066e00 msgr2=0x7f07c4067ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.821+0000 7f07c9a13700 1 -- 172.21.15.153:0/2909351715 shutdown_connections 2024-08-17T02:26:17.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.821+0000 7f07c9a13700 1 -- 172.21.15.153:0/2909351715 wait complete. 2024-08-17T02:26:17.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.825+0000 7f1c4ffff700 1 -- 172.21.15.153:0/3696200840 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f1c30005830 con 0x7f1c500ad750 2024-08-17T02:26:17.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.829+0000 7f1c36ffd700 1 -- 172.21.15.153:0/3696200840 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1c44076fe0 con 0x7f1c500ad750 2024-08-17T02:26:17.834 INFO:teuthology.orchestra.run.smithi153.stdout:64424509447 2024-08-17T02:26:17.838 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.0 2024-08-17T02:26:17.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.833+0000 7f1c4ffff700 1 -- 172.21.15.153:0/3696200840 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1c3c060890 msgr2=0x7f1c3c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.833+0000 7f1c4ffff700 1 --2- 172.21.15.153:0/3696200840 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1c3c060890 0x7f1c3c062d40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1c5016acf0 tx=0x7f1c48007710 comp rx=0 tx=0).stop 2024-08-17T02:26:17.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.833+0000 7f1c4ffff700 1 -- 172.21.15.153:0/3696200840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c500ad750 msgr2=0x7f1c5016b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.833+0000 7f1c4ffff700 1 --2- 172.21.15.153:0/3696200840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c500ad750 0x7f1c5016b6c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1c501578f0 tx=0x7f1c44017000 comp rx=0 tx=0).stop 2024-08-17T02:26:17.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.833+0000 7f1c4ffff700 1 -- 172.21.15.153:0/3696200840 shutdown_connections 2024-08-17T02:26:17.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.833+0000 7f1c4ffff700 1 --2- 172.21.15.153:0/3696200840 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1c3c060890 0x7f1c3c062d40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.833+0000 7f1c4ffff700 1 --2- 172.21.15.153:0/3696200840 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1c50156d80 0x7f1c500a80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.833+0000 7f1c4ffff700 1 --2- 172.21.15.153:0/3696200840 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1c500b0d90 0x7f1c500c71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.833+0000 7f1c4ffff700 1 --2- 172.21.15.153:0/3696200840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c500ad750 0x7f1c5016b6c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.833+0000 7f1c4ffff700 1 -- 172.21.15.153:0/3696200840 >> 172.21.15.153:0/3696200840 conn(0x7f1c500678d0 msgr2=0x7f1c50069950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.833+0000 7f9fbe421700 1 -- 172.21.15.153:0/2434667884 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9fb80ab9e0 con 0x7f9fb80adf10 2024-08-17T02:26:17.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.833+0000 7f1c4ffff700 1 -- 172.21.15.153:0/3696200840 shutdown_connections 2024-08-17T02:26:17.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.833+0000 7f1c4ffff700 1 -- 172.21.15.153:0/3696200840 wait complete. 2024-08-17T02:26:17.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.837+0000 7f9f9ffff700 1 -- 172.21.15.153:0/2434667884 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9fac021020 con 0x7f9fb80adf10 2024-08-17T02:26:17.840 INFO:teuthology.orchestra.run.smithi153.stdout:64424509446 2024-08-17T02:26:17.841 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.6 2024-08-17T02:26:17.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.841+0000 7f9fbe421700 1 -- 172.21.15.153:0/2434667884 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9fa4060860 msgr2=0x7f9fa4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.841+0000 7f9fbe421700 1 --2- 172.21.15.153:0/2434667884 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9fa4060860 0x7f9fa4062d10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0009880 tx=0x7f9fb0018000 comp rx=0 tx=0).stop 2024-08-17T02:26:17.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.841+0000 7f9fbe421700 1 -- 172.21.15.153:0/2434667884 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fb80adf10 msgr2=0x7f9fb8098c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.841+0000 7f9fbe421700 1 --2- 172.21.15.153:0/2434667884 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fb80adf10 0x7f9fb8098c00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9fac00c590 tx=0x7f9fac007ec0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.841+0000 7f9fbe421700 1 -- 172.21.15.153:0/2434667884 shutdown_connections 2024-08-17T02:26:17.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.841+0000 7f9fbe421700 1 --2- 172.21.15.153:0/2434667884 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9fa4060860 0x7f9fa4062d10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.841+0000 7f9fbe421700 1 --2- 172.21.15.153:0/2434667884 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fb80cb450 0x7f9fb8099140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.841+0000 7f9fbe421700 1 --2- 172.21.15.153:0/2434667884 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fb80adf10 0x7f9fb8098c00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.841+0000 7f9fbe421700 1 --2- 172.21.15.153:0/2434667884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9fb806e470 0x7f9fb8155730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.841+0000 7f9fbe421700 1 -- 172.21.15.153:0/2434667884 >> 172.21.15.153:0/2434667884 conn(0x7f9fb8067810 msgr2=0x7f9fb81604d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.841+0000 7f9fbe421700 1 -- 172.21.15.153:0/2434667884 shutdown_connections 2024-08-17T02:26:17.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.841+0000 7f9fbe421700 1 -- 172.21.15.153:0/2434667884 wait complete. 2024-08-17T02:26:17.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.845+0000 7f566c223700 1 -- 172.21.15.153:0/2183826407 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f566406f5f0 con 0x7f56640b1950 2024-08-17T02:26:17.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.845+0000 7f5659ffb700 1 -- 172.21.15.153:0/2183826407 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5654051060 con 0x7f56640b1950 2024-08-17T02:26:17.847 INFO:teuthology.orchestra.run.smithi153.stdout:64424509445 2024-08-17T02:26:17.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.845+0000 7f566c223700 1 -- 172.21.15.153:0/2183826407 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f5648060930 msgr2=0x7f5648062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.845+0000 7f566c223700 1 --2- 172.21.15.153:0/2183826407 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f5648060930 0x7f5648062de0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f566406c070 tx=0x7f5660017000 comp rx=0 tx=0).stop 2024-08-17T02:26:17.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.845+0000 7f566c223700 1 -- 172.21.15.153:0/2183826407 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56640b1950 msgr2=0x7f56641485e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.845+0000 7f566c223700 1 --2- 172.21.15.153:0/2183826407 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56640b1950 0x7f56641485e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f565400ec80 tx=0x7f56540091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.845+0000 7f566c223700 1 -- 172.21.15.153:0/2183826407 shutdown_connections 2024-08-17T02:26:17.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.845+0000 7f566c223700 1 --2- 172.21.15.153:0/2183826407 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f5648060930 0x7f5648062de0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.845+0000 7f566c223700 1 --2- 172.21.15.153:0/2183826407 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f566413bf10 0x7f566414bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.845+0000 7f566c223700 1 --2- 172.21.15.153:0/2183826407 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f566413b630 0x7f5664136920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.845+0000 7f566c223700 1 --2- 172.21.15.153:0/2183826407 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56640b1950 0x7f56641485e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.845+0000 7f566c223700 1 -- 172.21.15.153:0/2183826407 >> 172.21.15.153:0/2183826407 conn(0x7f56640678d0 msgr2=0x7f566406d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.845+0000 7f566c223700 1 -- 172.21.15.153:0/2183826407 shutdown_connections 2024-08-17T02:26:17.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.845+0000 7f566c223700 1 -- 172.21.15.153:0/2183826407 wait complete. 2024-08-17T02:26:17.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.849+0000 7f7ba2f75700 1 -- 172.21.15.153:0/1189532479 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f7b9c06f5f0 con 0x7f7b9c169880 2024-08-17T02:26:17.852 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.849+0000 7f6d89606700 1 -- 172.21.15.153:0/264208460 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f6d8415d800 con 0x7f6d840c3170 2024-08-17T02:26:17.852 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.849+0000 7f6d6bfff700 1 -- 172.21.15.153:0/264208460 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6d8415d800 con 0x7f6d840c3170 2024-08-17T02:26:17.852 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.849+0000 7f7b91ffb700 1 -- 172.21.15.153:0/1189532479 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7b9804fc10 con 0x7f7b9c169880 2024-08-17T02:26:17.852 INFO:teuthology.orchestra.run.smithi153.stdout:64424509445 2024-08-17T02:26:17.852 INFO:teuthology.orchestra.run.smithi153.stdout:64424509446 2024-08-17T02:26:17.853 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.4 2024-08-17T02:26:17.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.849+0000 7f6d89606700 1 -- 172.21.15.153:0/264208460 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6d70060890 msgr2=0x7f6d70062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.849+0000 7f6d89606700 1 --2- 172.21.15.153:0/264208460 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6d70060890 0x7f6d70062d40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6d7400a9d0 tx=0x7f6d7400c040 comp rx=0 tx=0).stop 2024-08-17T02:26:17.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.849+0000 7f6d89606700 1 -- 172.21.15.153:0/264208460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d840c3170 msgr2=0x7f6d84170e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.849+0000 7f6d89606700 1 --2- 172.21.15.153:0/264208460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d840c3170 0x7f6d84170e10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c003000 tx=0x7f6d7c017000 comp rx=0 tx=0).stop 2024-08-17T02:26:17.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.849+0000 7f6d89606700 1 -- 172.21.15.153:0/264208460 shutdown_connections 2024-08-17T02:26:17.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.849+0000 7f6d89606700 1 --2- 172.21.15.153:0/264208460 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6d70060890 0x7f6d70062d40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.849+0000 7f6d89606700 1 --2- 172.21.15.153:0/264208460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d840c3170 0x7f6d84170e10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.849+0000 7f6d89606700 1 --2- 172.21.15.153:0/264208460 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6d8413ea80 0x7f6d840c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.849+0000 7f6d89606700 1 --2- 172.21.15.153:0/264208460 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d8413e6b0 0x7f6d8413d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.849+0000 7f6d89606700 1 -- 172.21.15.153:0/264208460 >> 172.21.15.153:0/264208460 conn(0x7f6d840678d0 msgr2=0x7f6d840ca4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.849+0000 7f6d89606700 1 -- 172.21.15.153:0/264208460 shutdown_connections 2024-08-17T02:26:17.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.849+0000 7f6d89606700 1 -- 172.21.15.153:0/264208460 wait complete. 2024-08-17T02:26:17.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.853+0000 7f7ba2f75700 1 -- 172.21.15.153:0/1189532479 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7b80060860 msgr2=0x7f7b80062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.853+0000 7f7ba2f75700 1 --2- 172.21.15.153:0/1189532479 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7b80060860 0x7f7b80062d10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c009d40 tx=0x7f7b8c008040 comp rx=0 tx=0).stop 2024-08-17T02:26:17.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.853+0000 7f7ba2f75700 1 -- 172.21.15.153:0/1189532479 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b9c169880 msgr2=0x7f7b9c15aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.853+0000 7f7ba2f75700 1 --2- 172.21.15.153:0/1189532479 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b9c169880 0x7f7b9c15aa80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7b9800bb10 tx=0x7f7b9800f040 comp rx=0 tx=0).stop 2024-08-17T02:26:17.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.853+0000 7f7ba2f75700 1 -- 172.21.15.153:0/1189532479 shutdown_connections 2024-08-17T02:26:17.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.853+0000 7f7ba2f75700 1 --2- 172.21.15.153:0/1189532479 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7b80060860 0x7f7b80062d10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.853+0000 7f7ba2f75700 1 --2- 172.21.15.153:0/1189532479 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b9c169880 0x7f7b9c15aa80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.853+0000 7f7ba2f75700 1 --2- 172.21.15.153:0/1189532479 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b9c06e2e0 0x7f7b9c15a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.853+0000 7f7ba2f75700 1 --2- 172.21.15.153:0/1189532479 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b9c06df10 0x7f7b9c0874d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.853+0000 7f7ba2f75700 1 -- 172.21.15.153:0/1189532479 >> 172.21.15.153:0/1189532479 conn(0x7f7b9c0678d0 msgr2=0x7f7b9c161b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.857 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.3 2024-08-17T02:26:17.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.853+0000 7f7ba2f75700 1 -- 172.21.15.153:0/1189532479 shutdown_connections 2024-08-17T02:26:17.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.853+0000 7f7ba2f75700 1 -- 172.21.15.153:0/1189532479 wait complete. 2024-08-17T02:26:17.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.853+0000 7fbffc9c4700 1 -- 172.21.15.153:0/2437953763 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbfdc005560 con 0x7fbff8155050 2024-08-17T02:26:17.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.853+0000 7fbfe67fc700 1 -- 172.21.15.153:0/2437953763 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbff0009940 con 0x7fbff8155050 2024-08-17T02:26:17.858 INFO:teuthology.orchestra.run.smithi153.stdout:60129542150 2024-08-17T02:26:17.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.857+0000 7fbffc9c4700 1 -- 172.21.15.153:0/2437953763 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fbfd80609b0 msgr2=0x7fbfd8062e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.857+0000 7fbffc9c4700 1 --2- 172.21.15.153:0/2437953763 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fbfd80609b0 0x7fbfd8062e60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8006fd0 tx=0x7fbfe8009060 comp rx=0 tx=0).stop 2024-08-17T02:26:17.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.857+0000 7fbffc9c4700 1 -- 172.21.15.153:0/2437953763 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbff8155050 msgr2=0x7fbff80972c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.857+0000 7fbffc9c4700 1 --2- 172.21.15.153:0/2437953763 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbff8155050 0x7fbff80972c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbff000d000 tx=0x7fbff001c000 comp rx=0 tx=0).stop 2024-08-17T02:26:17.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.857+0000 7fbffc9c4700 1 -- 172.21.15.153:0/2437953763 shutdown_connections 2024-08-17T02:26:17.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.857+0000 7fbffc9c4700 1 --2- 172.21.15.153:0/2437953763 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fbfd80609b0 0x7fbfd8062e60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.857+0000 7fbffc9c4700 1 --2- 172.21.15.153:0/2437953763 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbff8155050 0x7fbff80972c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.857+0000 7fbffc9c4700 1 --2- 172.21.15.153:0/2437953763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbff80ae370 0x7fbff80969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.857+0000 7fbffc9c4700 1 --2- 172.21.15.153:0/2437953763 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbff80aab50 0x7fbff80993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.857+0000 7fbffc9c4700 1 -- 172.21.15.153:0/2437953763 >> 172.21.15.153:0/2437953763 conn(0x7fbff8068320 msgr2=0x7fbff806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.857+0000 7fbffc9c4700 1 -- 172.21.15.153:0/2437953763 shutdown_connections 2024-08-17T02:26:17.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:17.857+0000 7fbffc9c4700 1 -- 172.21.15.153:0/2437953763 wait complete. 2024-08-17T02:26:17.864 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.1 2024-08-17T02:26:17.870 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.2 2024-08-17T02:26:17.871 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.5 2024-08-17T02:26:17.872 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.7 2024-08-17T02:26:18.839 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-17T02:26:18.842 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-17T02:26:18.854 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-17T02:26:18.858 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-17T02:26:18.865 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-17T02:26:18.871 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-17T02:26:18.872 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-17T02:26:18.872 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-17T02:26:18.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.961+0000 7f7944c14700 1 Processor -- start 2024-08-17T02:26:18.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.961+0000 7f7944c14700 1 -- start start 2024-08-17T02:26:18.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.961+0000 7f7944c14700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f794013b630 0x7f79400b1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:18.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.961+0000 7f7944c14700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f794013bf10 0x7f794006df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:18.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.961+0000 7f7944c14700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f794013cf90 con 0x7f79400b1950 2024-08-17T02:26:18.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.961+0000 7f7944c14700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f794013c380 con 0x7f794013b630 2024-08-17T02:26:18.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.961+0000 7f7944c14700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f794013c660 con 0x7f794013bf10 2024-08-17T02:26:18.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.961+0000 7f793e59c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f794013b630 0x7f79400b1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:18.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.961+0000 7f793e59c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f794013b630 0x7f79400b1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57586/0 (socket says 172.21.15.153:57586) 2024-08-17T02:26:18.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.961+0000 7f793e59c700 1 -- 172.21.15.153:0/4052068022 learned_addr learned my addr 172.21.15.153:0/4052068022 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:18.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.961+0000 7f793e59c700 1 -- 172.21.15.153:0/4052068022 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f794013bf10 msgr2=0x7f794006df10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:26:18.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.961+0000 7f793e59c700 1 --2- 172.21.15.153:0/4052068022 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f794013bf10 0x7f794006df10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.961+0000 7f793e59c700 1 -- 172.21.15.153:0/4052068022 >> v1:172.21.15.153:6789/0 conn(0x7f79400b1950 legacy=0x7f7940158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:18.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.961+0000 7f793e59c700 1 -- 172.21.15.153:0/4052068022 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794013c940 con 0x7f794013b630 2024-08-17T02:26:18.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.965+0000 7f793e59c700 1 --2- 172.21.15.153:0/4052068022 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f794013b630 0x7f79400b1410 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f793800d1a0 tx=0x7f7938007690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af94a861532551fa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:18.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.965+0000 7f793d59a700 1 -- 172.21.15.153:0/4052068022 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7938010070 con 0x7f794013b630 2024-08-17T02:26:18.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.965+0000 7f793d59a700 1 -- 172.21.15.153:0/4052068022 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793800dcb0 con 0x7f794013b630 2024-08-17T02:26:18.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.965+0000 7f7944c14700 1 -- 172.21.15.153:0/4052068022 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f794013b630 msgr2=0x7f79400b1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:18.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.965+0000 7f7944c14700 1 --2- 172.21.15.153:0/4052068022 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f794013b630 0x7f79400b1410 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f793800d1a0 tx=0x7f7938007690 comp rx=0 tx=0).stop 2024-08-17T02:26:18.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.965+0000 7f7944c14700 1 -- 172.21.15.153:0/4052068022 shutdown_connections 2024-08-17T02:26:18.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.965+0000 7f7944c14700 1 --2- 172.21.15.153:0/4052068022 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f794013bf10 0x7f794006df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.965+0000 7f7944c14700 1 --2- 172.21.15.153:0/4052068022 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f794013b630 0x7f79400b1410 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.965+0000 7f7944c14700 1 -- 172.21.15.153:0/4052068022 >> 172.21.15.153:0/4052068022 conn(0x7f79400678d0 msgr2=0x7f7940067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:18.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.965+0000 7f7944c14700 1 -- 172.21.15.153:0/4052068022 shutdown_connections 2024-08-17T02:26:18.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.965+0000 7f7944c14700 1 -- 172.21.15.153:0/4052068022 wait complete. 2024-08-17T02:26:18.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.969+0000 7f7944c14700 1 Processor -- start 2024-08-17T02:26:18.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.965+0000 7fa94f1a1700 1 Processor -- start 2024-08-17T02:26:18.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.969+0000 7f7944c14700 1 -- start start 2024-08-17T02:26:18.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.969+0000 7f7944c14700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79400b1950 0x7f7940170860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:18.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.969+0000 7f7944c14700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f794013b630 0x7f7940150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:18.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.969+0000 7f7944c14700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f794013bf10 0x7f79401513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:18.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.969+0000 7f7944c14700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79401396f0 con 0x7f79400b1950 2024-08-17T02:26:18.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.969+0000 7f7944c14700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7940138ae0 con 0x7f794013b630 2024-08-17T02:26:18.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.969+0000 7f7944c14700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7940138dc0 con 0x7f794013bf10 2024-08-17T02:26:18.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.969+0000 7f793e59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79400b1950 0x7f7940170860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:18.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.969+0000 7f793e59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79400b1950 0x7f7940170860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57612/0 (socket says 172.21.15.153:57612) 2024-08-17T02:26:18.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.969+0000 7f793e59c700 1 -- 172.21.15.153:0/2260623873 learned_addr learned my addr 172.21.15.153:0/2260623873 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:18.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.965+0000 7fa94f1a1700 1 -- start start 2024-08-17T02:26:18.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.969+0000 7fa94f1a1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9480cb9c0 0x7fa948069910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:18.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.969+0000 7fa94f1a1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa94806b870 0x7fa94815cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:18.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.969+0000 7fa94f1a1700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9480af2e0 con 0x7fa9480677e0 2024-08-17T02:26:18.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.969+0000 7fa94f1a1700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9480af5c0 con 0x7fa94806b870 2024-08-17T02:26:18.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.969+0000 7fa94f1a1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa948068060 con 0x7fa9480cb9c0 2024-08-17T02:26:18.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.969+0000 7fa94cf3d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9480cb9c0 0x7fa948069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:18.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.969+0000 7fa94cf3d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9480cb9c0 0x7fa948069910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.153:34926/0 (socket says 172.21.15.153:34926) 2024-08-17T02:26:18.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.969+0000 7fa94cf3d700 1 -- 172.21.15.153:0/3969449366 learned_addr learned my addr 172.21.15.153:0/3969449366 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:18.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.969+0000 7fa94d73e700 1 --2- 172.21.15.153:0/3969449366 >> v2:172.21.15.153:3300/0 conn(0x7fa94806b870 0x7fa94815cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:18.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.969+0000 7fa94cf3d700 1 -- 172.21.15.153:0/3969449366 >> v2:172.21.15.153:3300/0 conn(0x7fa94806b870 msgr2=0x7fa94815cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:18.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.969+0000 7fa94cf3d700 1 --2- 172.21.15.153:0/3969449366 >> v2:172.21.15.153:3300/0 conn(0x7fa94806b870 0x7fa94815cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.969+0000 7fa94cf3d700 1 -- 172.21.15.153:0/3969449366 >> v1:172.21.15.174:6789/0 conn(0x7fa9480677e0 legacy=0x7fa94806b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:18.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.969+0000 7fa94cf3d700 1 -- 172.21.15.153:0/3969449366 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa948068340 con 0x7fa9480cb9c0 2024-08-17T02:26:18.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.969+0000 7f793ed9d700 1 --2- 172.21.15.153:0/2260623873 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f794013bf10 0x7f79401513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:18.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.969+0000 7f793dd9b700 1 --2- 172.21.15.153:0/2260623873 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f794013b630 0x7f7940150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:18.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.969+0000 7fa94d73e700 1 --2- 172.21.15.153:0/3969449366 >> v2:172.21.15.153:3300/0 conn(0x7fa94806b870 0x7fa94815cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:18.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.969+0000 7f793e59c700 1 -- 172.21.15.153:0/2260623873 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f794013bf10 msgr2=0x7f79401513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:18.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.969+0000 7f793e59c700 1 --2- 172.21.15.153:0/2260623873 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f794013bf10 0x7f79401513b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.969+0000 7f793e59c700 1 -- 172.21.15.153:0/2260623873 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f794013b630 msgr2=0x7f7940150e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:18.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.969+0000 7f793e59c700 1 --2- 172.21.15.153:0/2260623873 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f794013b630 0x7f7940150e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.969+0000 7f793e59c700 1 -- 172.21.15.153:0/2260623873 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793800be70 con 0x7f79400b1950 2024-08-17T02:26:18.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.969+0000 7fa94cf3d700 1 --2- 172.21.15.153:0/3969449366 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9480cb9c0 0x7fa948069910 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa940009f20 tx=0x7fa940009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31eec6189e648319 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:18.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.969+0000 7f793e59c700 1 --2- 172.21.15.153:0/2260623873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79400b1950 0x7f7940170860 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7938007ff0 tx=0x7f793801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:18.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.969+0000 7fa9477fe700 1 -- 172.21.15.153:0/3969449366 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94000e070 con 0x7fa9480cb9c0 2024-08-17T02:26:18.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.969+0000 7fa9477fe700 1 -- 172.21.15.153:0/3969449366 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94000ba80 con 0x7fa9480cb9c0 2024-08-17T02:26:18.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.969+0000 7fa9477fe700 1 -- 172.21.15.153:0/3969449366 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9400092e0 con 0x7fa9480cb9c0 2024-08-17T02:26:18.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.973+0000 7f792e7fc700 1 -- 172.21.15.153:0/2260623873 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7938020460 con 0x7f79400b1950 2024-08-17T02:26:18.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.973+0000 7f792e7fc700 1 -- 172.21.15.153:0/2260623873 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79380205c0 con 0x7f79400b1950 2024-08-17T02:26:18.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.973+0000 7fa94f1a1700 1 -- 172.21.15.153:0/3969449366 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9480cb9c0 msgr2=0x7fa948069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:18.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.973+0000 7fa94f1a1700 1 --2- 172.21.15.153:0/3969449366 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9480cb9c0 0x7fa948069910 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa940009f20 tx=0x7fa940009840 comp rx=0 tx=0).stop 2024-08-17T02:26:18.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.973+0000 7f7944c14700 1 -- 172.21.15.153:0/2260623873 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79401390a0 con 0x7f79400b1950 2024-08-17T02:26:18.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.973+0000 7f7944c14700 1 -- 172.21.15.153:0/2260623873 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7940170da0 con 0x7f79400b1950 2024-08-17T02:26:18.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.973+0000 7f792e7fc700 1 -- 172.21.15.153:0/2260623873 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7938020980 con 0x7f79400b1950 2024-08-17T02:26:18.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.973+0000 7fa94f1a1700 1 -- 172.21.15.153:0/3969449366 shutdown_connections 2024-08-17T02:26:18.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.973+0000 7fa94f1a1700 1 --2- 172.21.15.153:0/3969449366 >> v2:172.21.15.153:3300/0 conn(0x7fa94806b870 0x7fa94815cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.973+0000 7fa94f1a1700 1 --2- 172.21.15.153:0/3969449366 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9480cb9c0 0x7fa948069910 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.973+0000 7fa94f1a1700 1 -- 172.21.15.153:0/3969449366 >> 172.21.15.153:0/3969449366 conn(0x7fa9480ccb80 msgr2=0x7fa9480a8f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:18.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.973+0000 7fa94f1a1700 1 -- 172.21.15.153:0/3969449366 shutdown_connections 2024-08-17T02:26:18.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.973+0000 7fa94f1a1700 1 -- 172.21.15.153:0/3969449366 wait complete. 2024-08-17T02:26:18.981 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.973+0000 7f7944c14700 1 -- 172.21.15.153:0/2260623873 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79400643a0 con 0x7f79400b1950 2024-08-17T02:26:18.981 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.977+0000 7f792e7fc700 1 -- 172.21.15.153:0/2260623873 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7938016440 con 0x7f79400b1950 2024-08-17T02:26:18.981 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.977+0000 7fa94f1a1700 1 Processor -- start 2024-08-17T02:26:18.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.977+0000 7f792e7fc700 1 --2- 172.21.15.153:0/2260623873 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7920060930 0x7f7920062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:18.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.977+0000 7f792e7fc700 1 -- 172.21.15.153:0/2260623873 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f793807e860 con 0x7f79400b1950 2024-08-17T02:26:18.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.977+0000 7f793dd9b700 1 --2- 172.21.15.153:0/2260623873 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7920060930 0x7f7920062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:18.983 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.977+0000 7fa94f1a1700 1 -- start start 2024-08-17T02:26:18.983 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.977+0000 7fa94f1a1700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9480677e0 0x7fa9480973a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:18.983 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.977+0000 7fa94f1a1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa94806b870 0x7fa94813dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:18.983 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.977+0000 7fa94f1a1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9480cb9c0 0x7fa948150670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:18.984 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.977+0000 7fa94f1a1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94813e5a0 con 0x7fa94806b870 2024-08-17T02:26:18.984 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.977+0000 7fa94f1a1700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94813a3f0 con 0x7fa9480677e0 2024-08-17T02:26:18.984 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.977+0000 7fa94f1a1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa948099880 con 0x7fa9480cb9c0 2024-08-17T02:26:18.984 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.977+0000 7fa947fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa94806b870 0x7fa94813dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:18.984 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.977+0000 7fa94cf3d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9480677e0 0x7fa9480973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:18.984 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.977+0000 7fa94d73e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9480cb9c0 0x7fa948150670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:18.984 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.977+0000 7fa94cf3d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9480677e0 0x7fa9480973a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.153:49670/0 (socket says 172.21.15.153:49670) 2024-08-17T02:26:18.984 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.977+0000 7fa94cf3d700 1 -- 172.21.15.153:0/1812611743 learned_addr learned my addr 172.21.15.153:0/1812611743 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:18.984 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.977+0000 7fa94d73e700 1 -- 172.21.15.153:0/1812611743 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9480677e0 msgr2=0x7fa9480973a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:18.984 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.977+0000 7fa94d73e700 1 --2- 172.21.15.153:0/1812611743 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9480677e0 0x7fa9480973a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.984 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.977+0000 7fa94d73e700 1 -- 172.21.15.153:0/1812611743 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa94806b870 msgr2=0x7fa94813dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:18.984 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.977+0000 7fa94d73e700 1 --2- 172.21.15.153:0/1812611743 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa94806b870 0x7fa94813dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.984 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.977+0000 7fa94d73e700 1 -- 172.21.15.153:0/1812611743 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa940009ae0 con 0x7fa9480cb9c0 2024-08-17T02:26:18.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.977+0000 7fa947fff700 1 --2- 172.21.15.153:0/1812611743 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa94806b870 0x7fa94813dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:18.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.977+0000 7fa94d73e700 1 --2- 172.21.15.153:0/1812611743 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9480cb9c0 0x7fa948150670 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa93800c8b0 tx=0x7fa938008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:18.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.981+0000 7f793dd9b700 1 --2- 172.21.15.153:0/2260623873 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7920060930 0x7f7920062de0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7940154fd0 tx=0x7f7934009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:18.986 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.981+0000 7fa944ff9700 1 -- 172.21.15.153:0/1812611743 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa938011600 con 0x7fa9480cb9c0 2024-08-17T02:26:18.986 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.981+0000 7fa94f1a1700 1 -- 172.21.15.153:0/1812611743 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9480afbf0 con 0x7fa9480cb9c0 2024-08-17T02:26:18.986 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.981+0000 7fa94f1a1700 1 -- 172.21.15.153:0/1812611743 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9480b01b0 con 0x7fa9480cb9c0 2024-08-17T02:26:18.986 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.981+0000 7fa944ff9700 1 -- 172.21.15.153:0/1812611743 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa938011760 con 0x7fa9480cb9c0 2024-08-17T02:26:18.986 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.981+0000 7fa944ff9700 1 -- 172.21.15.153:0/1812611743 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa938011b00 con 0x7fa9480cb9c0 2024-08-17T02:26:18.986 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.981+0000 7fa944ff9700 1 -- 172.21.15.153:0/1812611743 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa9380193a0 con 0x7fa9480cb9c0 2024-08-17T02:26:18.986 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.985+0000 7fa944ff9700 1 --2- 172.21.15.153:0/1812611743 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fa9340609b0 0x7fa934062e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:18.987 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.985+0000 7f792e7fc700 1 -- 172.21.15.153:0/2260623873 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f793804ec10 con 0x7f79400b1950 2024-08-17T02:26:18.987 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.985+0000 7fa94cf3d700 1 --2- 172.21.15.153:0/1812611743 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fa9340609b0 0x7fa934062e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:18.987 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.985+0000 7fa94cf3d700 1 --2- 172.21.15.153:0/1812611743 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fa9340609b0 0x7fa934062e60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa940012000 tx=0x7fa940018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:18.987 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.985+0000 7fa944ff9700 1 -- 172.21.15.153:0/1812611743 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa93807cb20 con 0x7fa9480cb9c0 2024-08-17T02:26:18.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.985+0000 7fa94f1a1700 1 -- 172.21.15.153:0/1812611743 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9280052b0 con 0x7fa9480cb9c0 2024-08-17T02:26:19.000 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:18.997+0000 7fa944ff9700 1 -- 172.21.15.153:0/1812611743 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa93804cf50 con 0x7fa9480cb9c0 2024-08-17T02:26:19.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fd3098d0700 1 Processor -- start 2024-08-17T02:26:19.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fd3098d0700 1 -- start start 2024-08-17T02:26:19.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fd3098d0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd30413b630 0x7fd3040b1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fd3098d0700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd30413bf10 0x7fd30406df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fd3098d0700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd30413cf90 con 0x7fd3040b1950 2024-08-17T02:26:19.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fd3098d0700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd30413c380 con 0x7fd30413bf10 2024-08-17T02:26:19.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fd3098d0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd30413c660 con 0x7fd30413b630 2024-08-17T02:26:19.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fa4dd254700 1 Processor -- start 2024-08-17T02:26:19.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fd3037fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fd3040b1950 0x7fd304158db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35780/0 (socket says 172.21.15.153:35780) 2024-08-17T02:26:19.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fd3037fe700 1 -- 172.21.15.153:0/1027238089 learned_addr learned my addr 172.21.15.153:0/1027238089 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:19.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fd3027fc700 1 --2- 172.21.15.153:0/1027238089 >> v2:172.21.15.153:3300/0 conn(0x7fd30413bf10 0x7fd30406df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fd302ffd700 1 --2- 172.21.15.153:0/1027238089 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd30413b630 0x7fd3040b1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fd3027fc700 1 -- 172.21.15.153:0/1027238089 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd30413b630 msgr2=0x7fd3040b1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:19.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fd3027fc700 1 --2- 172.21.15.153:0/1027238089 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd30413b630 0x7fd3040b1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fd3027fc700 1 -- 172.21.15.153:0/1027238089 >> v1:172.21.15.153:6789/0 conn(0x7fd3040b1950 legacy=0x7fd304158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fd3027fc700 1 -- 172.21.15.153:0/1027238089 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd30413c940 con 0x7fd30413bf10 2024-08-17T02:26:19.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fd3027fc700 1 --2- 172.21.15.153:0/1027238089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd30413bf10 0x7fd30406df10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd2f800bdf0 tx=0x7fd2f800b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae0bb9d04fa5f43 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:19.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fc6562e1700 1 Processor -- start 2024-08-17T02:26:19.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fc6562e1700 1 -- start start 2024-08-17T02:26:19.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fd301ffb700 1 -- 172.21.15.153:0/1027238089 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f80173f0 con 0x7fd30413bf10 2024-08-17T02:26:19.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fa4dd254700 1 -- start start 2024-08-17T02:26:19.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fa4dd254700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa4d813b630 0x7fa4d80b1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fa4dd254700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4d813bf10 0x7fa4d806df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fa4dd254700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d813cf90 con 0x7fa4d80b1950 2024-08-17T02:26:19.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fa4dd254700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d813c380 con 0x7fa4d813b630 2024-08-17T02:26:19.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fa4dd254700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d813c660 con 0x7fa4d813bf10 2024-08-17T02:26:19.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fd301ffb700 1 -- 172.21.15.153:0/1027238089 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f8017550 con 0x7fd30413bf10 2024-08-17T02:26:19.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fa4d759e700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fa4d80b1950 0x7fa4d8158db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35786/0 (socket says 172.21.15.153:35786) 2024-08-17T02:26:19.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fa4d759e700 1 -- 172.21.15.153:0/3359214074 learned_addr learned my addr 172.21.15.153:0/3359214074 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:19.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fc6562e1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc6500cb5e0 0x7fc6500b1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fc6562e1700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc650141d00 con 0x7fc650140c60 2024-08-17T02:26:19.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fc6562e1700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6501410f0 con 0x7fc6500af190 2024-08-17T02:26:19.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fc6562e1700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc65015da40 con 0x7fc6500cb5e0 2024-08-17T02:26:19.036 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fa4d659c700 1 --2- 172.21.15.153:0/3359214074 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4d813bf10 0x7fa4d806df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.036 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fc64f7fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc650140c60 0x7fc6500aea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35790/0 (socket says 172.21.15.153:35790) 2024-08-17T02:26:19.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fc64f7fe700 1 -- 172.21.15.153:0/1380413574 learned_addr learned my addr 172.21.15.153:0/1380413574 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:19.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fa4d6d9d700 1 --2- 172.21.15.153:0/3359214074 >> v2:172.21.15.174:3300/0 conn(0x7fa4d813b630 0x7fa4d80b1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fa4d5d9b700 1 -- 172.21.15.153:0/3359214074 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1875954451 0 0) 0x7fa4d813cf90 con 0x7fa4d80b1950 2024-08-17T02:26:19.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fa4d5d9b700 1 -- 172.21.15.153:0/3359214074 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4c0003490 con 0x7fa4d80b1950 2024-08-17T02:26:19.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fc64ffff700 1 --2- 172.21.15.153:0/1380413574 >> v2:172.21.15.153:3300/0 conn(0x7fc6500cb5e0 0x7fc6500b1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.025+0000 7fd301ffb700 1 -- 172.21.15.153:0/1027238089 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f80173f0 con 0x7fd30413bf10 2024-08-17T02:26:19.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fd3098d0700 1 -- 172.21.15.153:0/1027238089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd30413bf10 msgr2=0x7fd30406df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fd3098d0700 1 --2- 172.21.15.153:0/1027238089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd30413bf10 0x7fd30406df10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd2f800bdf0 tx=0x7fd2f800b430 comp rx=0 tx=0).stop 2024-08-17T02:26:19.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fa4d659c700 1 -- 172.21.15.153:0/3359214074 >> v2:172.21.15.174:3300/0 conn(0x7fa4d813b630 msgr2=0x7fa4d80b1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:19.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fd3098d0700 1 -- 172.21.15.153:0/1027238089 shutdown_connections 2024-08-17T02:26:19.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fd3098d0700 1 --2- 172.21.15.153:0/1027238089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd30413bf10 0x7fd30406df10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fd3098d0700 1 --2- 172.21.15.153:0/1027238089 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd30413b630 0x7fd3040b1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fd3098d0700 1 -- 172.21.15.153:0/1027238089 >> 172.21.15.153:0/1027238089 conn(0x7fd3040678d0 msgr2=0x7fd304067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:19.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fa4d5d9b700 1 -- 172.21.15.153:0/3359214074 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2174873957 0 0) 0x7fa4c0003490 con 0x7fa4d80b1950 2024-08-17T02:26:19.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fa4d659c700 1 --2- 172.21.15.153:0/3359214074 >> v2:172.21.15.174:3300/0 conn(0x7fa4d813b630 0x7fa4d80b1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fa4d659c700 1 -- 172.21.15.153:0/3359214074 >> v1:172.21.15.153:6789/0 conn(0x7fa4d80b1950 legacy=0x7fa4d8158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fa4d659c700 1 -- 172.21.15.153:0/3359214074 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d813c940 con 0x7fa4d813bf10 2024-08-17T02:26:19.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fc64ffff700 1 -- 172.21.15.153:0/1380413574 >> v1:172.21.15.174:6789/0 conn(0x7fc6500af190 legacy=0x7fc650142190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7f7633f90700 1 Processor -- start 2024-08-17T02:26:19.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fd3098d0700 1 -- 172.21.15.153:0/1027238089 shutdown_connections 2024-08-17T02:26:19.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fa4d6d9d700 1 --2- 172.21.15.153:0/3359214074 >> v2:172.21.15.174:3300/0 conn(0x7fa4d813b630 0x7fa4d80b1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:19.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fd3098d0700 1 -- 172.21.15.153:0/1027238089 wait complete. 2024-08-17T02:26:19.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fc64ffff700 1 -- 172.21.15.153:0/1380413574 >> v1:172.21.15.153:6789/0 conn(0x7fc650140c60 legacy=0x7fc6500aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fc64ffff700 1 -- 172.21.15.153:0/1380413574 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6501413d0 con 0x7fc6500cb5e0 2024-08-17T02:26:19.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fa4d659c700 1 --2- 172.21.15.153:0/3359214074 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4d813bf10 0x7fa4d806df10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0009e60 tx=0x7fa4d0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61f8947185d2aa0c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:19.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fc64ffff700 1 --2- 172.21.15.153:0/1380413574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6500cb5e0 0x7fc6500b1580 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc648009e60 tx=0x7fc648009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83a74dadab1e8f3d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:19.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fc64effd700 1 -- 172.21.15.153:0/1380413574 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64800e070 con 0x7fc6500cb5e0 2024-08-17T02:26:19.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fc64effd700 1 -- 172.21.15.153:0/1380413574 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64800bb30 con 0x7fc6500cb5e0 2024-08-17T02:26:19.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fc64effd700 1 -- 172.21.15.153:0/1380413574 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc648012430 con 0x7fc6500cb5e0 2024-08-17T02:26:19.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fa4d5d9b700 1 -- 172.21.15.153:0/3359214074 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d000e070 con 0x7fa4d813bf10 2024-08-17T02:26:19.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fa4d5d9b700 1 -- 172.21.15.153:0/3359214074 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d000b7a0 con 0x7fa4d813bf10 2024-08-17T02:26:19.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fa4d5d9b700 1 -- 172.21.15.153:0/3359214074 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc004b20 con 0x7fa4d813bf10 2024-08-17T02:26:19.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7f7633f90700 1 -- start start 2024-08-17T02:26:19.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7f7633f90700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f762c06e400 0x7f762c0b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7f7633f90700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f762c06e7d0 0x7f762c0b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7f7633f90700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f762c15da10 con 0x7f762c146690 2024-08-17T02:26:19.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7f7633f90700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f762c1444a0 con 0x7f762c06e400 2024-08-17T02:26:19.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7f7633f90700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f762c144170 con 0x7f762c06e7d0 2024-08-17T02:26:19.046 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fa4dd254700 1 -- 172.21.15.153:0/3359214074 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4d813bf10 msgr2=0x7fa4d806df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.046 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fa4dd254700 1 --2- 172.21.15.153:0/3359214074 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4d813bf10 0x7fa4d806df10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0009e60 tx=0x7fa4d0009780 comp rx=0 tx=0).stop 2024-08-17T02:26:19.046 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7f763252d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f762c146690 0x7f762c161130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35798/0 (socket says 172.21.15.153:35798) 2024-08-17T02:26:19.046 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7f763252d700 1 -- 172.21.15.153:0/3657596312 learned_addr learned my addr 172.21.15.153:0/3657596312 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:19.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7f7631d2c700 1 --2- 172.21.15.153:0/3657596312 >> v2:172.21.15.153:3300/0 conn(0x7f762c06e400 0x7f762c0b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fd3098d0700 1 Processor -- start 2024-08-17T02:26:19.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fa4dd254700 1 -- 172.21.15.153:0/3359214074 shutdown_connections 2024-08-17T02:26:19.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fa4dd254700 1 --2- 172.21.15.153:0/3359214074 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4d813bf10 0x7fa4d806df10 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fa4dd254700 1 --2- 172.21.15.153:0/3359214074 >> v2:172.21.15.174:3300/0 conn(0x7fa4d813b630 0x7fa4d80b1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fa4dd254700 1 -- 172.21.15.153:0/3359214074 >> 172.21.15.153:0/3359214074 conn(0x7fa4d80678d0 msgr2=0x7fa4d8067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:19.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fc6562e1700 1 -- 172.21.15.153:0/1380413574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6500cb5e0 msgr2=0x7fc6500b1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fc6562e1700 1 --2- 172.21.15.153:0/1380413574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6500cb5e0 0x7fc6500b1580 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc648009e60 tx=0x7fc648009780 comp rx=0 tx=0).stop 2024-08-17T02:26:19.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fc6562e1700 1 -- 172.21.15.153:0/1380413574 shutdown_connections 2024-08-17T02:26:19.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fc6562e1700 1 --2- 172.21.15.153:0/1380413574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6500cb5e0 0x7fc6500b1580 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fc6562e1700 1 -- 172.21.15.153:0/1380413574 >> 172.21.15.153:0/1380413574 conn(0x7fc6500678d0 msgr2=0x7fc650067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:19.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fd3098d0700 1 -- start start 2024-08-17T02:26:19.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fc6562e1700 1 -- 172.21.15.153:0/1380413574 shutdown_connections 2024-08-17T02:26:19.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7f7631d2c700 1 -- 172.21.15.153:0/3657596312 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f762c06e7d0 msgr2=0x7f762c0b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:19.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7f7631d2c700 1 --2- 172.21.15.153:0/3657596312 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f762c06e7d0 0x7f762c0b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7f7631d2c700 1 -- 172.21.15.153:0/3657596312 >> v1:172.21.15.153:6789/0 conn(0x7f762c146690 legacy=0x7f762c161130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7f7631d2c700 1 -- 172.21.15.153:0/3657596312 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f762c0b15a0 con 0x7f762c06e400 2024-08-17T02:26:19.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7f7631d2c700 1 --2- 172.21.15.153:0/3657596312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f762c06e400 0x7f762c0b0a50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f76280098e0 tx=0x7f76280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f805c092a348dbf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:19.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7f7630d2a700 1 -- 172.21.15.153:0/3657596312 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7628009e80 con 0x7f762c06e400 2024-08-17T02:26:19.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7f7630d2a700 1 -- 172.21.15.153:0/3657596312 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762800b760 con 0x7f762c06e400 2024-08-17T02:26:19.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7f7630d2a700 1 -- 172.21.15.153:0/3657596312 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762800bae0 con 0x7f762c06e400 2024-08-17T02:26:19.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fd3098d0700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3040b1950 0x7fd30413a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fd3098d0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd30413b630 0x7fd30415ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fd3098d0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd30415d3f0 0x7fd30415d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fd3098d0700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3041535d0 con 0x7fd30415d3f0 2024-08-17T02:26:19.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fd3098d0700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30415e800 con 0x7fd3040b1950 2024-08-17T02:26:19.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fd3098d0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd304153890 con 0x7fd30413b630 2024-08-17T02:26:19.052 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.029+0000 7fc6562e1700 1 -- 172.21.15.153:0/1380413574 wait complete. 2024-08-17T02:26:19.052 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7fd3037fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd30415d3f0 0x7fd30415d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.052 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7fd3027fc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd30413b630 0x7fd30415ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.052 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7fd3037fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd30415d3f0 0x7fd30415d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57670/0 (socket says 172.21.15.153:57670) 2024-08-17T02:26:19.052 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7fd3037fe700 1 -- 172.21.15.153:0/4076346322 learned_addr learned my addr 172.21.15.153:0/4076346322 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:19.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7f7633f90700 1 -- 172.21.15.153:0/3657596312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f762c06e400 msgr2=0x7f762c0b0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7f7633f90700 1 --2- 172.21.15.153:0/3657596312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f762c06e400 0x7f762c0b0a50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f76280098e0 tx=0x7f76280091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7fc6562e1700 1 Processor -- start 2024-08-17T02:26:19.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7fa4dd254700 1 -- 172.21.15.153:0/3359214074 shutdown_connections 2024-08-17T02:26:19.054 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7fc6562e1700 1 -- start start 2024-08-17T02:26:19.054 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7fd3037fe700 1 -- 172.21.15.153:0/4076346322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd30413b630 msgr2=0x7fd30415ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.054 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7fd3037fe700 1 --2- 172.21.15.153:0/4076346322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd30413b630 0x7fd30415ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.054 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7fd3037fe700 1 -- 172.21.15.153:0/4076346322 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3040b1950 msgr2=0x7fd30413a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7fd3037fe700 1 --2- 172.21.15.153:0/4076346322 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3040b1950 0x7fd30413a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7fd3037fe700 1 -- 172.21.15.153:0/4076346322 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f800b6d0 con 0x7fd30415d3f0 2024-08-17T02:26:19.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7fa4dd254700 1 -- 172.21.15.153:0/3359214074 wait complete. 2024-08-17T02:26:19.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7fd3037fe700 1 --2- 172.21.15.153:0/4076346322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd30415d3f0 0x7fd30415d890 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd2f400d9c0 tx=0x7fd2f400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:19.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7fc6562e1700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6500af190 0x7fc65015ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7fc6562e1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc6500cb5e0 0x7fc6501610c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7fa4dd254700 1 Processor -- start 2024-08-17T02:26:19.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7fc6562e1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc650140c60 0x7fc65015f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7fc6562e1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65015b5a0 con 0x7fc650140c60 2024-08-17T02:26:19.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7fc6562e1700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65017a270 con 0x7fc6500af190 2024-08-17T02:26:19.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7fc6562e1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc650161e60 con 0x7fc6500cb5e0 2024-08-17T02:26:19.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7fc65487e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc650140c60 0x7fc65015f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7fc65487e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc650140c60 0x7fc65015f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57678/0 (socket says 172.21.15.153:57678) 2024-08-17T02:26:19.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7fc65487e700 1 -- 172.21.15.153:0/3792870234 learned_addr learned my addr 172.21.15.153:0/3792870234 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:19.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7fc64ffff700 1 --2- 172.21.15.153:0/3792870234 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6500af190 0x7fc65015ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7fc64f7fe700 1 --2- 172.21.15.153:0/3792870234 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc6500cb5e0 0x7fc6501610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7fc65487e700 1 -- 172.21.15.153:0/3792870234 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc6500cb5e0 msgr2=0x7fc6501610c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7fc65487e700 1 --2- 172.21.15.153:0/3792870234 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc6500cb5e0 0x7fc6501610c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.058 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7fc65487e700 1 -- 172.21.15.153:0/3792870234 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6500af190 msgr2=0x7fc65015ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.058 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7fc65487e700 1 --2- 172.21.15.153:0/3792870234 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6500af190 0x7fc65015ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.058 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7fc65487e700 1 -- 172.21.15.153:0/3792870234 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc648009a20 con 0x7fc650140c60 2024-08-17T02:26:19.058 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7fd2eaffd700 1 -- 172.21.15.153:0/4076346322 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f40088d0 con 0x7fd30415d3f0 2024-08-17T02:26:19.058 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7fd3098d0700 1 -- 172.21.15.153:0/4076346322 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd30415df60 con 0x7fd30415d3f0 2024-08-17T02:26:19.058 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7fd3098d0700 1 -- 172.21.15.153:0/4076346322 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd30415e520 con 0x7fd30415d3f0 2024-08-17T02:26:19.058 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7fc65487e700 1 --2- 172.21.15.153:0/3792870234 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc650140c60 0x7fc65015f690 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc64000c4c0 tx=0x7fc640007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:19.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7fa4dd254700 1 -- start start 2024-08-17T02:26:19.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7fd2eaffd700 1 -- 172.21.15.153:0/4076346322 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f4008a30 con 0x7fd30415d3f0 2024-08-17T02:26:19.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7fd2eaffd700 1 -- 172.21.15.153:0/4076346322 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f4008df0 con 0x7fd30415d3f0 2024-08-17T02:26:19.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7fa4dd254700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4d80b1950 0x7fa4d8152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.033+0000 7fc64f7fe700 1 --2- 172.21.15.153:0/3792870234 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc6500cb5e0 0x7fc6501610c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:19.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7fc637fff700 1 -- 172.21.15.153:0/3792870234 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc640011590 con 0x7fc650140c60 2024-08-17T02:26:19.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7fc637fff700 1 -- 172.21.15.153:0/3792870234 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6400116f0 con 0x7fc650140c60 2024-08-17T02:26:19.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7fc637fff700 1 -- 172.21.15.153:0/3792870234 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc640011ab0 con 0x7fc650140c60 2024-08-17T02:26:19.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7fa4dd254700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4d813b630 0x7fa4d80a5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7fa4dd254700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4d813bf10 0x7fa4d80a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7fa4d6d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4d80b1950 0x7fa4d8152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7fa4dd254700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d80c5e90 con 0x7fa4d80b1950 2024-08-17T02:26:19.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7fa4dd254700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d80c5280 con 0x7fa4d813b630 2024-08-17T02:26:19.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7fa4dd254700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d80c5560 con 0x7fa4d813bf10 2024-08-17T02:26:19.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7fa4d6d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4d80b1950 0x7fa4d8152150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57686/0 (socket says 172.21.15.153:57686) 2024-08-17T02:26:19.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7fa4d6d9d700 1 -- 172.21.15.153:0/1195681080 learned_addr learned my addr 172.21.15.153:0/1195681080 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:19.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7f7633f90700 1 -- 172.21.15.153:0/3657596312 shutdown_connections 2024-08-17T02:26:19.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7f7633f90700 1 --2- 172.21.15.153:0/3657596312 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f762c06e7d0 0x7f762c0b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7f7633f90700 1 --2- 172.21.15.153:0/3657596312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f762c06e400 0x7f762c0b0a50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7f7633f90700 1 -- 172.21.15.153:0/3657596312 >> 172.21.15.153:0/3657596312 conn(0x7f762c067890 msgr2=0x7f762c067c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:19.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7fa4d659c700 1 --2- 172.21.15.153:0/1195681080 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4d813b630 0x7fa4d80a5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7fa4d6d9d700 1 -- 172.21.15.153:0/1195681080 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4d813bf10 msgr2=0x7fa4d80a5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7fa4d759e700 1 --2- 172.21.15.153:0/1195681080 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4d813bf10 0x7fa4d80a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7fa4d6d9d700 1 --2- 172.21.15.153:0/1195681080 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4d813bf10 0x7fa4d80a5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7fa4d6d9d700 1 -- 172.21.15.153:0/1195681080 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4d813b630 msgr2=0x7fa4d80a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7fa4d6d9d700 1 --2- 172.21.15.153:0/1195681080 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4d813b630 0x7fa4d80a5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7fa4d6d9d700 1 -- 172.21.15.153:0/1195681080 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c800d8d0 con 0x7fa4d80b1950 2024-08-17T02:26:19.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7fa4d659c700 1 --2- 172.21.15.153:0/1195681080 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4d813b630 0x7fa4d80a5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:19.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7fc6562e1700 1 -- 172.21.15.153:0/3792870234 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc650161600 con 0x7fc650140c60 2024-08-17T02:26:19.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7fa4d6d9d700 1 --2- 172.21.15.153:0/1195681080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4d80b1950 0x7fa4d8152150 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa4c800df50 tx=0x7fa4c800f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:19.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7fc6562e1700 1 -- 172.21.15.153:0/3792870234 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc650161b80 con 0x7fc650140c60 2024-08-17T02:26:19.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7f7633f90700 1 -- 172.21.15.153:0/3657596312 shutdown_connections 2024-08-17T02:26:19.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7f7633f90700 1 -- 172.21.15.153:0/3657596312 wait complete. 2024-08-17T02:26:19.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7f7633f90700 1 Processor -- start 2024-08-17T02:26:19.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7f7633f90700 1 -- start start 2024-08-17T02:26:19.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7f7633f90700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f762c06e400 0x7f762c179ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7f7633f90700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f762c06e7d0 0x7f762c177ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7f7633f90700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f762c146690 0x7f762c176b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7f7633f90700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762c140f40 con 0x7f762c06e400 2024-08-17T02:26:19.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7f7633f90700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762c177460 con 0x7f762c06e7d0 2024-08-17T02:26:19.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7f7633f90700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f762c177740 con 0x7f762c146690 2024-08-17T02:26:19.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7f7631d2c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f762c06e400 0x7f762c179ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7f7631d2c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f762c06e400 0x7f762c179ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57712/0 (socket says 172.21.15.153:57712) 2024-08-17T02:26:19.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.041+0000 7f7631d2c700 1 -- 172.21.15.153:0/3218837521 learned_addr learned my addr 172.21.15.153:0/3218837521 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:19.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.041+0000 7f763152b700 1 --2- 172.21.15.153:0/3218837521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f762c06e7d0 0x7f762c177ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.041+0000 7f763252d700 1 --2- 172.21.15.153:0/3218837521 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f762c146690 0x7f762c176b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.041+0000 7f7631d2c700 1 -- 172.21.15.153:0/3218837521 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f762c146690 msgr2=0x7f762c176b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.041+0000 7f7631d2c700 1 --2- 172.21.15.153:0/3218837521 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f762c146690 0x7f762c176b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.041+0000 7f7631d2c700 1 -- 172.21.15.153:0/3218837521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f762c06e7d0 msgr2=0x7f762c177ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.041+0000 7f7631d2c700 1 --2- 172.21.15.153:0/3218837521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f762c06e7d0 0x7f762c177ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.041+0000 7f7631d2c700 1 -- 172.21.15.153:0/3218837521 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7628009420 con 0x7f762c06e400 2024-08-17T02:26:19.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.041+0000 7f763252d700 1 --2- 172.21.15.153:0/3218837521 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f762c146690 0x7f762c176b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:19.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.041+0000 7f7631d2c700 1 --2- 172.21.15.153:0/3218837521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f762c06e400 0x7f762c179ae0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f76280030c0 tx=0x7f7628016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:19.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7fd3098d0700 1 -- 172.21.15.153:0/4076346322 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2e40052b0 con 0x7fd30415d3f0 2024-08-17T02:26:19.069 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7fd2eaffd700 1 -- 172.21.15.153:0/4076346322 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd2f4010670 con 0x7fd30415d3f0 2024-08-17T02:26:19.069 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7fd2eaffd700 1 --2- 172.21.15.153:0/4076346322 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd2f00609e0 0x7fd2f0062e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.069 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7fd2eaffd700 1 -- 172.21.15.153:0/4076346322 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd2f407d3a0 con 0x7fd30415d3f0 2024-08-17T02:26:19.069 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7fd302ffd700 1 --2- 172.21.15.153:0/4076346322 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd2f00609e0 0x7fd2f0062e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.069 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7fd302ffd700 1 --2- 172.21.15.153:0/4076346322 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd2f00609e0 0x7fd2f0062e90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc00e260 tx=0x7fd2fc00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:19.069 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.041+0000 7fd2eaffd700 1 -- 172.21.15.153:0/4076346322 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd2f404d830 con 0x7fd30415d3f0 2024-08-17T02:26:19.069 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.041+0000 7f7621ffb700 1 -- 172.21.15.153:0/3218837521 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762800bae0 con 0x7f762c06e400 2024-08-17T02:26:19.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7f3390a92700 1 Processor -- start 2024-08-17T02:26:19.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7f3390a92700 1 -- start start 2024-08-17T02:26:19.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7f3390a92700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f338c0aed20 0x7f338c0aaa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7f3390a92700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f338c15d1f0 0x7f338c15d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7f3390a92700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f338c06a6d0 con 0x7f338c0aa670 2024-08-17T02:26:19.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7f3390a92700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f338c06a9b0 con 0x7f338c15d1f0 2024-08-17T02:26:19.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7f3390a92700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f338c069d30 con 0x7f338c0aed20 2024-08-17T02:26:19.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7f338ad9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f338c15d1f0 0x7f338c15d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7f338ad9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f338c15d1f0 0x7f338c15d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57696/0 (socket says 172.21.15.153:57696) 2024-08-17T02:26:19.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7f338ad9d700 1 -- 172.21.15.153:0/3717530191 learned_addr learned my addr 172.21.15.153:0/3717530191 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:19.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7f3389d9b700 1 --2- 172.21.15.153:0/3717530191 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f338c0aed20 0x7f338c0aaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7f338ad9d700 1 -- 172.21.15.153:0/3717530191 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f338c0aed20 msgr2=0x7f338c0aaa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:19.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7f338ad9d700 1 --2- 172.21.15.153:0/3717530191 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f338c0aed20 0x7f338c0aaa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7f338ad9d700 1 -- 172.21.15.153:0/3717530191 >> v1:172.21.15.174:6789/0 conn(0x7f338c0aa670 legacy=0x7f338c069270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7f338ad9d700 1 -- 172.21.15.153:0/3717530191 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f338c06a010 con 0x7f338c15d1f0 2024-08-17T02:26:19.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.037+0000 7f338ad9d700 1 --2- 172.21.15.153:0/3717530191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f338c15d1f0 0x7f338c15d690 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3384009f50 tx=0x7f3384009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88b76e9962d9caa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:19.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.041+0000 7f338959a700 1 -- 172.21.15.153:0/3717530191 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338400e070 con 0x7f338c15d1f0 2024-08-17T02:26:19.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.041+0000 7f338959a700 1 -- 172.21.15.153:0/3717530191 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338400b9c0 con 0x7f338c15d1f0 2024-08-17T02:26:19.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.041+0000 7f338959a700 1 -- 172.21.15.153:0/3717530191 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33840092e0 con 0x7f338c15d1f0 2024-08-17T02:26:19.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.041+0000 7f7633f90700 1 -- 172.21.15.153:0/3218837521 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f762c177a20 con 0x7f762c06e400 2024-08-17T02:26:19.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.041+0000 7f7633f90700 1 -- 172.21.15.153:0/3218837521 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f762c177050 con 0x7f762c06e400 2024-08-17T02:26:19.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.045+0000 7f3390a92700 1 -- 172.21.15.153:0/3717530191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f338c15d1f0 msgr2=0x7f338c15d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.045+0000 7f3390a92700 1 --2- 172.21.15.153:0/3717530191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f338c15d1f0 0x7f338c15d690 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3384009f50 tx=0x7f3384009840 comp rx=0 tx=0).stop 2024-08-17T02:26:19.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.045+0000 7fc637fff700 1 -- 172.21.15.153:0/3792870234 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc64001c440 con 0x7fc650140c60 2024-08-17T02:26:19.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.045+0000 7fa4beffd700 1 -- 172.21.15.153:0/1195681080 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c800d2e0 con 0x7fa4d80b1950 2024-08-17T02:26:19.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.045+0000 7fa4beffd700 1 -- 172.21.15.153:0/1195681080 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c8013040 con 0x7fa4d80b1950 2024-08-17T02:26:19.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.045+0000 7fa4beffd700 1 -- 172.21.15.153:0/1195681080 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8010cd0 con 0x7fa4d80b1950 2024-08-17T02:26:19.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.045+0000 7f7621ffb700 1 -- 172.21.15.153:0/3218837521 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762800be90 con 0x7f762c06e400 2024-08-17T02:26:19.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.045+0000 7f7621ffb700 1 -- 172.21.15.153:0/3218837521 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7628006bc0 con 0x7f762c06e400 2024-08-17T02:26:19.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.045+0000 7fc637fff700 1 --2- 172.21.15.153:0/3792870234 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fc63c060930 0x7fc63c062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.045+0000 7fc637fff700 1 -- 172.21.15.153:0/3792870234 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc64007be40 con 0x7fc650140c60 2024-08-17T02:26:19.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.045+0000 7fa4dd254700 1 -- 172.21.15.153:0/1195681080 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d0009a20 con 0x7fa4d80b1950 2024-08-17T02:26:19.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.045+0000 7fa4dd254700 1 -- 172.21.15.153:0/1195681080 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d80c5b20 con 0x7fa4d80b1950 2024-08-17T02:26:19.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.045+0000 7f3390a92700 1 -- 172.21.15.153:0/3717530191 shutdown_connections 2024-08-17T02:26:19.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.045+0000 7f3390a92700 1 --2- 172.21.15.153:0/3717530191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f338c15d1f0 0x7f338c15d690 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.045+0000 7f3390a92700 1 --2- 172.21.15.153:0/3717530191 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f338c0aed20 0x7f338c0aaa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.045+0000 7f3390a92700 1 -- 172.21.15.153:0/3717530191 >> 172.21.15.153:0/3717530191 conn(0x7f338c068300 msgr2=0x7f338c0a8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:19.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.045+0000 7fa4dd254700 1 -- 172.21.15.153:0/1195681080 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d80643a0 con 0x7fa4d80b1950 2024-08-17T02:26:19.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.045+0000 7fa4beffd700 1 -- 172.21.15.153:0/1195681080 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa4c8018480 con 0x7fa4d80b1950 2024-08-17T02:26:19.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.045+0000 7fa4beffd700 1 --2- 172.21.15.153:0/1195681080 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fa4c4060930 0x7fa4c4062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.045+0000 7fc64ffff700 1 --2- 172.21.15.153:0/3792870234 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fc63c060930 0x7fc63c062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.045+0000 7fc6562e1700 1 -- 172.21.15.153:0/3792870234 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6500643a0 con 0x7fc650140c60 2024-08-17T02:26:19.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.045+0000 7f7621ffb700 1 -- 172.21.15.153:0/3218837521 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f762801c690 con 0x7f762c06e400 2024-08-17T02:26:19.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.045+0000 7fc64ffff700 1 --2- 172.21.15.153:0/3792870234 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fc63c060930 0x7fc63c062de0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc6480097c0 tx=0x7fc648018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:19.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.045+0000 7f7621ffb700 1 --2- 172.21.15.153:0/3218837521 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f76180609b0 0x7f7618062e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.049+0000 7f7621ffb700 1 -- 172.21.15.153:0/3218837521 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f762807ebd0 con 0x7f762c06e400 2024-08-17T02:26:19.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.045+0000 7fa4beffd700 1 -- 172.21.15.153:0/1195681080 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa4c8080c60 con 0x7fa4d80b1950 2024-08-17T02:26:19.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.045+0000 7fa4d659c700 1 --2- 172.21.15.153:0/1195681080 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fa4c4060930 0x7fa4c4062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.049+0000 7fa4d659c700 1 --2- 172.21.15.153:0/1195681080 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fa4c4060930 0x7fa4c4062de0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa4d00097c0 tx=0x7fa4d0018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:19.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.049+0000 7f763152b700 1 --2- 172.21.15.153:0/3218837521 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f76180609b0 0x7f7618062e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.049+0000 7f763152b700 1 --2- 172.21.15.153:0/3218837521 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f76180609b0 0x7f7618062e60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f762c0c1990 tx=0x7f761c0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:19.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.049+0000 7f7633f90700 1 -- 172.21.15.153:0/3218837521 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76080052b0 con 0x7f762c06e400 2024-08-17T02:26:19.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.045+0000 7f3390a92700 1 -- 172.21.15.153:0/3717530191 shutdown_connections 2024-08-17T02:26:19.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.045+0000 7f3390a92700 1 -- 172.21.15.153:0/3717530191 wait complete. 2024-08-17T02:26:19.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.049+0000 7f3390a92700 1 Processor -- start 2024-08-17T02:26:19.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.049+0000 7f3390a92700 1 -- start start 2024-08-17T02:26:19.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.049+0000 7ff690ea7700 1 Processor -- start 2024-08-17T02:26:19.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.049+0000 7ff690ea7700 1 -- start start 2024-08-17T02:26:19.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.049+0000 7f3390a92700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f338c0aa670 0x7f338c0af940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.049+0000 7f3390a92700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f338c0aed20 0x7f338c179930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.049+0000 7f3390a92700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f338c15d1f0 0x7f338c179e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.049+0000 7f338a59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f338c0aa670 0x7f338c0af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.049+0000 7f338a59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f338c0aa670 0x7f338c0af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57714/0 (socket says 172.21.15.153:57714) 2024-08-17T02:26:19.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.049+0000 7f3390a92700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338c0b0ea0 con 0x7f338c0aa670 2024-08-17T02:26:19.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.049+0000 7f338a59c700 1 -- 172.21.15.153:0/3068023707 learned_addr learned my addr 172.21.15.153:0/3068023707 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:19.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.049+0000 7f3390a92700 1 -- 172.21.15.153:0/3068023707 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338c0b12c0 con 0x7f338c15d1f0 2024-08-17T02:26:19.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.049+0000 7f3390a92700 1 -- 172.21.15.153:0/3068023707 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f338c0b0220 con 0x7f338c0aed20 2024-08-17T02:26:19.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.049+0000 7f3389d9b700 1 --2- 172.21.15.153:0/3068023707 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f338c0aed20 0x7f338c179930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.049+0000 7f338ad9d700 1 --2- 172.21.15.153:0/3068023707 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f338c15d1f0 0x7f338c179e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.049+0000 7f338a59c700 1 -- 172.21.15.153:0/3068023707 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f338c0aed20 msgr2=0x7f338c179930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.049+0000 7f338a59c700 1 --2- 172.21.15.153:0/3068023707 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f338c0aed20 0x7f338c179930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.049+0000 7f338a59c700 1 -- 172.21.15.153:0/3068023707 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f338c15d1f0 msgr2=0x7f338c179e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.049+0000 7f338a59c700 1 --2- 172.21.15.153:0/3068023707 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f338c15d1f0 0x7f338c179e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.049+0000 7f338a59c700 1 -- 172.21.15.153:0/3068023707 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3384009ae0 con 0x7f338c0aa670 2024-08-17T02:26:19.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.049+0000 7f338ad9d700 1 --2- 172.21.15.153:0/3068023707 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f338c15d1f0 0x7f338c179e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:19.082 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.049+0000 7ff690ea7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff68c0ae350 0x7ff68c06df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.082 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.049+0000 7ff690ea7700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff68c0adec0 con 0x7ff68c06e450 2024-08-17T02:26:19.082 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.049+0000 7ff690ea7700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff68c06e890 con 0x7ff68c155a60 2024-08-17T02:26:19.082 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.049+0000 7ff690ea7700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff68c0aed10 con 0x7ff68c0ae350 2024-08-17T02:26:19.082 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.049+0000 7ff68bfff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ff68c06e450 0x7ff68c155e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35814/0 (socket says 172.21.15.153:35814) 2024-08-17T02:26:19.082 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.049+0000 7ff68bfff700 1 -- 172.21.15.153:0/7898244 learned_addr learned my addr 172.21.15.153:0/7898244 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:19.082 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.049+0000 7ff68affd700 1 --2- 172.21.15.153:0/7898244 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff68c0ae350 0x7ff68c06df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.082 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.049+0000 7f338a59c700 1 --2- 172.21.15.153:0/3068023707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f338c0aa670 0x7f338c0af940 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f338000c790 tx=0x7f3380007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:19.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.053+0000 7ff68a7fc700 1 -- 172.21.15.153:0/7898244 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1114836378 0 0) 0x7ff68c06e890 con 0x7ff68c155a60 2024-08-17T02:26:19.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.053+0000 7ff68affd700 1 -- 172.21.15.153:0/7898244 >> v1:172.21.15.174:6789/0 conn(0x7ff68c155a60 legacy=0x7ff68c0ac7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.053+0000 7ff68affd700 1 -- 172.21.15.153:0/7898244 >> v1:172.21.15.153:6789/0 conn(0x7ff68c06e450 legacy=0x7ff68c155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.053+0000 7ff68affd700 1 -- 172.21.15.153:0/7898244 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff68c0ad2b0 con 0x7ff68c0ae350 2024-08-17T02:26:19.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.053+0000 7ff68affd700 1 --2- 172.21.15.153:0/7898244 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff68c0ae350 0x7ff68c06df10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff680009910 tx=0x7ff6800091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4791805ca4bfc03f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:19.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.053+0000 7ff68a7fc700 1 -- 172.21.15.153:0/7898244 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68000b860 con 0x7ff68c0ae350 2024-08-17T02:26:19.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.053+0000 7ff68a7fc700 1 -- 172.21.15.153:0/7898244 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68000b9c0 con 0x7ff68c0ae350 2024-08-17T02:26:19.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.053+0000 7ff68a7fc700 1 -- 172.21.15.153:0/7898244 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68000bd60 con 0x7ff68c0ae350 2024-08-17T02:26:19.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.053+0000 7fa4beffd700 1 -- 172.21.15.153:0/1195681080 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa4c8051130 con 0x7fa4d80b1950 2024-08-17T02:26:19.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.053+0000 7ff690ea7700 1 -- 172.21.15.153:0/7898244 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff68c0ae350 msgr2=0x7ff68c06df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.053+0000 7ff690ea7700 1 --2- 172.21.15.153:0/7898244 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff68c0ae350 0x7ff68c06df10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff680009910 tx=0x7ff6800091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.053+0000 7ff690ea7700 1 -- 172.21.15.153:0/7898244 shutdown_connections 2024-08-17T02:26:19.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.053+0000 7ff690ea7700 1 --2- 172.21.15.153:0/7898244 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff68c0ae350 0x7ff68c06df10 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.053+0000 7ff690ea7700 1 -- 172.21.15.153:0/7898244 >> 172.21.15.153:0/7898244 conn(0x7ff68c0678d0 msgr2=0x7ff68c067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:19.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.053+0000 7ff690ea7700 1 -- 172.21.15.153:0/7898244 shutdown_connections 2024-08-17T02:26:19.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.053+0000 7ff690ea7700 1 -- 172.21.15.153:0/7898244 wait complete. 2024-08-17T02:26:19.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.053+0000 7ff690ea7700 1 Processor -- start 2024-08-17T02:26:19.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.053+0000 7ff690ea7700 1 -- start start 2024-08-17T02:26:19.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.057+0000 7ff690ea7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff68c06e450 0x7ff68c157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.057+0000 7ff690ea7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff68c0ae350 0x7ff68c0c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.057+0000 7ff690ea7700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff68c155a60 0x7ff68c0c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.057+0000 7ff690ea7700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff68c0c9c20 con 0x7ff68c0ae350 2024-08-17T02:26:19.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.057+0000 7ff690ea7700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff68c0caa30 con 0x7ff68c155a60 2024-08-17T02:26:19.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.057+0000 7ff690ea7700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff68c0c9e20 con 0x7ff68c06e450 2024-08-17T02:26:19.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.057+0000 7ff68b7fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff68c06e450 0x7ff68c157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.057+0000 7ff68bfff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff68c155a60 0x7ff68c0c96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.057+0000 7ff68bfff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff68c155a60 0x7ff68c0c96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.153:49740/0 (socket says 172.21.15.153:49740) 2024-08-17T02:26:19.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.057+0000 7ff68b7fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff68c06e450 0x7ff68c157c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.153:35036/0 (socket says 172.21.15.153:35036) 2024-08-17T02:26:19.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.057+0000 7ff68bfff700 1 -- 172.21.15.153:0/3010658462 learned_addr learned my addr 172.21.15.153:0/3010658462 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:19.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.057+0000 7ff68bfff700 1 -- 172.21.15.153:0/3010658462 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff68c06e450 msgr2=0x7ff68c157c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.057+0000 7ff68bfff700 1 --2- 172.21.15.153:0/3010658462 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff68c06e450 0x7ff68c157c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.057+0000 7ff68bfff700 1 -- 172.21.15.153:0/3010658462 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff68c0ae350 msgr2=0x7ff68c0c91a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:26:19.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.057+0000 7ff68bfff700 1 --2- 172.21.15.153:0/3010658462 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff68c0ae350 0x7ff68c0c91a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.057+0000 7ff68bfff700 1 -- 172.21.15.153:0/3010658462 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff680009420 con 0x7ff68c155a60 2024-08-17T02:26:19.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.057+0000 7ff68bfff700 1 --2- 172.21.15.153:0/3010658462 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff68c155a60 0x7ff68c0c96e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff68400cc70 tx=0x7ff684001a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:19.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.057+0000 7ff6737fe700 1 -- 172.21.15.153:0/3010658462 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68400a8e0 con 0x7ff68c155a60 2024-08-17T02:26:19.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.057+0000 7ff690ea7700 1 -- 172.21.15.153:0/3010658462 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff68c0ca100 con 0x7ff68c155a60 2024-08-17T02:26:19.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.057+0000 7fc637fff700 1 -- 172.21.15.153:0/3792870234 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc64004c310 con 0x7fc650140c60 2024-08-17T02:26:19.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.057+0000 7ff690ea7700 1 -- 172.21.15.153:0/3010658462 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff68c0ca6c0 con 0x7ff68c155a60 2024-08-17T02:26:19.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.057+0000 7ff6737fe700 1 -- 172.21.15.153:0/3010658462 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68400aa60 con 0x7ff68c155a60 2024-08-17T02:26:19.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.057+0000 7ff6737fe700 1 -- 172.21.15.153:0/3010658462 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68400ae20 con 0x7ff68c155a60 2024-08-17T02:26:19.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.061+0000 7ff6737fe700 1 -- 172.21.15.153:0/3010658462 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff684007300 con 0x7ff68c155a60 2024-08-17T02:26:19.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.061+0000 7ff6737fe700 1 --2- 172.21.15.153:0/3010658462 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff678060860 0x7ff678062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.061+0000 7ff6737fe700 1 -- 172.21.15.153:0/3010658462 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff68407ce40 con 0x7ff68c155a60 2024-08-17T02:26:19.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.061+0000 7ff68b7fe700 1 --2- 172.21.15.153:0/3010658462 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff678060860 0x7ff678062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.061+0000 7ff68b7fe700 1 --2- 172.21.15.153:0/3010658462 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff678060860 0x7ff678062d10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff67c00ee50 tx=0x7ff67c007f50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:19.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.065+0000 7f337a7fc700 1 -- 172.21.15.153:0/3068023707 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3380011590 con 0x7f338c0aa670 2024-08-17T02:26:19.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.065+0000 7f337a7fc700 1 -- 172.21.15.153:0/3068023707 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3380011710 con 0x7f338c0aa670 2024-08-17T02:26:19.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.065+0000 7f3390a92700 1 -- 172.21.15.153:0/3068023707 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f338c0b0500 con 0x7f338c0aa670 2024-08-17T02:26:19.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.065+0000 7f337a7fc700 1 -- 172.21.15.153:0/3068023707 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3380011ad0 con 0x7f338c0aa670 2024-08-17T02:26:19.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.065+0000 7f7621ffb700 1 -- 172.21.15.153:0/3218837521 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f762804efc0 con 0x7f762c06e400 2024-08-17T02:26:19.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.065+0000 7f3390a92700 1 -- 172.21.15.153:0/3068023707 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f338c0b0ac0 con 0x7f338c0aa670 2024-08-17T02:26:19.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.065+0000 7f337a7fc700 1 -- 172.21.15.153:0/3068023707 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f338001b3b0 con 0x7f338c0aa670 2024-08-17T02:26:19.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.065+0000 7f337a7fc700 1 --2- 172.21.15.153:0/3068023707 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f336c060860 0x7f336c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.065+0000 7f337a7fc700 1 -- 172.21.15.153:0/3068023707 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f338007c090 con 0x7f338c0aa670 2024-08-17T02:26:19.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.065+0000 7f3389d9b700 1 --2- 172.21.15.153:0/3068023707 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f336c060860 0x7f336c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.069+0000 7f3389d9b700 1 --2- 172.21.15.153:0/3068023707 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f336c060860 0x7f336c062d10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f338c063d90 tx=0x7f337c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:19.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.073+0000 7ff690ea7700 1 -- 172.21.15.153:0/3010658462 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff66c0052b0 con 0x7ff68c155a60 2024-08-17T02:26:19.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.077+0000 7f3390a92700 1 -- 172.21.15.153:0/3068023707 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f338c0b1110 con 0x7f338c0aa670 2024-08-17T02:26:19.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.085+0000 7f337a7fc700 1 -- 172.21.15.153:0/3068023707 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f3380017020 con 0x7f338c0aa670 2024-08-17T02:26:19.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.089+0000 7ff6737fe700 1 -- 172.21.15.153:0/3010658462 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff68404d310 con 0x7ff68c155a60 2024-08-17T02:26:19.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.281+0000 7f7944c14700 1 -- 172.21.15.153:0/2260623873 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f794006f5f0 con 0x7f79400b1950 2024-08-17T02:26:19.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.281+0000 7f792e7fc700 1 -- 172.21.15.153:0/2260623873 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7938025090 con 0x7f79400b1950 2024-08-17T02:26:19.285 INFO:teuthology.orchestra.run.smithi153.stdout:60129542151 2024-08-17T02:26:19.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.281+0000 7f791ffff700 1 -- 172.21.15.153:0/2260623873 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7920060930 msgr2=0x7f7920062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.285+0000 7f791ffff700 1 --2- 172.21.15.153:0/2260623873 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7920060930 0x7f7920062de0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7940154fd0 tx=0x7f7934009060 comp rx=0 tx=0).stop 2024-08-17T02:26:19.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.285+0000 7f791ffff700 1 -- 172.21.15.153:0/2260623873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79400b1950 msgr2=0x7f7940170860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.285+0000 7f791ffff700 1 --2- 172.21.15.153:0/2260623873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79400b1950 0x7f7940170860 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7938007ff0 tx=0x7f793801a000 comp rx=0 tx=0).stop 2024-08-17T02:26:19.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.285+0000 7f791ffff700 1 -- 172.21.15.153:0/2260623873 shutdown_connections 2024-08-17T02:26:19.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.285+0000 7f791ffff700 1 --2- 172.21.15.153:0/2260623873 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7920060930 0x7f7920062de0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.285+0000 7f791ffff700 1 --2- 172.21.15.153:0/2260623873 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f794013bf10 0x7f79401513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.285+0000 7f791ffff700 1 --2- 172.21.15.153:0/2260623873 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f794013b630 0x7f7940150e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.285+0000 7f791ffff700 1 --2- 172.21.15.153:0/2260623873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79400b1950 0x7f7940170860 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.285+0000 7f791ffff700 1 -- 172.21.15.153:0/2260623873 >> 172.21.15.153:0/2260623873 conn(0x7f79400678d0 msgr2=0x7f794013a480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:19.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.285+0000 7f791ffff700 1 -- 172.21.15.153:0/2260623873 shutdown_connections 2024-08-17T02:26:19.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.285+0000 7f791ffff700 1 -- 172.21.15.153:0/2260623873 wait complete. 2024-08-17T02:26:19.301 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.0 2024-08-17T02:26:19.301 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:19.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.297+0000 7fa94f1a1700 1 -- 172.21.15.153:0/1812611743 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fa928005560 con 0x7fa9480cb9c0 2024-08-17T02:26:19.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.301+0000 7fa944ff9700 1 -- 172.21.15.153:0/1812611743 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa938050570 con 0x7fa9480cb9c0 2024-08-17T02:26:19.303 INFO:teuthology.orchestra.run.smithi153.stdout:64424509447 2024-08-17T02:26:19.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.301+0000 7fa94f1a1700 1 -- 172.21.15.153:0/1812611743 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fa9340609b0 msgr2=0x7fa934062e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.301+0000 7fa94f1a1700 1 --2- 172.21.15.153:0/1812611743 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fa9340609b0 0x7fa934062e60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa940012000 tx=0x7fa940018000 comp rx=0 tx=0).stop 2024-08-17T02:26:19.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.301+0000 7fa94f1a1700 1 -- 172.21.15.153:0/1812611743 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9480cb9c0 msgr2=0x7fa948150670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.301+0000 7fa94f1a1700 1 --2- 172.21.15.153:0/1812611743 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9480cb9c0 0x7fa948150670 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa93800c8b0 tx=0x7fa938008040 comp rx=0 tx=0).stop 2024-08-17T02:26:19.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.305+0000 7fa94f1a1700 1 -- 172.21.15.153:0/1812611743 shutdown_connections 2024-08-17T02:26:19.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.305+0000 7fa94f1a1700 1 --2- 172.21.15.153:0/1812611743 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fa9340609b0 0x7fa934062e60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.305+0000 7fa94f1a1700 1 --2- 172.21.15.153:0/1812611743 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9480cb9c0 0x7fa948150670 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.305+0000 7fa94f1a1700 1 --2- 172.21.15.153:0/1812611743 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa94806b870 0x7fa94813dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.305+0000 7fa94f1a1700 1 --2- 172.21.15.153:0/1812611743 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9480677e0 0x7fa9480973a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.308 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.305+0000 7fa94f1a1700 1 -- 172.21.15.153:0/1812611743 >> 172.21.15.153:0/1812611743 conn(0x7fa9480ccb80 msgr2=0x7fa94806ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:19.308 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.305+0000 7fa94f1a1700 1 -- 172.21.15.153:0/1812611743 shutdown_connections 2024-08-17T02:26:19.308 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.305+0000 7fa94f1a1700 1 -- 172.21.15.153:0/1812611743 wait complete. 2024-08-17T02:26:19.320 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.6 2024-08-17T02:26:19.320 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:19.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.333+0000 7fd3098d0700 1 -- 172.21.15.153:0/4076346322 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd2e4005560 con 0x7fd30415d3f0 2024-08-17T02:26:19.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.333+0000 7fd2eaffd700 1 -- 172.21.15.153:0/4076346322 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd2f4050e50 con 0x7fd30415d3f0 2024-08-17T02:26:19.335 INFO:teuthology.orchestra.run.smithi153.stdout:64424509446 2024-08-17T02:26:19.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.333+0000 7fd3098d0700 1 -- 172.21.15.153:0/4076346322 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd2f00609e0 msgr2=0x7fd2f0062e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.333+0000 7fd3098d0700 1 --2- 172.21.15.153:0/4076346322 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd2f00609e0 0x7fd2f0062e90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc00e260 tx=0x7fd2fc00b040 comp rx=0 tx=0).stop 2024-08-17T02:26:19.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.333+0000 7fd3098d0700 1 -- 172.21.15.153:0/4076346322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd30415d3f0 msgr2=0x7fd30415d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.333+0000 7fd3098d0700 1 --2- 172.21.15.153:0/4076346322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd30415d3f0 0x7fd30415d890 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd2f400d9c0 tx=0x7fd2f400b260 comp rx=0 tx=0).stop 2024-08-17T02:26:19.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.333+0000 7fd3098d0700 1 -- 172.21.15.153:0/4076346322 shutdown_connections 2024-08-17T02:26:19.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.333+0000 7fd3098d0700 1 --2- 172.21.15.153:0/4076346322 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd2f00609e0 0x7fd2f0062e90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.333+0000 7fd3098d0700 1 --2- 172.21.15.153:0/4076346322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd30415d3f0 0x7fd30415d890 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.333+0000 7fd3098d0700 1 --2- 172.21.15.153:0/4076346322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd30413b630 0x7fd30415ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.333+0000 7fd3098d0700 1 --2- 172.21.15.153:0/4076346322 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3040b1950 0x7fd30413a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.333+0000 7fd3098d0700 1 -- 172.21.15.153:0/4076346322 >> 172.21.15.153:0/4076346322 conn(0x7fd3040678d0 msgr2=0x7fd3040c8f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:19.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.333+0000 7fd3098d0700 1 -- 172.21.15.153:0/4076346322 shutdown_connections 2024-08-17T02:26:19.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.333+0000 7fd3098d0700 1 -- 172.21.15.153:0/4076346322 wait complete. 2024-08-17T02:26:19.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.337+0000 7fc6562e1700 1 -- 172.21.15.153:0/3792870234 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc65017a3b0 con 0x7fc650140c60 2024-08-17T02:26:19.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.337+0000 7fc637fff700 1 -- 172.21.15.153:0/3792870234 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc640017030 con 0x7fc650140c60 2024-08-17T02:26:19.340 INFO:teuthology.orchestra.run.smithi153.stdout:64424509447 2024-08-17T02:26:19.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.337+0000 7fc6562e1700 1 -- 172.21.15.153:0/3792870234 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fc63c060930 msgr2=0x7fc63c062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.337+0000 7fc6562e1700 1 --2- 172.21.15.153:0/3792870234 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fc63c060930 0x7fc63c062de0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc6480097c0 tx=0x7fc648018000 comp rx=0 tx=0).stop 2024-08-17T02:26:19.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.337+0000 7fc6562e1700 1 -- 172.21.15.153:0/3792870234 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc650140c60 msgr2=0x7fc65015f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.337+0000 7fc6562e1700 1 --2- 172.21.15.153:0/3792870234 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc650140c60 0x7fc65015f690 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc64000c4c0 tx=0x7fc640007f00 comp rx=0 tx=0).stop 2024-08-17T02:26:19.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.341+0000 7fc6562e1700 1 -- 172.21.15.153:0/3792870234 shutdown_connections 2024-08-17T02:26:19.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.341+0000 7fc6562e1700 1 --2- 172.21.15.153:0/3792870234 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fc63c060930 0x7fc63c062de0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.341+0000 7fc6562e1700 1 --2- 172.21.15.153:0/3792870234 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc650140c60 0x7fc65015f690 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.341+0000 7fc6562e1700 1 --2- 172.21.15.153:0/3792870234 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc6500cb5e0 0x7fc6501610c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.341+0000 7fc6562e1700 1 --2- 172.21.15.153:0/3792870234 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6500af190 0x7fc65015ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.341+0000 7fc6562e1700 1 -- 172.21.15.153:0/3792870234 >> 172.21.15.153:0/3792870234 conn(0x7fc6500678d0 msgr2=0x7fc650142190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:19.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.341+0000 7fc6562e1700 1 -- 172.21.15.153:0/3792870234 shutdown_connections 2024-08-17T02:26:19.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.341+0000 7fc6562e1700 1 -- 172.21.15.153:0/3792870234 wait complete. 2024-08-17T02:26:19.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.341+0000 7fa4dd254700 1 -- 172.21.15.153:0/1195681080 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa4d806f5f0 con 0x7fa4d80b1950 2024-08-17T02:26:19.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.341+0000 7fa4beffd700 1 -- 172.21.15.153:0/1195681080 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa4c8054750 con 0x7fa4d80b1950 2024-08-17T02:26:19.344 INFO:teuthology.orchestra.run.smithi153.stdout:64424509448 2024-08-17T02:26:19.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.345+0000 7fa4dd254700 1 -- 172.21.15.153:0/1195681080 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fa4c4060930 msgr2=0x7fa4c4062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.345+0000 7fa4dd254700 1 --2- 172.21.15.153:0/1195681080 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fa4c4060930 0x7fa4c4062de0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa4d00097c0 tx=0x7fa4d0018000 comp rx=0 tx=0).stop 2024-08-17T02:26:19.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.345+0000 7fa4dd254700 1 -- 172.21.15.153:0/1195681080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4d80b1950 msgr2=0x7fa4d8152150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.345+0000 7fa4dd254700 1 --2- 172.21.15.153:0/1195681080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4d80b1950 0x7fa4d8152150 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa4c800df50 tx=0x7fa4c800f040 comp rx=0 tx=0).stop 2024-08-17T02:26:19.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.345+0000 7fa4dd254700 1 -- 172.21.15.153:0/1195681080 shutdown_connections 2024-08-17T02:26:19.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.345+0000 7fa4dd254700 1 --2- 172.21.15.153:0/1195681080 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fa4c4060930 0x7fa4c4062de0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.345+0000 7fa4dd254700 1 --2- 172.21.15.153:0/1195681080 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4d813bf10 0x7fa4d80a5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.345+0000 7fa4dd254700 1 --2- 172.21.15.153:0/1195681080 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4d813b630 0x7fa4d80a5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.345+0000 7fa4dd254700 1 --2- 172.21.15.153:0/1195681080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4d80b1950 0x7fa4d8152150 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.345+0000 7fa4dd254700 1 -- 172.21.15.153:0/1195681080 >> 172.21.15.153:0/1195681080 conn(0x7fa4d80678d0 msgr2=0x7fa4d8069110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:19.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.345+0000 7fa4dd254700 1 -- 172.21.15.153:0/1195681080 shutdown_connections 2024-08-17T02:26:19.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.345+0000 7fa4dd254700 1 -- 172.21.15.153:0/1195681080 wait complete. 2024-08-17T02:26:19.349 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.1 2024-08-17T02:26:19.349 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:19.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.3 2024-08-17T02:26:19.354 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:19.361 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.4 2024-08-17T02:26:19.362 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:19.370 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.369+0000 7f7633f90700 1 -- 172.21.15.153:0/3218837521 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7608005560 con 0x7f762c06e400 2024-08-17T02:26:19.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.369+0000 7f7621ffb700 1 -- 172.21.15.153:0/3218837521 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f76280525e0 con 0x7f762c06e400 2024-08-17T02:26:19.371 INFO:teuthology.orchestra.run.smithi153.stdout:60129542151 2024-08-17T02:26:19.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.369+0000 7f7633f90700 1 -- 172.21.15.153:0/3218837521 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f76180609b0 msgr2=0x7f7618062e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.369+0000 7f7633f90700 1 --2- 172.21.15.153:0/3218837521 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f76180609b0 0x7f7618062e60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f762c0c1990 tx=0x7f761c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.369+0000 7f7633f90700 1 -- 172.21.15.153:0/3218837521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f762c06e400 msgr2=0x7f762c179ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.369+0000 7f7633f90700 1 --2- 172.21.15.153:0/3218837521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f762c06e400 0x7f762c179ae0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f76280030c0 tx=0x7f7628016000 comp rx=0 tx=0).stop 2024-08-17T02:26:19.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.369+0000 7f7633f90700 1 -- 172.21.15.153:0/3218837521 shutdown_connections 2024-08-17T02:26:19.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.369+0000 7f7633f90700 1 --2- 172.21.15.153:0/3218837521 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f76180609b0 0x7f7618062e60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.369+0000 7f7633f90700 1 --2- 172.21.15.153:0/3218837521 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f762c146690 0x7f762c176b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.369+0000 7f7633f90700 1 --2- 172.21.15.153:0/3218837521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f762c06e7d0 0x7f762c177ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.369+0000 7f7633f90700 1 --2- 172.21.15.153:0/3218837521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f762c06e400 0x7f762c179ae0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.369+0000 7f7633f90700 1 -- 172.21.15.153:0/3218837521 >> 172.21.15.153:0/3218837521 conn(0x7f762c067890 msgr2=0x7f762c15de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:19.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.369+0000 7f7633f90700 1 -- 172.21.15.153:0/3218837521 shutdown_connections 2024-08-17T02:26:19.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.369+0000 7f7633f90700 1 -- 172.21.15.153:0/3218837521 wait complete. 2024-08-17T02:26:19.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.377+0000 7ff690ea7700 1 -- 172.21.15.153:0/3010658462 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ff66c005830 con 0x7ff68c155a60 2024-08-17T02:26:19.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.377+0000 7ff6737fe700 1 -- 172.21.15.153:0/3010658462 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff684050930 con 0x7ff68c155a60 2024-08-17T02:26:19.380 INFO:teuthology.orchestra.run.smithi153.stdout:64424509447 2024-08-17T02:26:19.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.381+0000 7ff690ea7700 1 -- 172.21.15.153:0/3010658462 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff678060860 msgr2=0x7ff678062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.381+0000 7ff690ea7700 1 --2- 172.21.15.153:0/3010658462 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff678060860 0x7ff678062d10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff67c00ee50 tx=0x7ff67c007f50 comp rx=0 tx=0).stop 2024-08-17T02:26:19.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.381+0000 7f3390a92700 1 -- 172.21.15.153:0/3068023707 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f338c070360 con 0x7f338c0aa670 2024-08-17T02:26:19.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.381+0000 7ff690ea7700 1 -- 172.21.15.153:0/3010658462 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff68c155a60 msgr2=0x7ff68c0c96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.381+0000 7ff690ea7700 1 --2- 172.21.15.153:0/3010658462 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff68c155a60 0x7ff68c0c96e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff68400cc70 tx=0x7ff684001a10 comp rx=0 tx=0).stop 2024-08-17T02:26:19.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.381+0000 7ff690ea7700 1 -- 172.21.15.153:0/3010658462 shutdown_connections 2024-08-17T02:26:19.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.381+0000 7ff690ea7700 1 --2- 172.21.15.153:0/3010658462 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff678060860 0x7ff678062d10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.381+0000 7ff690ea7700 1 --2- 172.21.15.153:0/3010658462 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff68c155a60 0x7ff68c0c96e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.381+0000 7ff690ea7700 1 --2- 172.21.15.153:0/3010658462 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff68c0ae350 0x7ff68c0c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.381+0000 7ff690ea7700 1 --2- 172.21.15.153:0/3010658462 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff68c06e450 0x7ff68c157c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.381+0000 7ff690ea7700 1 -- 172.21.15.153:0/3010658462 >> 172.21.15.153:0/3010658462 conn(0x7ff68c0678d0 msgr2=0x7ff68c068f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:19.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.381+0000 7ff690ea7700 1 -- 172.21.15.153:0/3010658462 shutdown_connections 2024-08-17T02:26:19.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.381+0000 7ff690ea7700 1 -- 172.21.15.153:0/3010658462 wait complete. 2024-08-17T02:26:19.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.381+0000 7f337a7fc700 1 -- 172.21.15.153:0/3068023707 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3380055030 con 0x7f338c0aa670 2024-08-17T02:26:19.385 INFO:teuthology.orchestra.run.smithi153.stdout:64424509446 2024-08-17T02:26:19.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.381+0000 7f3390a92700 1 -- 172.21.15.153:0/3068023707 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f336c060860 msgr2=0x7f336c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.381+0000 7f3390a92700 1 --2- 172.21.15.153:0/3068023707 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f336c060860 0x7f336c062d10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f338c063d90 tx=0x7f337c008040 comp rx=0 tx=0).stop 2024-08-17T02:26:19.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.381+0000 7f3390a92700 1 -- 172.21.15.153:0/3068023707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f338c0aa670 msgr2=0x7f338c0af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.381+0000 7f3390a92700 1 --2- 172.21.15.153:0/3068023707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f338c0aa670 0x7f338c0af940 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f338000c790 tx=0x7f3380007f40 comp rx=0 tx=0).stop 2024-08-17T02:26:19.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.381+0000 7f3390a92700 1 -- 172.21.15.153:0/3068023707 shutdown_connections 2024-08-17T02:26:19.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.381+0000 7f3390a92700 1 --2- 172.21.15.153:0/3068023707 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f336c060860 0x7f336c062d10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.381+0000 7f3390a92700 1 --2- 172.21.15.153:0/3068023707 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f338c15d1f0 0x7f338c179e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.381+0000 7f3390a92700 1 --2- 172.21.15.153:0/3068023707 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f338c0aed20 0x7f338c179930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.381+0000 7f3390a92700 1 --2- 172.21.15.153:0/3068023707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f338c0aa670 0x7f338c0af940 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.381+0000 7f3390a92700 1 -- 172.21.15.153:0/3068023707 >> 172.21.15.153:0/3068023707 conn(0x7f338c068300 msgr2=0x7f338c0691f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:19.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.381+0000 7f3390a92700 1 -- 172.21.15.153:0/3068023707 shutdown_connections 2024-08-17T02:26:19.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.381+0000 7f3390a92700 1 -- 172.21.15.153:0/3068023707 wait complete. 2024-08-17T02:26:19.388 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.2 2024-08-17T02:26:19.388 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:19.396 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.5 2024-08-17T02:26:19.396 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:19.397 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.7 2024-08-17T02:26:19.397 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:19.397 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:26:19.397 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:26:19.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.485+0000 7f3dcaa0d700 1 Processor -- start 2024-08-17T02:26:19.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.485+0000 7f3dcaa0d700 1 -- start start 2024-08-17T02:26:19.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.485+0000 7f3dcaa0d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3dc4159040 0x7f3dc40cf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.485+0000 7f3dcaa0d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3dc40d0010 0x7f3dc40d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.485+0000 7f3dcaa0d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3dc415cea0 0x7f3dc415d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.489+0000 7f3dcaa0d700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dc40cf190 con 0x7f3dc4159040 2024-08-17T02:26:19.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.489+0000 7f3dcaa0d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dc40d09a0 con 0x7f3dc415cea0 2024-08-17T02:26:19.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.489+0000 7f3dcaa0d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc40ce5e0 con 0x7f3dc40d0010 2024-08-17T02:26:19.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.489+0000 7f3dc9a0b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3dc4159040 0x7f3dc40cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.489+0000 7f3dc9a0b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3dc4159040 0x7f3dc40cf620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57722/0 (socket says 172.21.15.153:57722) 2024-08-17T02:26:19.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.489+0000 7f3dc9a0b700 1 -- 172.21.15.153:0/3633067295 learned_addr learned my addr 172.21.15.153:0/3633067295 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:19.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.489+0000 7f3dc920a700 1 --2- 172.21.15.153:0/3633067295 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3dc40d0010 0x7f3dc40d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.489+0000 7f3dca20c700 1 --2- 172.21.15.153:0/3633067295 >> v2:172.21.15.174:3300/0 conn(0x7f3dc415cea0 0x7f3dc415d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.489+0000 7f3dc9a0b700 1 -- 172.21.15.153:0/3633067295 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3dc40d0010 msgr2=0x7f3dc40d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:19.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.489+0000 7f3dc9a0b700 1 --2- 172.21.15.153:0/3633067295 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3dc40d0010 0x7f3dc40d0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.489+0000 7f3dc9a0b700 1 -- 172.21.15.153:0/3633067295 >> v2:172.21.15.174:3300/0 conn(0x7f3dc415cea0 msgr2=0x7f3dc415d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:19.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.489+0000 7f3dc9a0b700 1 --2- 172.21.15.153:0/3633067295 >> v2:172.21.15.174:3300/0 conn(0x7f3dc415cea0 0x7f3dc415d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.489+0000 7f3dc9a0b700 1 -- 172.21.15.153:0/3633067295 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc40ce860 con 0x7f3dc4159040 2024-08-17T02:26:19.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.489+0000 7f3dca20c700 1 --2- 172.21.15.153:0/3633067295 >> v2:172.21.15.174:3300/0 conn(0x7f3dc415cea0 0x7f3dc415d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:19.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.489+0000 7f3dc9a0b700 1 --2- 172.21.15.153:0/3633067295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dc4159040 0x7f3dc40cf620 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3dc40b6130 tx=0x7f3dc0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b49368a22129eb3e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:19.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.489+0000 7f3dc8a09700 1 -- 172.21.15.153:0/3633067295 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc000b860 con 0x7f3dc4159040 2024-08-17T02:26:19.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.489+0000 7f3dc8a09700 1 -- 172.21.15.153:0/3633067295 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc000b9c0 con 0x7f3dc4159040 2024-08-17T02:26:19.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.489+0000 7f3dc8a09700 1 -- 172.21.15.153:0/3633067295 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc000bd60 con 0x7f3dc4159040 2024-08-17T02:26:19.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.489+0000 7f3dcaa0d700 1 -- 172.21.15.153:0/3633067295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dc4159040 msgr2=0x7f3dc40cf620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.489+0000 7f3dcaa0d700 1 --2- 172.21.15.153:0/3633067295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dc4159040 0x7f3dc40cf620 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3dc40b6130 tx=0x7f3dc0009250 comp rx=0 tx=0).stop 2024-08-17T02:26:19.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.489+0000 7f3dcaa0d700 1 -- 172.21.15.153:0/3633067295 shutdown_connections 2024-08-17T02:26:19.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.489+0000 7f3dcaa0d700 1 --2- 172.21.15.153:0/3633067295 >> v2:172.21.15.174:3300/0 conn(0x7f3dc415cea0 0x7f3dc415d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.489+0000 7f3dcaa0d700 1 --2- 172.21.15.153:0/3633067295 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3dc40d0010 0x7f3dc40d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.489+0000 7f3dcaa0d700 1 --2- 172.21.15.153:0/3633067295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dc4159040 0x7f3dc40cf620 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.489+0000 7f3dcaa0d700 1 -- 172.21.15.153:0/3633067295 >> 172.21.15.153:0/3633067295 conn(0x7f3dc4068250 msgr2=0x7f3dc4068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:19.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.489+0000 7f3dcaa0d700 1 -- 172.21.15.153:0/3633067295 shutdown_connections 2024-08-17T02:26:19.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.489+0000 7f3dcaa0d700 1 -- 172.21.15.153:0/3633067295 wait complete. 2024-08-17T02:26:19.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.489+0000 7f3dcaa0d700 1 Processor -- start 2024-08-17T02:26:19.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.489+0000 7f3dcaa0d700 1 -- start start 2024-08-17T02:26:19.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.493+0000 7f3dcaa0d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3dc40d0010 0x7f3dc40c6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.493+0000 7f3dcaa0d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dc4159040 0x7f3dc416a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.493+0000 7f3dcaa0d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3dc415cea0 0x7f3dc4167350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.493+0000 7f3dcaa0d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc416ae20 con 0x7f3dc4159040 2024-08-17T02:26:19.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.493+0000 7f3dcaa0d700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc416bc40 con 0x7f3dc415cea0 2024-08-17T02:26:19.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.493+0000 7f3dcaa0d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc416b030 con 0x7f3dc40d0010 2024-08-17T02:26:19.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.493+0000 7f3dc920a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dc4159040 0x7f3dc416a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.493+0000 7f3dc920a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dc4159040 0x7f3dc416a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57724/0 (socket says 172.21.15.153:57724) 2024-08-17T02:26:19.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.493+0000 7f3dc920a700 1 -- 172.21.15.153:0/3614331565 learned_addr learned my addr 172.21.15.153:0/3614331565 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:19.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.493+0000 7f3dca20c700 1 --2- 172.21.15.153:0/3614331565 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3dc415cea0 0x7f3dc4167350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.493+0000 7f3dc9a0b700 1 --2- 172.21.15.153:0/3614331565 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3dc40d0010 0x7f3dc40c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.493+0000 7f3dc920a700 1 -- 172.21.15.153:0/3614331565 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3dc40d0010 msgr2=0x7f3dc40c6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.493+0000 7f3dc920a700 1 --2- 172.21.15.153:0/3614331565 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3dc40d0010 0x7f3dc40c6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.493+0000 7f3dc920a700 1 -- 172.21.15.153:0/3614331565 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3dc415cea0 msgr2=0x7f3dc4167350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.493+0000 7f3dc920a700 1 --2- 172.21.15.153:0/3614331565 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3dc415cea0 0x7f3dc4167350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.493+0000 7f3dc920a700 1 -- 172.21.15.153:0/3614331565 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc00094f0 con 0x7f3dc4159040 2024-08-17T02:26:19.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.493+0000 7f3dca20c700 1 --2- 172.21.15.153:0/3614331565 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3dc415cea0 0x7f3dc4167350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:19.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.493+0000 7f3dc920a700 1 --2- 172.21.15.153:0/3614331565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dc4159040 0x7f3dc416a8e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3db400d890 tx=0x7f3db4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:19.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.493+0000 7f3db9ffb700 1 -- 172.21.15.153:0/3614331565 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db400b600 con 0x7f3dc4159040 2024-08-17T02:26:19.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.493+0000 7f3db9ffb700 1 -- 172.21.15.153:0/3614331565 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db400b760 con 0x7f3dc4159040 2024-08-17T02:26:19.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.493+0000 7f3dcaa0d700 1 -- 172.21.15.153:0/3614331565 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dc416b310 con 0x7f3dc4159040 2024-08-17T02:26:19.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.493+0000 7f3db9ffb700 1 -- 172.21.15.153:0/3614331565 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db400bae0 con 0x7f3dc4159040 2024-08-17T02:26:19.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.493+0000 7f3dcaa0d700 1 -- 172.21.15.153:0/3614331565 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dc416b8d0 con 0x7f3dc4159040 2024-08-17T02:26:19.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.493+0000 7f3dcaa0d700 1 -- 172.21.15.153:0/3614331565 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dc416bdb0 con 0x7f3dc4159040 2024-08-17T02:26:19.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.493+0000 7f3db9ffb700 1 -- 172.21.15.153:0/3614331565 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f3db401e460 con 0x7f3dc4159040 2024-08-17T02:26:19.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.497+0000 7f3db9ffb700 1 --2- 172.21.15.153:0/3614331565 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3da8060860 0x7f3da8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.497+0000 7f3dc9a0b700 1 --2- 172.21.15.153:0/3614331565 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3da8060860 0x7f3da8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.497+0000 7f3db9ffb700 1 -- 172.21.15.153:0/3614331565 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3db407d2c0 con 0x7f3dc4159040 2024-08-17T02:26:19.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.497+0000 7f3dc9a0b700 1 --2- 172.21.15.153:0/3614331565 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3da8060860 0x7f3da8062d10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3dc40b6130 tx=0x7f3dc0017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:19.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.505+0000 7f3db9ffb700 1 -- 172.21.15.153:0/3614331565 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f3db404d710 con 0x7f3dc4159040 2024-08-17T02:26:19.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.653+0000 7f3dcaa0d700 1 -- 172.21.15.153:0/3614331565 --> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3dc40643a0 con 0x7f3da8060860 2024-08-17T02:26:19.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.657+0000 7f3db9ffb700 1 -- 172.21.15.153:0/3614331565 <== mgr.4104 v2:172.21.15.153:6832/24147 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264504 (secure 0 0 0) 0x7f3dc40643a0 con 0x7f3da8060860 2024-08-17T02:26:19.666 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:19.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.665+0000 7f3dcaa0d700 1 -- 172.21.15.153:0/3614331565 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3da8060860 msgr2=0x7f3da8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.665+0000 7f3dcaa0d700 1 --2- 172.21.15.153:0/3614331565 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3da8060860 0x7f3da8062d10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3dc40b6130 tx=0x7f3dc0017000 comp rx=0 tx=0).stop 2024-08-17T02:26:19.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.665+0000 7f3dcaa0d700 1 -- 172.21.15.153:0/3614331565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dc4159040 msgr2=0x7f3dc416a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.665+0000 7f3dcaa0d700 1 --2- 172.21.15.153:0/3614331565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dc4159040 0x7f3dc416a8e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3db400d890 tx=0x7f3db4008040 comp rx=0 tx=0).stop 2024-08-17T02:26:19.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.665+0000 7f3dcaa0d700 1 -- 172.21.15.153:0/3614331565 shutdown_connections 2024-08-17T02:26:19.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.665+0000 7f3dcaa0d700 1 --2- 172.21.15.153:0/3614331565 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3da8060860 0x7f3da8062d10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.665+0000 7f3dcaa0d700 1 --2- 172.21.15.153:0/3614331565 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3dc415cea0 0x7f3dc4167350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.665+0000 7f3dcaa0d700 1 --2- 172.21.15.153:0/3614331565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dc4159040 0x7f3dc416a8e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.665+0000 7f3dcaa0d700 1 --2- 172.21.15.153:0/3614331565 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3dc40d0010 0x7f3dc40c6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.665+0000 7f3dcaa0d700 1 -- 172.21.15.153:0/3614331565 >> 172.21.15.153:0/3614331565 conn(0x7f3dc4068250 msgr2=0x7f3dc40b56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:19.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.665+0000 7f3dcaa0d700 1 -- 172.21.15.153:0/3614331565 shutdown_connections 2024-08-17T02:26:19.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.665+0000 7f3dcaa0d700 1 -- 172.21.15.153:0/3614331565 wait complete. 2024-08-17T02:26:19.669 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-08-17T02:26:19.679 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-08-17T02:26:18.037691+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381720,"kb_used_data":2856,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752593000,"statfs":{"total":773094113280,"available":770655232000,"internally_reserved":0,"allocated":2924544,"data_stored":1758748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.311962"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.788062+0000","last_change":"2024-08-17T02:26:12.777798+0000","last_active":"2024-08-17T02:26:12.788062+0000","last_peered":"2024-08-17T02:26:12.788062+0000","last_clean":"2024-08-17T02:26:12.788062+0000","last_became_active":"2024-08-17T02:26:12.776925+0000","last_became_peered":"2024-08-17T02:26:12.776925+0000","last_unstale":"2024-08-17T02:26:12.788062+0000","last_undegraded":"2024-08-17T02:26:12.788062+0000","last_fullsized":"2024-08-17T02:26:12.788062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:30:26.589185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.766974+0000","last_change":"2024-08-17T02:26:12.764803+0000","last_active":"2024-08-17T02:26:12.766974+0000","last_peered":"2024-08-17T02:26:12.766974+0000","last_clean":"2024-08-17T02:26:12.766974+0000","last_became_active":"2024-08-17T02:26:12.764396+0000","last_became_peered":"2024-08-17T02:26:12.764396+0000","last_unstale":"2024-08-17T02:26:12.766974+0000","last_undegraded":"2024-08-17T02:26:12.766974+0000","last_fullsized":"2024-08-17T02:26:12.766974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:35:38.652631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.762936+0000","last_change":"2024-08-17T02:26:12.758694+0000","last_active":"2024-08-17T02:26:12.762936+0000","last_peered":"2024-08-17T02:26:12.762936+0000","last_clean":"2024-08-17T02:26:12.762936+0000","last_became_active":"2024-08-17T02:26:12.758036+0000","last_became_peered":"2024-08-17T02:26:12.758036+0000","last_unstale":"2024-08-17T02:26:12.762936+0000","last_undegraded":"2024-08-17T02:26:12.762936+0000","last_fullsized":"2024-08-17T02:26:12.762936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:48:08.511164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.774763+0000","last_change":"2024-08-17T02:26:12.769763+0000","last_active":"2024-08-17T02:26:12.774763+0000","last_peered":"2024-08-17T02:26:12.774763+0000","last_clean":"2024-08-17T02:26:12.774763+0000","last_became_active":"2024-08-17T02:26:12.769481+0000","last_became_peered":"2024-08-17T02:26:12.769481+0000","last_unstale":"2024-08-17T02:26:12.774763+0000","last_undegraded":"2024-08-17T02:26:12.774763+0000","last_fullsized":"2024-08-17T02:26:12.774763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:35:55.150476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.776688+0000","last_change":"2024-08-17T02:26:12.767565+0000","last_active":"2024-08-17T02:26:12.776688+0000","last_peered":"2024-08-17T02:26:12.776688+0000","last_clean":"2024-08-17T02:26:12.776688+0000","last_became_active":"2024-08-17T02:26:12.767168+0000","last_became_peered":"2024-08-17T02:26:12.767168+0000","last_unstale":"2024-08-17T02:26:12.776688+0000","last_undegraded":"2024-08-17T02:26:12.776688+0000","last_fullsized":"2024-08-17T02:26:12.776688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:02:03.668267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.768745+0000","last_change":"2024-08-17T02:26:12.763368+0000","last_active":"2024-08-17T02:26:12.768745+0000","last_peered":"2024-08-17T02:26:12.768745+0000","last_clean":"2024-08-17T02:26:12.768745+0000","last_became_active":"2024-08-17T02:26:12.763106+0000","last_became_peered":"2024-08-17T02:26:12.763106+0000","last_unstale":"2024-08-17T02:26:12.768745+0000","last_undegraded":"2024-08-17T02:26:12.768745+0000","last_fullsized":"2024-08-17T02:26:12.768745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:57:16.242016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.776719+0000","last_change":"2024-08-17T02:26:12.767440+0000","last_active":"2024-08-17T02:26:12.776719+0000","last_peered":"2024-08-17T02:26:12.776719+0000","last_clean":"2024-08-17T02:26:12.776719+0000","last_became_active":"2024-08-17T02:26:12.766962+0000","last_became_peered":"2024-08-17T02:26:12.766962+0000","last_unstale":"2024-08-17T02:26:12.776719+0000","last_undegraded":"2024-08-17T02:26:12.776719+0000","last_fullsized":"2024-08-17T02:26:12.776719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:57:16.242016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.773336+0000","last_change":"2024-08-17T02:26:12.768304+0000","last_active":"2024-08-17T02:26:12.773336+0000","last_peered":"2024-08-17T02:26:12.773336+0000","last_clean":"2024-08-17T02:26:12.773336+0000","last_became_active":"2024-08-17T02:26:12.768041+0000","last_became_peered":"2024-08-17T02:26:12.768041+0000","last_unstale":"2024-08-17T02:26:12.773336+0000","last_undegraded":"2024-08-17T02:26:12.773336+0000","last_fullsized":"2024-08-17T02:26:12.773336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:12:11.738249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.782933+0000","last_change":"2024-08-17T02:26:12.770547+0000","last_active":"2024-08-17T02:26:12.782933+0000","last_peered":"2024-08-17T02:26:12.782933+0000","last_clean":"2024-08-17T02:26:12.782933+0000","last_became_active":"2024-08-17T02:26:12.770189+0000","last_became_peered":"2024-08-17T02:26:12.770189+0000","last_unstale":"2024-08-17T02:26:12.782933+0000","last_undegraded":"2024-08-17T02:26:12.782933+0000","last_fullsized":"2024-08-17T02:26:12.782933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:28:12.295650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.768543+0000","last_change":"2024-08-17T02:26:12.762340+0000","last_active":"2024-08-17T02:26:12.768543+0000","last_peered":"2024-08-17T02:26:12.768543+0000","last_clean":"2024-08-17T02:26:12.768543+0000","last_became_active":"2024-08-17T02:26:12.762033+0000","last_became_peered":"2024-08-17T02:26:12.762033+0000","last_unstale":"2024-08-17T02:26:12.768543+0000","last_undegraded":"2024-08-17T02:26:12.768543+0000","last_fullsized":"2024-08-17T02:26:12.768543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:01:31.899155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.772316+0000","last_change":"2024-08-17T02:26:12.763725+0000","last_active":"2024-08-17T02:26:12.772316+0000","last_peered":"2024-08-17T02:26:12.772316+0000","last_clean":"2024-08-17T02:26:12.772316+0000","last_became_active":"2024-08-17T02:26:12.763362+0000","last_became_peered":"2024-08-17T02:26:12.763362+0000","last_unstale":"2024-08-17T02:26:12.772316+0000","last_undegraded":"2024-08-17T02:26:12.772316+0000","last_fullsized":"2024-08-17T02:26:12.772316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:35:38.652631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.769441+0000","last_change":"2024-08-17T02:26:12.760713+0000","last_active":"2024-08-17T02:26:12.769441+0000","last_peered":"2024-08-17T02:26:12.769441+0000","last_clean":"2024-08-17T02:26:12.769441+0000","last_became_active":"2024-08-17T02:26:12.760422+0000","last_became_peered":"2024-08-17T02:26:12.760422+0000","last_unstale":"2024-08-17T02:26:12.769441+0000","last_undegraded":"2024-08-17T02:26:12.769441+0000","last_fullsized":"2024-08-17T02:26:12.769441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:47:11.421230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.769079+0000","last_change":"2024-08-17T02:26:12.763523+0000","last_active":"2024-08-17T02:26:12.769079+0000","last_peered":"2024-08-17T02:26:12.769079+0000","last_clean":"2024-08-17T02:26:12.769079+0000","last_became_active":"2024-08-17T02:26:12.762838+0000","last_became_peered":"2024-08-17T02:26:12.762838+0000","last_unstale":"2024-08-17T02:26:12.769079+0000","last_undegraded":"2024-08-17T02:26:12.769079+0000","last_fullsized":"2024-08-17T02:26:12.769079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:35:55.150476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.763560+0000","last_change":"2024-08-17T02:26:12.762220+0000","last_active":"2024-08-17T02:26:12.763560+0000","last_peered":"2024-08-17T02:26:12.763560+0000","last_clean":"2024-08-17T02:26:12.763560+0000","last_became_active":"2024-08-17T02:26:12.761872+0000","last_became_peered":"2024-08-17T02:26:12.761872+0000","last_unstale":"2024-08-17T02:26:12.763560+0000","last_undegraded":"2024-08-17T02:26:12.763560+0000","last_fullsized":"2024-08-17T02:26:12.763560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:40:15.880102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.770390+0000","last_change":"2024-08-17T02:26:12.768586+0000","last_active":"2024-08-17T02:26:12.770390+0000","last_peered":"2024-08-17T02:26:12.770390+0000","last_clean":"2024-08-17T02:26:12.770390+0000","last_became_active":"2024-08-17T02:26:12.768293+0000","last_became_peered":"2024-08-17T02:26:12.768293+0000","last_unstale":"2024-08-17T02:26:12.770390+0000","last_undegraded":"2024-08-17T02:26:12.770390+0000","last_fullsized":"2024-08-17T02:26:12.770390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:22.659534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.765002+0000","last_change":"2024-08-17T02:26:12.757448+0000","last_active":"2024-08-17T02:26:12.765002+0000","last_peered":"2024-08-17T02:26:12.765002+0000","last_clean":"2024-08-17T02:26:12.765002+0000","last_became_active":"2024-08-17T02:26:12.755026+0000","last_became_peered":"2024-08-17T02:26:12.755026+0000","last_unstale":"2024-08-17T02:26:12.765002+0000","last_undegraded":"2024-08-17T02:26:12.765002+0000","last_fullsized":"2024-08-17T02:26:12.765002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:22.659534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.774812+0000","last_change":"2024-08-17T02:26:12.770619+0000","last_active":"2024-08-17T02:26:12.774812+0000","last_peered":"2024-08-17T02:26:12.774812+0000","last_clean":"2024-08-17T02:26:12.774812+0000","last_became_active":"2024-08-17T02:26:12.770280+0000","last_became_peered":"2024-08-17T02:26:12.770280+0000","last_unstale":"2024-08-17T02:26:12.774812+0000","last_undegraded":"2024-08-17T02:26:12.774812+0000","last_fullsized":"2024-08-17T02:26:12.774812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:09:06.162369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.763960+0000","last_change":"2024-08-17T02:26:12.761378+0000","last_active":"2024-08-17T02:26:12.763960+0000","last_peered":"2024-08-17T02:26:12.763960+0000","last_clean":"2024-08-17T02:26:12.763960+0000","last_became_active":"2024-08-17T02:26:12.761023+0000","last_became_peered":"2024-08-17T02:26:12.761023+0000","last_unstale":"2024-08-17T02:26:12.763960+0000","last_undegraded":"2024-08-17T02:26:12.763960+0000","last_fullsized":"2024-08-17T02:26:12.763960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:48:08.511164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.772755+0000","last_change":"2024-08-17T02:26:12.767191+0000","last_active":"2024-08-17T02:26:12.772755+0000","last_peered":"2024-08-17T02:26:12.772755+0000","last_clean":"2024-08-17T02:26:12.772755+0000","last_became_active":"2024-08-17T02:26:12.766917+0000","last_became_peered":"2024-08-17T02:26:12.766917+0000","last_unstale":"2024-08-17T02:26:12.772755+0000","last_undegraded":"2024-08-17T02:26:12.772755+0000","last_fullsized":"2024-08-17T02:26:12.772755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:52.096067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.773863+0000","last_change":"2024-08-17T02:26:12.769217+0000","last_active":"2024-08-17T02:26:12.773863+0000","last_peered":"2024-08-17T02:26:12.773863+0000","last_clean":"2024-08-17T02:26:12.773863+0000","last_became_active":"2024-08-17T02:26:12.768948+0000","last_became_peered":"2024-08-17T02:26:12.768948+0000","last_unstale":"2024-08-17T02:26:12.773863+0000","last_undegraded":"2024-08-17T02:26:12.773863+0000","last_fullsized":"2024-08-17T02:26:12.773863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:22.659534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.767928+0000","last_change":"2024-08-17T02:26:12.764704+0000","last_active":"2024-08-17T02:26:12.767928+0000","last_peered":"2024-08-17T02:26:12.767928+0000","last_clean":"2024-08-17T02:26:12.767928+0000","last_became_active":"2024-08-17T02:26:12.764364+0000","last_became_peered":"2024-08-17T02:26:12.764364+0000","last_unstale":"2024-08-17T02:26:12.767928+0000","last_undegraded":"2024-08-17T02:26:12.767928+0000","last_fullsized":"2024-08-17T02:26:12.767928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:04:38.025404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.774928+0000","last_change":"2024-08-17T02:26:12.771719+0000","last_active":"2024-08-17T02:26:12.774928+0000","last_peered":"2024-08-17T02:26:12.774928+0000","last_clean":"2024-08-17T02:26:12.774928+0000","last_became_active":"2024-08-17T02:26:12.770932+0000","last_became_peered":"2024-08-17T02:26:12.770932+0000","last_unstale":"2024-08-17T02:26:12.774928+0000","last_undegraded":"2024-08-17T02:26:12.774928+0000","last_fullsized":"2024-08-17T02:26:12.774928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:12:11.738249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.773471+0000","last_change":"2024-08-17T02:26:12.768435+0000","last_active":"2024-08-17T02:26:12.773471+0000","last_peered":"2024-08-17T02:26:12.773471+0000","last_clean":"2024-08-17T02:26:12.773471+0000","last_became_active":"2024-08-17T02:26:12.768140+0000","last_became_peered":"2024-08-17T02:26:12.768140+0000","last_unstale":"2024-08-17T02:26:12.773471+0000","last_undegraded":"2024-08-17T02:26:12.773471+0000","last_fullsized":"2024-08-17T02:26:12.773471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:02:03.668267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.774691+0000","last_change":"2024-08-17T02:26:12.769539+0000","last_active":"2024-08-17T02:26:12.774691+0000","last_peered":"2024-08-17T02:26:12.774691+0000","last_clean":"2024-08-17T02:26:12.774691+0000","last_became_active":"2024-08-17T02:26:12.769265+0000","last_became_peered":"2024-08-17T02:26:12.769265+0000","last_unstale":"2024-08-17T02:26:12.774691+0000","last_undegraded":"2024-08-17T02:26:12.774691+0000","last_fullsized":"2024-08-17T02:26:12.774691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:30:26.589185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.777445+0000","last_change":"2024-08-17T02:26:12.770914+0000","last_active":"2024-08-17T02:26:12.777445+0000","last_peered":"2024-08-17T02:26:12.777445+0000","last_clean":"2024-08-17T02:26:12.777445+0000","last_became_active":"2024-08-17T02:26:12.770412+0000","last_became_peered":"2024-08-17T02:26:12.770412+0000","last_unstale":"2024-08-17T02:26:12.777445+0000","last_undegraded":"2024-08-17T02:26:12.777445+0000","last_fullsized":"2024-08-17T02:26:12.777445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:01:31.899155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.773947+0000","last_change":"2024-08-17T02:26:12.771500+0000","last_active":"2024-08-17T02:26:12.773947+0000","last_peered":"2024-08-17T02:26:12.773947+0000","last_clean":"2024-08-17T02:26:12.773947+0000","last_became_active":"2024-08-17T02:26:12.771244+0000","last_became_peered":"2024-08-17T02:26:12.771244+0000","last_unstale":"2024-08-17T02:26:12.773947+0000","last_undegraded":"2024-08-17T02:26:12.773947+0000","last_fullsized":"2024-08-17T02:26:12.773947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:52.096067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.771527+0000","last_change":"2024-08-17T02:26:12.769916+0000","last_active":"2024-08-17T02:26:12.771527+0000","last_peered":"2024-08-17T02:26:12.771527+0000","last_clean":"2024-08-17T02:26:12.771527+0000","last_became_active":"2024-08-17T02:26:12.769640+0000","last_became_peered":"2024-08-17T02:26:12.769640+0000","last_unstale":"2024-08-17T02:26:12.771527+0000","last_undegraded":"2024-08-17T02:26:12.771527+0000","last_fullsized":"2024-08-17T02:26:12.771527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:52.096067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.779660+0000","last_change":"2024-08-17T02:26:12.774242+0000","last_active":"2024-08-17T02:26:12.779660+0000","last_peered":"2024-08-17T02:26:12.779660+0000","last_clean":"2024-08-17T02:26:12.779660+0000","last_became_active":"2024-08-17T02:26:12.773927+0000","last_became_peered":"2024-08-17T02:26:12.773927+0000","last_unstale":"2024-08-17T02:26:12.779660+0000","last_undegraded":"2024-08-17T02:26:12.779660+0000","last_fullsized":"2024-08-17T02:26:12.779660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:57:43.119108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.773690+0000","last_change":"2024-08-17T02:26:12.771799+0000","last_active":"2024-08-17T02:26:12.773690+0000","last_peered":"2024-08-17T02:26:12.773690+0000","last_clean":"2024-08-17T02:26:12.773690+0000","last_became_active":"2024-08-17T02:26:12.771451+0000","last_became_peered":"2024-08-17T02:26:12.771451+0000","last_unstale":"2024-08-17T02:26:12.773690+0000","last_undegraded":"2024-08-17T02:26:12.773690+0000","last_fullsized":"2024-08-17T02:26:12.773690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:49:58.271852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.774907+0000","last_change":"2024-08-17T02:26:12.771407+0000","last_active":"2024-08-17T02:26:12.774907+0000","last_peered":"2024-08-17T02:26:12.774907+0000","last_clean":"2024-08-17T02:26:12.774907+0000","last_became_active":"2024-08-17T02:26:12.770406+0000","last_became_peered":"2024-08-17T02:26:12.770406+0000","last_unstale":"2024-08-17T02:26:12.774907+0000","last_undegraded":"2024-08-17T02:26:12.774907+0000","last_fullsized":"2024-08-17T02:26:12.774907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:46:54.172659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.767647+0000","last_change":"2024-08-17T02:26:12.764126+0000","last_active":"2024-08-17T02:26:12.767647+0000","last_peered":"2024-08-17T02:26:12.767647+0000","last_clean":"2024-08-17T02:26:12.767647+0000","last_became_active":"2024-08-17T02:26:12.763871+0000","last_became_peered":"2024-08-17T02:26:12.763871+0000","last_unstale":"2024-08-17T02:26:12.767647+0000","last_undegraded":"2024-08-17T02:26:12.767647+0000","last_fullsized":"2024-08-17T02:26:12.767647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:52.634628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.772373+0000","last_change":"2024-08-17T02:26:12.766452+0000","last_active":"2024-08-17T02:26:12.772373+0000","last_peered":"2024-08-17T02:26:12.772373+0000","last_clean":"2024-08-17T02:26:12.772373+0000","last_became_active":"2024-08-17T02:26:12.766197+0000","last_became_peered":"2024-08-17T02:26:12.766197+0000","last_unstale":"2024-08-17T02:26:12.772373+0000","last_undegraded":"2024-08-17T02:26:12.772373+0000","last_fullsized":"2024-08-17T02:26:12.772373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:56:34.246512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.771933+0000","last_change":"2024-08-17T02:26:12.767925+0000","last_active":"2024-08-17T02:26:12.771933+0000","last_peered":"2024-08-17T02:26:12.771933+0000","last_clean":"2024-08-17T02:26:12.771933+0000","last_became_active":"2024-08-17T02:26:12.767638+0000","last_became_peered":"2024-08-17T02:26:12.767638+0000","last_unstale":"2024-08-17T02:26:12.771933+0000","last_undegraded":"2024-08-17T02:26:12.771933+0000","last_fullsized":"2024-08-17T02:26:12.771933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:17:50.872489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.788926+0000","last_change":"2024-08-17T02:26:11.752462+0000","last_active":"2024-08-17T02:26:12.788926+0000","last_peered":"2024-08-17T02:26:12.788926+0000","last_clean":"2024-08-17T02:26:12.788926+0000","last_became_active":"2024-08-17T02:26:11.752167+0000","last_became_peered":"2024-08-17T02:26:11.752167+0000","last_unstale":"2024-08-17T02:26:12.788926+0000","last_undegraded":"2024-08-17T02:26:12.788926+0000","last_fullsized":"2024-08-17T02:26:12.788926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:28:45.373009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.763201+0000","last_change":"2024-08-17T02:26:12.761203+0000","last_active":"2024-08-17T02:26:12.763201+0000","last_peered":"2024-08-17T02:26:12.763201+0000","last_clean":"2024-08-17T02:26:12.763201+0000","last_became_active":"2024-08-17T02:26:12.759701+0000","last_became_peered":"2024-08-17T02:26:12.759701+0000","last_unstale":"2024-08-17T02:26:12.763201+0000","last_undegraded":"2024-08-17T02:26:12.763201+0000","last_fullsized":"2024-08-17T02:26:12.763201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:11:48.128685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.780138+0000","last_change":"2024-08-17T02:26:11.744002+0000","last_active":"2024-08-17T02:26:12.780138+0000","last_peered":"2024-08-17T02:26:12.780138+0000","last_clean":"2024-08-17T02:26:12.780138+0000","last_became_active":"2024-08-17T02:26:11.743661+0000","last_became_peered":"2024-08-17T02:26:11.743661+0000","last_unstale":"2024-08-17T02:26:12.780138+0000","last_undegraded":"2024-08-17T02:26:12.780138+0000","last_fullsized":"2024-08-17T02:26:12.780138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:12.144056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.760330+0000","last_change":"2024-08-17T02:26:11.742090+0000","last_active":"2024-08-17T02:26:12.760330+0000","last_peered":"2024-08-17T02:26:12.760330+0000","last_clean":"2024-08-17T02:26:12.760330+0000","last_became_active":"2024-08-17T02:26:11.741738+0000","last_became_peered":"2024-08-17T02:26:11.741738+0000","last_unstale":"2024-08-17T02:26:12.760330+0000","last_undegraded":"2024-08-17T02:26:12.760330+0000","last_fullsized":"2024-08-17T02:26:12.760330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:16.129872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.769078+0000","last_change":"2024-08-17T02:26:12.766090+0000","last_active":"2024-08-17T02:26:12.769078+0000","last_peered":"2024-08-17T02:26:12.769078+0000","last_clean":"2024-08-17T02:26:12.769078+0000","last_became_active":"2024-08-17T02:26:12.765809+0000","last_became_peered":"2024-08-17T02:26:12.765809+0000","last_unstale":"2024-08-17T02:26:12.769078+0000","last_undegraded":"2024-08-17T02:26:12.769078+0000","last_fullsized":"2024-08-17T02:26:12.769078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:30:26.589185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.749399+0000","last_change":"2024-08-17T02:26:11.747004+0000","last_active":"2024-08-17T02:26:12.749399+0000","last_peered":"2024-08-17T02:26:12.749399+0000","last_clean":"2024-08-17T02:26:12.749399+0000","last_became_active":"2024-08-17T02:26:11.742575+0000","last_became_peered":"2024-08-17T02:26:11.742575+0000","last_unstale":"2024-08-17T02:26:12.749399+0000","last_undegraded":"2024-08-17T02:26:12.749399+0000","last_fullsized":"2024-08-17T02:26:12.749399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:19:02.670677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.772394+0000","last_change":"2024-08-17T02:26:12.770011+0000","last_active":"2024-08-17T02:26:12.772394+0000","last_peered":"2024-08-17T02:26:12.772394+0000","last_clean":"2024-08-17T02:26:12.772394+0000","last_became_active":"2024-08-17T02:26:12.769717+0000","last_became_peered":"2024-08-17T02:26:12.769717+0000","last_unstale":"2024-08-17T02:26:12.772394+0000","last_undegraded":"2024-08-17T02:26:12.772394+0000","last_fullsized":"2024-08-17T02:26:12.772394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:01:31.899155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.758697+0000","last_change":"2024-08-17T02:26:11.753364+0000","last_active":"2024-08-17T02:26:12.758697+0000","last_peered":"2024-08-17T02:26:12.758697+0000","last_clean":"2024-08-17T02:26:12.758697+0000","last_became_active":"2024-08-17T02:26:11.753151+0000","last_became_peered":"2024-08-17T02:26:11.753151+0000","last_unstale":"2024-08-17T02:26:12.758697+0000","last_undegraded":"2024-08-17T02:26:12.758697+0000","last_fullsized":"2024-08-17T02:26:12.758697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:16.129872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.765940+0000","last_change":"2024-08-17T02:26:12.764566+0000","last_active":"2024-08-17T02:26:12.765940+0000","last_peered":"2024-08-17T02:26:12.765940+0000","last_clean":"2024-08-17T02:26:12.765940+0000","last_became_active":"2024-08-17T02:26:12.764233+0000","last_became_peered":"2024-08-17T02:26:12.764233+0000","last_unstale":"2024-08-17T02:26:12.765940+0000","last_undegraded":"2024-08-17T02:26:12.765940+0000","last_fullsized":"2024-08-17T02:26:12.765940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:28:12.295650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.750417+0000","last_change":"2024-08-17T02:26:11.751390+0000","last_active":"2024-08-17T02:26:12.750417+0000","last_peered":"2024-08-17T02:26:12.750417+0000","last_clean":"2024-08-17T02:26:12.750417+0000","last_became_active":"2024-08-17T02:26:11.751114+0000","last_became_peered":"2024-08-17T02:26:11.751114+0000","last_unstale":"2024-08-17T02:26:12.750417+0000","last_undegraded":"2024-08-17T02:26:12.750417+0000","last_fullsized":"2024-08-17T02:26:12.750417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:50:23.467873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.767715+0000","last_change":"2024-08-17T02:26:12.763838+0000","last_active":"2024-08-17T02:26:12.767715+0000","last_peered":"2024-08-17T02:26:12.767715+0000","last_clean":"2024-08-17T02:26:12.767715+0000","last_became_active":"2024-08-17T02:26:12.763383+0000","last_became_peered":"2024-08-17T02:26:12.763383+0000","last_unstale":"2024-08-17T02:26:12.767715+0000","last_undegraded":"2024-08-17T02:26:12.767715+0000","last_fullsized":"2024-08-17T02:26:12.767715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:58:46.781607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.781109+0000","last_change":"2024-08-17T02:26:11.749300+0000","last_active":"2024-08-17T02:26:12.781109+0000","last_peered":"2024-08-17T02:26:12.781109+0000","last_clean":"2024-08-17T02:26:12.781109+0000","last_became_active":"2024-08-17T02:26:11.748641+0000","last_became_peered":"2024-08-17T02:26:11.748641+0000","last_unstale":"2024-08-17T02:26:12.781109+0000","last_undegraded":"2024-08-17T02:26:12.781109+0000","last_fullsized":"2024-08-17T02:26:12.781109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:17:49.864348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.773125+0000","last_change":"2024-08-17T02:26:12.768314+0000","last_active":"2024-08-17T02:26:12.773125+0000","last_peered":"2024-08-17T02:26:12.773125+0000","last_clean":"2024-08-17T02:26:12.773125+0000","last_became_active":"2024-08-17T02:26:12.768066+0000","last_became_peered":"2024-08-17T02:26:12.768066+0000","last_unstale":"2024-08-17T02:26:12.773125+0000","last_undegraded":"2024-08-17T02:26:12.773125+0000","last_fullsized":"2024-08-17T02:26:12.773125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:28:46.381149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.790010+0000","last_change":"2024-08-17T02:26:11.745150+0000","last_active":"2024-08-17T02:26:12.790010+0000","last_peered":"2024-08-17T02:26:12.790010+0000","last_clean":"2024-08-17T02:26:12.790010+0000","last_became_active":"2024-08-17T02:26:11.744417+0000","last_became_peered":"2024-08-17T02:26:11.744417+0000","last_unstale":"2024-08-17T02:26:12.790010+0000","last_undegraded":"2024-08-17T02:26:12.790010+0000","last_fullsized":"2024-08-17T02:26:12.790010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:01:19.012403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.782538+0000","last_change":"2024-08-17T02:26:12.771891+0000","last_active":"2024-08-17T02:26:12.782538+0000","last_peered":"2024-08-17T02:26:12.782538+0000","last_clean":"2024-08-17T02:26:12.782538+0000","last_became_active":"2024-08-17T02:26:12.771553+0000","last_became_peered":"2024-08-17T02:26:12.771553+0000","last_unstale":"2024-08-17T02:26:12.782538+0000","last_undegraded":"2024-08-17T02:26:12.782538+0000","last_fullsized":"2024-08-17T02:26:12.782538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:09:06.162369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.783558+0000","last_change":"2024-08-17T02:26:11.743421+0000","last_active":"2024-08-17T02:26:12.783558+0000","last_peered":"2024-08-17T02:26:12.783558+0000","last_clean":"2024-08-17T02:26:12.783558+0000","last_became_active":"2024-08-17T02:26:11.743158+0000","last_became_peered":"2024-08-17T02:26:11.743158+0000","last_unstale":"2024-08-17T02:26:12.783558+0000","last_undegraded":"2024-08-17T02:26:12.783558+0000","last_fullsized":"2024-08-17T02:26:12.783558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:09:59.680512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.770940+0000","last_change":"2024-08-17T02:26:12.769818+0000","last_active":"2024-08-17T02:26:12.770940+0000","last_peered":"2024-08-17T02:26:12.770940+0000","last_clean":"2024-08-17T02:26:12.770940+0000","last_became_active":"2024-08-17T02:26:12.769239+0000","last_became_peered":"2024-08-17T02:26:12.769239+0000","last_unstale":"2024-08-17T02:26:12.770940+0000","last_undegraded":"2024-08-17T02:26:12.770940+0000","last_fullsized":"2024-08-17T02:26:12.770940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:18.753712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.754444+0000","last_change":"2024-08-17T02:26:11.750830+0000","last_active":"2024-08-17T02:26:12.754444+0000","last_peered":"2024-08-17T02:26:12.754444+0000","last_clean":"2024-08-17T02:26:12.754444+0000","last_became_active":"2024-08-17T02:26:11.750327+0000","last_became_peered":"2024-08-17T02:26:11.750327+0000","last_unstale":"2024-08-17T02:26:12.754444+0000","last_undegraded":"2024-08-17T02:26:12.754444+0000","last_fullsized":"2024-08-17T02:26:12.754444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:44:31.584691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.787928+0000","last_change":"2024-08-17T02:26:12.776592+0000","last_active":"2024-08-17T02:26:12.787928+0000","last_peered":"2024-08-17T02:26:12.787928+0000","last_clean":"2024-08-17T02:26:12.787928+0000","last_became_active":"2024-08-17T02:26:12.772976+0000","last_became_peered":"2024-08-17T02:26:12.772976+0000","last_unstale":"2024-08-17T02:26:12.787928+0000","last_undegraded":"2024-08-17T02:26:12.787928+0000","last_fullsized":"2024-08-17T02:26:12.787928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:12:11.738249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.756908+0000","last_change":"2024-08-17T02:26:11.744845+0000","last_active":"2024-08-17T02:26:12.756908+0000","last_peered":"2024-08-17T02:26:12.756908+0000","last_clean":"2024-08-17T02:26:12.756908+0000","last_became_active":"2024-08-17T02:26:11.743525+0000","last_became_peered":"2024-08-17T02:26:11.743525+0000","last_unstale":"2024-08-17T02:26:12.756908+0000","last_undegraded":"2024-08-17T02:26:12.756908+0000","last_fullsized":"2024-08-17T02:26:12.756908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:19:02.670677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.772355+0000","last_change":"2024-08-17T02:26:12.764059+0000","last_active":"2024-08-17T02:26:12.772355+0000","last_peered":"2024-08-17T02:26:12.772355+0000","last_clean":"2024-08-17T02:26:12.772355+0000","last_became_active":"2024-08-17T02:26:12.763801+0000","last_became_peered":"2024-08-17T02:26:12.763801+0000","last_unstale":"2024-08-17T02:26:12.772355+0000","last_undegraded":"2024-08-17T02:26:12.772355+0000","last_fullsized":"2024-08-17T02:26:12.772355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:00.945590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.782776+0000","last_change":"2024-08-17T02:26:11.745341+0000","last_active":"2024-08-17T02:26:12.782776+0000","last_peered":"2024-08-17T02:26:12.782776+0000","last_clean":"2024-08-17T02:26:12.782776+0000","last_became_active":"2024-08-17T02:26:11.745025+0000","last_became_peered":"2024-08-17T02:26:11.745025+0000","last_unstale":"2024-08-17T02:26:12.782776+0000","last_undegraded":"2024-08-17T02:26:12.782776+0000","last_fullsized":"2024-08-17T02:26:12.782776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:47:43.451789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.787814+0000","last_change":"2024-08-17T02:26:12.772497+0000","last_active":"2024-08-17T02:26:12.787814+0000","last_peered":"2024-08-17T02:26:12.787814+0000","last_clean":"2024-08-17T02:26:12.787814+0000","last_became_active":"2024-08-17T02:26:12.772175+0000","last_became_peered":"2024-08-17T02:26:12.772175+0000","last_unstale":"2024-08-17T02:26:12.787814+0000","last_undegraded":"2024-08-17T02:26:12.787814+0000","last_fullsized":"2024-08-17T02:26:12.787814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:36:24.497583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.779889+0000","last_change":"2024-08-17T02:26:11.742829+0000","last_active":"2024-08-17T02:26:12.779889+0000","last_peered":"2024-08-17T02:26:12.779889+0000","last_clean":"2024-08-17T02:26:12.779889+0000","last_became_active":"2024-08-17T02:26:11.742316+0000","last_became_peered":"2024-08-17T02:26:11.742316+0000","last_unstale":"2024-08-17T02:26:12.779889+0000","last_undegraded":"2024-08-17T02:26:12.779889+0000","last_fullsized":"2024-08-17T02:26:12.779889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:10.151157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.788029+0000","last_change":"2024-08-17T02:26:12.777702+0000","last_active":"2024-08-17T02:26:12.788029+0000","last_peered":"2024-08-17T02:26:12.788029+0000","last_clean":"2024-08-17T02:26:12.788029+0000","last_became_active":"2024-08-17T02:26:12.777420+0000","last_became_peered":"2024-08-17T02:26:12.777420+0000","last_unstale":"2024-08-17T02:26:12.788029+0000","last_undegraded":"2024-08-17T02:26:12.788029+0000","last_fullsized":"2024-08-17T02:26:12.788029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:32:22.491464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.782079+0000","last_change":"2024-08-17T02:26:11.746064+0000","last_active":"2024-08-17T02:26:12.782079+0000","last_peered":"2024-08-17T02:26:12.782079+0000","last_clean":"2024-08-17T02:26:12.782079+0000","last_became_active":"2024-08-17T02:26:11.745735+0000","last_became_peered":"2024-08-17T02:26:11.745735+0000","last_unstale":"2024-08-17T02:26:12.782079+0000","last_undegraded":"2024-08-17T02:26:12.782079+0000","last_fullsized":"2024-08-17T02:26:12.782079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:18:27.869243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.788259+0000","last_change":"2024-08-17T02:26:12.780624+0000","last_active":"2024-08-17T02:26:12.788259+0000","last_peered":"2024-08-17T02:26:12.788259+0000","last_clean":"2024-08-17T02:26:12.788259+0000","last_became_active":"2024-08-17T02:26:12.778112+0000","last_became_peered":"2024-08-17T02:26:12.778112+0000","last_unstale":"2024-08-17T02:26:12.788259+0000","last_undegraded":"2024-08-17T02:26:12.788259+0000","last_fullsized":"2024-08-17T02:26:12.788259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:46:54.172659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.783515+0000","last_change":"2024-08-17T02:26:11.743505+0000","last_active":"2024-08-17T02:26:12.783515+0000","last_peered":"2024-08-17T02:26:12.783515+0000","last_clean":"2024-08-17T02:26:12.783515+0000","last_became_active":"2024-08-17T02:26:11.743235+0000","last_became_peered":"2024-08-17T02:26:11.743235+0000","last_unstale":"2024-08-17T02:26:12.783515+0000","last_undegraded":"2024-08-17T02:26:12.783515+0000","last_fullsized":"2024-08-17T02:26:12.783515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:16.129872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.774742+0000","last_change":"2024-08-17T02:26:12.769747+0000","last_active":"2024-08-17T02:26:12.774742+0000","last_peered":"2024-08-17T02:26:12.774742+0000","last_clean":"2024-08-17T02:26:12.774742+0000","last_became_active":"2024-08-17T02:26:12.769129+0000","last_became_peered":"2024-08-17T02:26:12.769129+0000","last_unstale":"2024-08-17T02:26:12.774742+0000","last_undegraded":"2024-08-17T02:26:12.774742+0000","last_fullsized":"2024-08-17T02:26:12.774742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:02:03.668267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.752138+0000","last_change":"2024-08-17T02:26:11.744390+0000","last_active":"2024-08-17T02:26:12.752138+0000","last_peered":"2024-08-17T02:26:12.752138+0000","last_clean":"2024-08-17T02:26:12.752138+0000","last_became_active":"2024-08-17T02:26:11.744090+0000","last_became_peered":"2024-08-17T02:26:11.744090+0000","last_unstale":"2024-08-17T02:26:12.752138+0000","last_undegraded":"2024-08-17T02:26:12.752138+0000","last_fullsized":"2024-08-17T02:26:12.752138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:45:35.172781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.787941+0000","last_change":"2024-08-17T02:26:12.776646+0000","last_active":"2024-08-17T02:26:12.787941+0000","last_peered":"2024-08-17T02:26:12.787941+0000","last_clean":"2024-08-17T02:26:12.787941+0000","last_became_active":"2024-08-17T02:26:12.776339+0000","last_became_peered":"2024-08-17T02:26:12.776339+0000","last_unstale":"2024-08-17T02:26:12.787941+0000","last_undegraded":"2024-08-17T02:26:12.787941+0000","last_fullsized":"2024-08-17T02:26:12.787941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:39:46.134798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.759672+0000","last_change":"2024-08-17T02:26:00.033569+0000","last_active":"2024-08-17T02:26:12.759672+0000","last_peered":"2024-08-17T02:26:12.759672+0000","last_clean":"2024-08-17T02:26:12.759672+0000","last_became_active":"2024-08-17T02:26:00.031512+0000","last_became_peered":"2024-08-17T02:26:00.031512+0000","last_unstale":"2024-08-17T02:26:12.759672+0000","last_undegraded":"2024-08-17T02:26:12.759672+0000","last_fullsized":"2024-08-17T02:26:12.759672+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:58.643690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:58.643690+0000","last_clean_scrub_stamp":"2024-08-17T02:25:58.643690+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:47:24.121981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.748244+0000","last_change":"2024-08-17T02:26:11.747504+0000","last_active":"2024-08-17T02:26:12.748244+0000","last_peered":"2024-08-17T02:26:12.748244+0000","last_clean":"2024-08-17T02:26:12.748244+0000","last_became_active":"2024-08-17T02:26:11.747162+0000","last_became_peered":"2024-08-17T02:26:11.747162+0000","last_unstale":"2024-08-17T02:26:12.748244+0000","last_undegraded":"2024-08-17T02:26:12.748244+0000","last_fullsized":"2024-08-17T02:26:12.748244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:01:19.012403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.779564+0000","last_change":"2024-08-17T02:26:12.772153+0000","last_active":"2024-08-17T02:26:12.779564+0000","last_peered":"2024-08-17T02:26:12.779564+0000","last_clean":"2024-08-17T02:26:12.779564+0000","last_became_active":"2024-08-17T02:26:12.771909+0000","last_became_peered":"2024-08-17T02:26:12.771909+0000","last_unstale":"2024-08-17T02:26:12.779564+0000","last_undegraded":"2024-08-17T02:26:12.779564+0000","last_fullsized":"2024-08-17T02:26:12.779564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:46:54.172659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.759288+0000","last_change":"2024-08-17T02:26:11.755283+0000","last_active":"2024-08-17T02:26:12.759288+0000","last_peered":"2024-08-17T02:26:12.759288+0000","last_clean":"2024-08-17T02:26:12.759288+0000","last_became_active":"2024-08-17T02:26:11.754919+0000","last_became_peered":"2024-08-17T02:26:11.754919+0000","last_unstale":"2024-08-17T02:26:12.759288+0000","last_undegraded":"2024-08-17T02:26:12.759288+0000","last_fullsized":"2024-08-17T02:26:12.759288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:47:10.413089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.763629+0000","last_change":"2024-08-17T02:26:12.758664+0000","last_active":"2024-08-17T02:26:12.763629+0000","last_peered":"2024-08-17T02:26:12.763629+0000","last_clean":"2024-08-17T02:26:12.763629+0000","last_became_active":"2024-08-17T02:26:12.758221+0000","last_became_peered":"2024-08-17T02:26:12.758221+0000","last_unstale":"2024-08-17T02:26:12.763629+0000","last_undegraded":"2024-08-17T02:26:12.763629+0000","last_fullsized":"2024-08-17T02:26:12.763629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:15:37.296290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.754545+0000","last_change":"2024-08-17T02:26:11.746935+0000","last_active":"2024-08-17T02:26:12.754545+0000","last_peered":"2024-08-17T02:26:12.754545+0000","last_clean":"2024-08-17T02:26:12.754545+0000","last_became_active":"2024-08-17T02:26:11.746769+0000","last_became_peered":"2024-08-17T02:26:11.746769+0000","last_unstale":"2024-08-17T02:26:12.754545+0000","last_undegraded":"2024-08-17T02:26:12.754545+0000","last_fullsized":"2024-08-17T02:26:12.754545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:31:45.321709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.762938+0000","last_change":"2024-08-17T02:26:12.760578+0000","last_active":"2024-08-17T02:26:12.762938+0000","last_peered":"2024-08-17T02:26:12.762938+0000","last_clean":"2024-08-17T02:26:12.762938+0000","last_became_active":"2024-08-17T02:26:12.760278+0000","last_became_peered":"2024-08-17T02:26:12.760278+0000","last_unstale":"2024-08-17T02:26:12.762938+0000","last_undegraded":"2024-08-17T02:26:12.762938+0000","last_fullsized":"2024-08-17T02:26:12.762938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:57:43.119108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.754788+0000","last_change":"2024-08-17T02:26:11.751106+0000","last_active":"2024-08-17T02:26:12.754788+0000","last_peered":"2024-08-17T02:26:12.754788+0000","last_clean":"2024-08-17T02:26:12.754788+0000","last_became_active":"2024-08-17T02:26:11.750673+0000","last_became_peered":"2024-08-17T02:26:11.750673+0000","last_unstale":"2024-08-17T02:26:12.754788+0000","last_undegraded":"2024-08-17T02:26:12.754788+0000","last_fullsized":"2024-08-17T02:26:12.754788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:16.129872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.772914+0000","last_change":"2024-08-17T02:26:12.766859+0000","last_active":"2024-08-17T02:26:12.772914+0000","last_peered":"2024-08-17T02:26:12.772914+0000","last_clean":"2024-08-17T02:26:12.772914+0000","last_became_active":"2024-08-17T02:26:12.766495+0000","last_became_peered":"2024-08-17T02:26:12.766495+0000","last_unstale":"2024-08-17T02:26:12.772914+0000","last_undegraded":"2024-08-17T02:26:12.772914+0000","last_fullsized":"2024-08-17T02:26:12.772914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:33:42.790374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.755000+0000","last_change":"2024-08-17T02:26:11.743487+0000","last_active":"2024-08-17T02:26:12.755000+0000","last_peered":"2024-08-17T02:26:12.755000+0000","last_clean":"2024-08-17T02:26:12.755000+0000","last_became_active":"2024-08-17T02:26:11.743202+0000","last_became_peered":"2024-08-17T02:26:11.743202+0000","last_unstale":"2024-08-17T02:26:12.755000+0000","last_undegraded":"2024-08-17T02:26:12.755000+0000","last_fullsized":"2024-08-17T02:26:12.755000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:01:19.012403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.774677+0000","last_change":"2024-08-17T02:26:12.769587+0000","last_active":"2024-08-17T02:26:12.774677+0000","last_peered":"2024-08-17T02:26:12.774677+0000","last_clean":"2024-08-17T02:26:12.774677+0000","last_became_active":"2024-08-17T02:26:12.769320+0000","last_became_peered":"2024-08-17T02:26:12.769320+0000","last_unstale":"2024-08-17T02:26:12.774677+0000","last_undegraded":"2024-08-17T02:26:12.774677+0000","last_fullsized":"2024-08-17T02:26:12.774677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:52.096067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.760638+0000","last_change":"2024-08-17T02:26:11.751886+0000","last_active":"2024-08-17T02:26:12.760638+0000","last_peered":"2024-08-17T02:26:12.760638+0000","last_clean":"2024-08-17T02:26:12.760638+0000","last_became_active":"2024-08-17T02:26:11.751183+0000","last_became_peered":"2024-08-17T02:26:11.751183+0000","last_unstale":"2024-08-17T02:26:12.760638+0000","last_undegraded":"2024-08-17T02:26:12.760638+0000","last_fullsized":"2024-08-17T02:26:12.760638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:17:49.864348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.762902+0000","last_change":"2024-08-17T02:26:12.760992+0000","last_active":"2024-08-17T02:26:12.762902+0000","last_peered":"2024-08-17T02:26:12.762902+0000","last_clean":"2024-08-17T02:26:12.762902+0000","last_became_active":"2024-08-17T02:26:12.760709+0000","last_became_peered":"2024-08-17T02:26:12.760709+0000","last_unstale":"2024-08-17T02:26:12.762902+0000","last_undegraded":"2024-08-17T02:26:12.762902+0000","last_fullsized":"2024-08-17T02:26:12.762902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:56:34.246512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:13.765976+0000","last_change":"2024-08-17T02:26:11.744348+0000","last_active":"2024-08-17T02:26:13.765976+0000","last_peered":"2024-08-17T02:26:13.765976+0000","last_clean":"2024-08-17T02:26:13.765976+0000","last_became_active":"2024-08-17T02:26:11.744074+0000","last_became_peered":"2024-08-17T02:26:11.744074+0000","last_unstale":"2024-08-17T02:26:13.765976+0000","last_undegraded":"2024-08-17T02:26:13.765976+0000","last_fullsized":"2024-08-17T02:26:13.765976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:12.144056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.773545+0000","last_change":"2024-08-17T02:26:12.769279+0000","last_active":"2024-08-17T02:26:12.773545+0000","last_peered":"2024-08-17T02:26:12.773545+0000","last_clean":"2024-08-17T02:26:12.773545+0000","last_became_active":"2024-08-17T02:26:12.768690+0000","last_became_peered":"2024-08-17T02:26:12.768690+0000","last_unstale":"2024-08-17T02:26:12.773545+0000","last_undegraded":"2024-08-17T02:26:12.773545+0000","last_fullsized":"2024-08-17T02:26:12.773545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:57:16.242016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.788598+0000","last_change":"2024-08-17T02:26:11.752392+0000","last_active":"2024-08-17T02:26:12.788598+0000","last_peered":"2024-08-17T02:26:12.788598+0000","last_clean":"2024-08-17T02:26:12.788598+0000","last_became_active":"2024-08-17T02:26:11.751991+0000","last_became_peered":"2024-08-17T02:26:11.751991+0000","last_unstale":"2024-08-17T02:26:12.788598+0000","last_undegraded":"2024-08-17T02:26:12.788598+0000","last_fullsized":"2024-08-17T02:26:12.788598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:28:45.373009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.763790+0000","last_change":"2024-08-17T02:26:12.759849+0000","last_active":"2024-08-17T02:26:12.763790+0000","last_peered":"2024-08-17T02:26:12.763790+0000","last_clean":"2024-08-17T02:26:12.763790+0000","last_became_active":"2024-08-17T02:26:12.759502+0000","last_became_peered":"2024-08-17T02:26:12.759502+0000","last_unstale":"2024-08-17T02:26:12.763790+0000","last_undegraded":"2024-08-17T02:26:12.763790+0000","last_fullsized":"2024-08-17T02:26:12.763790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:00:16.197120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.758942+0000","last_change":"2024-08-17T02:26:11.749500+0000","last_active":"2024-08-17T02:26:12.758942+0000","last_peered":"2024-08-17T02:26:12.758942+0000","last_clean":"2024-08-17T02:26:12.758942+0000","last_became_active":"2024-08-17T02:26:11.749109+0000","last_became_peered":"2024-08-17T02:26:11.749109+0000","last_unstale":"2024-08-17T02:26:12.758942+0000","last_undegraded":"2024-08-17T02:26:12.758942+0000","last_fullsized":"2024-08-17T02:26:12.758942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:33:41.782234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.771792+0000","last_change":"2024-08-17T02:26:12.767588+0000","last_active":"2024-08-17T02:26:12.771792+0000","last_peered":"2024-08-17T02:26:12.771792+0000","last_clean":"2024-08-17T02:26:12.771792+0000","last_became_active":"2024-08-17T02:26:12.767340+0000","last_became_peered":"2024-08-17T02:26:12.767340+0000","last_unstale":"2024-08-17T02:26:12.771792+0000","last_undegraded":"2024-08-17T02:26:12.771792+0000","last_fullsized":"2024-08-17T02:26:12.771792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:13.152196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.754893+0000","last_change":"2024-08-17T02:26:11.752823+0000","last_active":"2024-08-17T02:26:12.754893+0000","last_peered":"2024-08-17T02:26:12.754893+0000","last_clean":"2024-08-17T02:26:12.754893+0000","last_became_active":"2024-08-17T02:26:11.752550+0000","last_became_peered":"2024-08-17T02:26:11.752550+0000","last_unstale":"2024-08-17T02:26:12.754893+0000","last_undegraded":"2024-08-17T02:26:12.754893+0000","last_fullsized":"2024-08-17T02:26:12.754893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:28:45.373009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.769060+0000","last_change":"2024-08-17T02:26:12.765817+0000","last_active":"2024-08-17T02:26:12.769060+0000","last_peered":"2024-08-17T02:26:12.769060+0000","last_clean":"2024-08-17T02:26:12.769060+0000","last_became_active":"2024-08-17T02:26:12.765318+0000","last_became_peered":"2024-08-17T02:26:12.765318+0000","last_unstale":"2024-08-17T02:26:12.769060+0000","last_undegraded":"2024-08-17T02:26:12.769060+0000","last_fullsized":"2024-08-17T02:26:12.769060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:28:12.295650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.755330+0000","last_change":"2024-08-17T02:26:11.747437+0000","last_active":"2024-08-17T02:26:12.755330+0000","last_peered":"2024-08-17T02:26:12.755330+0000","last_clean":"2024-08-17T02:26:12.755330+0000","last_became_active":"2024-08-17T02:26:11.747213+0000","last_became_peered":"2024-08-17T02:26:11.747213+0000","last_unstale":"2024-08-17T02:26:12.755330+0000","last_undegraded":"2024-08-17T02:26:12.755330+0000","last_fullsized":"2024-08-17T02:26:12.755330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:33:41.782234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.769100+0000","last_change":"2024-08-17T02:26:12.765628+0000","last_active":"2024-08-17T02:26:12.769100+0000","last_peered":"2024-08-17T02:26:12.769100+0000","last_clean":"2024-08-17T02:26:12.769100+0000","last_became_active":"2024-08-17T02:26:12.765332+0000","last_became_peered":"2024-08-17T02:26:12.765332+0000","last_unstale":"2024-08-17T02:26:12.769100+0000","last_undegraded":"2024-08-17T02:26:12.769100+0000","last_fullsized":"2024-08-17T02:26:12.769100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:35:38.652631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.788340+0000","last_change":"2024-08-17T02:26:11.751615+0000","last_active":"2024-08-17T02:26:12.788340+0000","last_peered":"2024-08-17T02:26:12.788340+0000","last_clean":"2024-08-17T02:26:12.788340+0000","last_became_active":"2024-08-17T02:26:11.751145+0000","last_became_peered":"2024-08-17T02:26:11.751145+0000","last_unstale":"2024-08-17T02:26:12.788340+0000","last_undegraded":"2024-08-17T02:26:12.788340+0000","last_fullsized":"2024-08-17T02:26:12.788340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:28:45.373009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.773892+0000","last_change":"2024-08-17T02:26:12.769204+0000","last_active":"2024-08-17T02:26:12.773892+0000","last_peered":"2024-08-17T02:26:12.773892+0000","last_clean":"2024-08-17T02:26:12.773892+0000","last_became_active":"2024-08-17T02:26:12.768909+0000","last_became_peered":"2024-08-17T02:26:12.768909+0000","last_unstale":"2024-08-17T02:26:12.773892+0000","last_undegraded":"2024-08-17T02:26:12.773892+0000","last_fullsized":"2024-08-17T02:26:12.773892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:57:43.119108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.773689+0000","last_change":"2024-08-17T02:26:12.765911+0000","last_active":"2024-08-17T02:26:12.773689+0000","last_peered":"2024-08-17T02:26:12.773689+0000","last_clean":"2024-08-17T02:26:12.773689+0000","last_became_active":"2024-08-17T02:26:12.765109+0000","last_became_peered":"2024-08-17T02:26:12.765109+0000","last_unstale":"2024-08-17T02:26:12.773689+0000","last_undegraded":"2024-08-17T02:26:12.773689+0000","last_fullsized":"2024-08-17T02:26:12.773689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:58:46.756190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.788301+0000","last_change":"2024-08-17T02:26:11.755644+0000","last_active":"2024-08-17T02:26:12.788301+0000","last_peered":"2024-08-17T02:26:12.788301+0000","last_clean":"2024-08-17T02:26:12.788301+0000","last_became_active":"2024-08-17T02:26:11.755257+0000","last_became_peered":"2024-08-17T02:26:11.755257+0000","last_unstale":"2024-08-17T02:26:12.788301+0000","last_undegraded":"2024-08-17T02:26:12.788301+0000","last_fullsized":"2024-08-17T02:26:12.788301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:44:31.584691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.762324+0000","last_change":"2024-08-17T02:26:12.759902+0000","last_active":"2024-08-17T02:26:12.762324+0000","last_peered":"2024-08-17T02:26:12.762324+0000","last_clean":"2024-08-17T02:26:12.762324+0000","last_became_active":"2024-08-17T02:26:12.759616+0000","last_became_peered":"2024-08-17T02:26:12.759616+0000","last_unstale":"2024-08-17T02:26:12.762324+0000","last_undegraded":"2024-08-17T02:26:12.762324+0000","last_fullsized":"2024-08-17T02:26:12.762324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:57:43.119108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.788334+0000","last_change":"2024-08-17T02:26:11.751645+0000","last_active":"2024-08-17T02:26:12.788334+0000","last_peered":"2024-08-17T02:26:12.788334+0000","last_clean":"2024-08-17T02:26:12.788334+0000","last_became_active":"2024-08-17T02:26:11.751331+0000","last_became_peered":"2024-08-17T02:26:11.751331+0000","last_unstale":"2024-08-17T02:26:12.788334+0000","last_undegraded":"2024-08-17T02:26:12.788334+0000","last_fullsized":"2024-08-17T02:26:12.788334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:12.144056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.765093+0000","last_change":"2024-08-17T02:26:12.763641+0000","last_active":"2024-08-17T02:26:12.765093+0000","last_peered":"2024-08-17T02:26:12.765093+0000","last_clean":"2024-08-17T02:26:12.765093+0000","last_became_active":"2024-08-17T02:26:12.763027+0000","last_became_peered":"2024-08-17T02:26:12.763027+0000","last_unstale":"2024-08-17T02:26:12.765093+0000","last_undegraded":"2024-08-17T02:26:12.765093+0000","last_fullsized":"2024-08-17T02:26:12.765093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:49:37.970276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.780543+0000","last_change":"2024-08-17T02:26:11.748898+0000","last_active":"2024-08-17T02:26:12.780543+0000","last_peered":"2024-08-17T02:26:12.780543+0000","last_clean":"2024-08-17T02:26:12.780543+0000","last_became_active":"2024-08-17T02:26:11.748630+0000","last_became_peered":"2024-08-17T02:26:11.748630+0000","last_unstale":"2024-08-17T02:26:12.780543+0000","last_undegraded":"2024-08-17T02:26:12.780543+0000","last_fullsized":"2024-08-17T02:26:12.780543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:12.144056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.769043+0000","last_change":"2024-08-17T02:26:12.763150+0000","last_active":"2024-08-17T02:26:12.769043+0000","last_peered":"2024-08-17T02:26:12.769043+0000","last_clean":"2024-08-17T02:26:12.769043+0000","last_became_active":"2024-08-17T02:26:12.762858+0000","last_became_peered":"2024-08-17T02:26:12.762858+0000","last_unstale":"2024-08-17T02:26:12.769043+0000","last_undegraded":"2024-08-17T02:26:12.769043+0000","last_fullsized":"2024-08-17T02:26:12.769043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:09:06.162369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.789331+0000","last_change":"2024-08-17T02:26:11.750667+0000","last_active":"2024-08-17T02:26:12.789331+0000","last_peered":"2024-08-17T02:26:12.789331+0000","last_clean":"2024-08-17T02:26:12.789331+0000","last_became_active":"2024-08-17T02:26:11.750353+0000","last_became_peered":"2024-08-17T02:26:11.750353+0000","last_unstale":"2024-08-17T02:26:12.789331+0000","last_undegraded":"2024-08-17T02:26:12.789331+0000","last_fullsized":"2024-08-17T02:26:12.789331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:57:03.276859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298144,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073696,"statfs":{"total":96636764160,"available":96331464704,"internally_reserved":0,"allocated":806912,"data_stored":662605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.196}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3169999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":221184,"data_stored":73219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2809999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":212992,"data_stored":71757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":221184,"data_stored":71793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2250000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":221184,"data_stored":73219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4259999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":217088,"data_stored":71827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":208896,"data_stored":71667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]}]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298152,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073688,"statfs":{"total":96636764160,"available":96331456512,"internally_reserved":0,"allocated":815104,"data_stored":662661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:26:19.683 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:26:19.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.781+0000 7f49b359e700 1 Processor -- start 2024-08-17T02:26:19.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.781+0000 7f49b359e700 1 -- start start 2024-08-17T02:26:19.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.781+0000 7f49b359e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f49b4068ca0 0x7f49b4158af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.781+0000 7f49b359e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f49b4159030 0x7f49b40ab3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.781+0000 7f49b359e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49b40aa300 con 0x7f49b40688d0 2024-08-17T02:26:19.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.781+0000 7f49b359e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49b40aa5e0 con 0x7f49b4159030 2024-08-17T02:26:19.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.781+0000 7f49b359e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b40aa8c0 con 0x7f49b4068ca0 2024-08-17T02:26:19.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.781+0000 7f49b2d9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f49b4159030 0x7f49b40ab3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.781+0000 7f49b2d9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f49b4159030 0x7f49b40ab3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57732/0 (socket says 172.21.15.153:57732) 2024-08-17T02:26:19.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.781+0000 7f49b2d9d700 1 -- 172.21.15.153:0/3416842050 learned_addr learned my addr 172.21.15.153:0/3416842050 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:19.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.781+0000 7f49b259c700 1 --1- 172.21.15.153:0/3416842050 >> v1:172.21.15.153:6789/0 conn(0x7f49b40688d0 0x7f49b40a9860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35820/0 (socket says 172.21.15.153:35820) 2024-08-17T02:26:19.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.781+0000 7f49b1d9b700 1 --2- 172.21.15.153:0/3416842050 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f49b4068ca0 0x7f49b4158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.781+0000 7f49b2d9d700 1 -- 172.21.15.153:0/3416842050 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f49b4068ca0 msgr2=0x7f49b4158af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:19.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.781+0000 7f49b2d9d700 1 --2- 172.21.15.153:0/3416842050 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f49b4068ca0 0x7f49b4158af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.781+0000 7f49b2d9d700 1 -- 172.21.15.153:0/3416842050 >> v1:172.21.15.153:6789/0 conn(0x7f49b40688d0 legacy=0x7f49b40a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.781+0000 7f49b2d9d700 1 -- 172.21.15.153:0/3416842050 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b40aaba0 con 0x7f49b4159030 2024-08-17T02:26:19.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.781+0000 7f49b1d9b700 1 --2- 172.21.15.153:0/3416842050 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f49b4068ca0 0x7f49b4158af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:19.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.781+0000 7f49b2d9d700 1 --2- 172.21.15.153:0/3416842050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49b4159030 0x7f49b40ab3a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f49ac009f20 tx=0x7f49ac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b1dbcdc8e3dcab4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:19.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.781+0000 7f49b159a700 1 -- 172.21.15.153:0/3416842050 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ac00e070 con 0x7f49b4159030 2024-08-17T02:26:19.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.781+0000 7f49b159a700 1 -- 172.21.15.153:0/3416842050 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49ac00ba80 con 0x7f49b4159030 2024-08-17T02:26:19.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.781+0000 7f49b159a700 1 -- 172.21.15.153:0/3416842050 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ac0092e0 con 0x7f49b4159030 2024-08-17T02:26:19.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.785+0000 7f49b359e700 1 -- 172.21.15.153:0/3416842050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49b4159030 msgr2=0x7f49b40ab3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.785+0000 7f49b359e700 1 --2- 172.21.15.153:0/3416842050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49b4159030 0x7f49b40ab3a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f49ac009f20 tx=0x7f49ac009840 comp rx=0 tx=0).stop 2024-08-17T02:26:19.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.785+0000 7f49b359e700 1 -- 172.21.15.153:0/3416842050 shutdown_connections 2024-08-17T02:26:19.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.785+0000 7f49b359e700 1 --2- 172.21.15.153:0/3416842050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49b4159030 0x7f49b40ab3a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.785+0000 7f49b359e700 1 --2- 172.21.15.153:0/3416842050 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f49b4068ca0 0x7f49b4158af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.785+0000 7f49b359e700 1 -- 172.21.15.153:0/3416842050 >> 172.21.15.153:0/3416842050 conn(0x7f49b406d790 msgr2=0x7f49b406db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:19.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.785+0000 7f49b359e700 1 -- 172.21.15.153:0/3416842050 shutdown_connections 2024-08-17T02:26:19.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.785+0000 7f49b359e700 1 -- 172.21.15.153:0/3416842050 wait complete. 2024-08-17T02:26:19.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.785+0000 7f49b359e700 1 Processor -- start 2024-08-17T02:26:19.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.785+0000 7f49b359e700 1 -- start start 2024-08-17T02:26:19.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.785+0000 7f49b359e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f49b40688d0 0x7f49b41507f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.785+0000 7f49b359e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49b4068ca0 0x7f49b4153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.785+0000 7f49b359e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f49b4159030 0x7f49b414e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.785+0000 7f49b359e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b415b050 con 0x7f49b4068ca0 2024-08-17T02:26:19.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.785+0000 7f49b359e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b414e990 con 0x7f49b4159030 2024-08-17T02:26:19.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.785+0000 7f49b359e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b4150df0 con 0x7f49b40688d0 2024-08-17T02:26:19.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.785+0000 7f49b1d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49b4068ca0 0x7f49b4153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.785+0000 7f49b1d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49b4068ca0 0x7f49b4153fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57742/0 (socket says 172.21.15.153:57742) 2024-08-17T02:26:19.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.785+0000 7f49b1d9b700 1 -- 172.21.15.153:0/26895021 learned_addr learned my addr 172.21.15.153:0/26895021 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:19.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.785+0000 7f49b259c700 1 --2- 172.21.15.153:0/26895021 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f49b40688d0 0x7f49b41507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.785+0000 7f49b2d9d700 1 --2- 172.21.15.153:0/26895021 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f49b4159030 0x7f49b414e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.789+0000 7f49b1d9b700 1 -- 172.21.15.153:0/26895021 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f49b40688d0 msgr2=0x7f49b41507f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.789+0000 7f49b1d9b700 1 --2- 172.21.15.153:0/26895021 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f49b40688d0 0x7f49b41507f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.789+0000 7f49b1d9b700 1 -- 172.21.15.153:0/26895021 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f49b4159030 msgr2=0x7f49b414e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.789+0000 7f49b1d9b700 1 --2- 172.21.15.153:0/26895021 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f49b4159030 0x7f49b414e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.789+0000 7f49b1d9b700 1 -- 172.21.15.153:0/26895021 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ac009ae0 con 0x7f49b4068ca0 2024-08-17T02:26:19.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.789+0000 7f49b1d9b700 1 --2- 172.21.15.153:0/26895021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49b4068ca0 0x7f49b4153fa0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f499c00c830 tx=0x7f499c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:19.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.789+0000 7f49aa7fc700 1 -- 172.21.15.153:0/26895021 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c011600 con 0x7f49b4068ca0 2024-08-17T02:26:19.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.789+0000 7f49b359e700 1 -- 172.21.15.153:0/26895021 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49b41510d0 con 0x7f49b4068ca0 2024-08-17T02:26:19.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.789+0000 7f49aa7fc700 1 -- 172.21.15.153:0/26895021 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499c011760 con 0x7f49b4068ca0 2024-08-17T02:26:19.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.789+0000 7f49b359e700 1 -- 172.21.15.153:0/26895021 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49b4151690 con 0x7f49b4068ca0 2024-08-17T02:26:19.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.789+0000 7f49aa7fc700 1 -- 172.21.15.153:0/26895021 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c011b20 con 0x7f49b4068ca0 2024-08-17T02:26:19.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.793+0000 7f49b359e700 1 -- 172.21.15.153:0/26895021 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49b415b1c0 con 0x7f49b4068ca0 2024-08-17T02:26:19.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.793+0000 7f49aa7fc700 1 -- 172.21.15.153:0/26895021 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f499c00a3e0 con 0x7f49b4068ca0 2024-08-17T02:26:19.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.793+0000 7f49aa7fc700 1 --2- 172.21.15.153:0/26895021 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4994060860 0x7f4994062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.793+0000 7f49aa7fc700 1 -- 172.21.15.153:0/26895021 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f499c07d110 con 0x7f49b4068ca0 2024-08-17T02:26:19.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.793+0000 7f49b259c700 1 --2- 172.21.15.153:0/26895021 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4994060860 0x7f4994062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.793+0000 7f49b259c700 1 --2- 172.21.15.153:0/26895021 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4994060860 0x7f4994062d10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f49a4007fd0 tx=0x7f49a4007d70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:19.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.801+0000 7f49aa7fc700 1 -- 172.21.15.153:0/26895021 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f499c04d560 con 0x7f49b4068ca0 2024-08-17T02:26:19.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.949+0000 7f49b359e700 1 -- 172.21.15.153:0/26895021 --> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f49b40643a0 con 0x7f4994060860 2024-08-17T02:26:19.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.961+0000 7f49aa7fc700 1 -- 172.21.15.153:0/26895021 <== mgr.4104 v2:172.21.15.153:6832/24147 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264504 (secure 0 0 0) 0x7f49b40643a0 con 0x7f4994060860 2024-08-17T02:26:19.967 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:19.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.965+0000 7f49b359e700 1 -- 172.21.15.153:0/26895021 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4994060860 msgr2=0x7f4994062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.965+0000 7f49b359e700 1 --2- 172.21.15.153:0/26895021 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4994060860 0x7f4994062d10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f49a4007fd0 tx=0x7f49a4007d70 comp rx=0 tx=0).stop 2024-08-17T02:26:19.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.965+0000 7f49b359e700 1 -- 172.21.15.153:0/26895021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49b4068ca0 msgr2=0x7f49b4153fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.965+0000 7f49b359e700 1 --2- 172.21.15.153:0/26895021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49b4068ca0 0x7f49b4153fa0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f499c00c830 tx=0x7f499c008040 comp rx=0 tx=0).stop 2024-08-17T02:26:19.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.965+0000 7f49b359e700 1 -- 172.21.15.153:0/26895021 shutdown_connections 2024-08-17T02:26:19.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.965+0000 7f49b359e700 1 --2- 172.21.15.153:0/26895021 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4994060860 0x7f4994062d10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.965+0000 7f49b359e700 1 --2- 172.21.15.153:0/26895021 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f49b4159030 0x7f49b414e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.965+0000 7f49b359e700 1 --2- 172.21.15.153:0/26895021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49b4068ca0 0x7f49b4153fa0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.965+0000 7f49b359e700 1 --2- 172.21.15.153:0/26895021 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f49b40688d0 0x7f49b41507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.965+0000 7f49b359e700 1 -- 172.21.15.153:0/26895021 >> 172.21.15.153:0/26895021 conn(0x7f49b406d790 msgr2=0x7f49b4063060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:19.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.965+0000 7f49b359e700 1 -- 172.21.15.153:0/26895021 shutdown_connections 2024-08-17T02:26:19.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:19.965+0000 7f49b359e700 1 -- 172.21.15.153:0/26895021 wait complete. 2024-08-17T02:26:19.970 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-08-17T02:26:19.980 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-08-17T02:26:18.037691+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381720,"kb_used_data":2856,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752593000,"statfs":{"total":773094113280,"available":770655232000,"internally_reserved":0,"allocated":2924544,"data_stored":1758748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.311962"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.788062+0000","last_change":"2024-08-17T02:26:12.777798+0000","last_active":"2024-08-17T02:26:12.788062+0000","last_peered":"2024-08-17T02:26:12.788062+0000","last_clean":"2024-08-17T02:26:12.788062+0000","last_became_active":"2024-08-17T02:26:12.776925+0000","last_became_peered":"2024-08-17T02:26:12.776925+0000","last_unstale":"2024-08-17T02:26:12.788062+0000","last_undegraded":"2024-08-17T02:26:12.788062+0000","last_fullsized":"2024-08-17T02:26:12.788062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:30:26.589185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.766974+0000","last_change":"2024-08-17T02:26:12.764803+0000","last_active":"2024-08-17T02:26:12.766974+0000","last_peered":"2024-08-17T02:26:12.766974+0000","last_clean":"2024-08-17T02:26:12.766974+0000","last_became_active":"2024-08-17T02:26:12.764396+0000","last_became_peered":"2024-08-17T02:26:12.764396+0000","last_unstale":"2024-08-17T02:26:12.766974+0000","last_undegraded":"2024-08-17T02:26:12.766974+0000","last_fullsized":"2024-08-17T02:26:12.766974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:35:38.652631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.762936+0000","last_change":"2024-08-17T02:26:12.758694+0000","last_active":"2024-08-17T02:26:12.762936+0000","last_peered":"2024-08-17T02:26:12.762936+0000","last_clean":"2024-08-17T02:26:12.762936+0000","last_became_active":"2024-08-17T02:26:12.758036+0000","last_became_peered":"2024-08-17T02:26:12.758036+0000","last_unstale":"2024-08-17T02:26:12.762936+0000","last_undegraded":"2024-08-17T02:26:12.762936+0000","last_fullsized":"2024-08-17T02:26:12.762936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:48:08.511164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.774763+0000","last_change":"2024-08-17T02:26:12.769763+0000","last_active":"2024-08-17T02:26:12.774763+0000","last_peered":"2024-08-17T02:26:12.774763+0000","last_clean":"2024-08-17T02:26:12.774763+0000","last_became_active":"2024-08-17T02:26:12.769481+0000","last_became_peered":"2024-08-17T02:26:12.769481+0000","last_unstale":"2024-08-17T02:26:12.774763+0000","last_undegraded":"2024-08-17T02:26:12.774763+0000","last_fullsized":"2024-08-17T02:26:12.774763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:35:55.150476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.776688+0000","last_change":"2024-08-17T02:26:12.767565+0000","last_active":"2024-08-17T02:26:12.776688+0000","last_peered":"2024-08-17T02:26:12.776688+0000","last_clean":"2024-08-17T02:26:12.776688+0000","last_became_active":"2024-08-17T02:26:12.767168+0000","last_became_peered":"2024-08-17T02:26:12.767168+0000","last_unstale":"2024-08-17T02:26:12.776688+0000","last_undegraded":"2024-08-17T02:26:12.776688+0000","last_fullsized":"2024-08-17T02:26:12.776688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:02:03.668267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.768745+0000","last_change":"2024-08-17T02:26:12.763368+0000","last_active":"2024-08-17T02:26:12.768745+0000","last_peered":"2024-08-17T02:26:12.768745+0000","last_clean":"2024-08-17T02:26:12.768745+0000","last_became_active":"2024-08-17T02:26:12.763106+0000","last_became_peered":"2024-08-17T02:26:12.763106+0000","last_unstale":"2024-08-17T02:26:12.768745+0000","last_undegraded":"2024-08-17T02:26:12.768745+0000","last_fullsized":"2024-08-17T02:26:12.768745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:57:16.242016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.776719+0000","last_change":"2024-08-17T02:26:12.767440+0000","last_active":"2024-08-17T02:26:12.776719+0000","last_peered":"2024-08-17T02:26:12.776719+0000","last_clean":"2024-08-17T02:26:12.776719+0000","last_became_active":"2024-08-17T02:26:12.766962+0000","last_became_peered":"2024-08-17T02:26:12.766962+0000","last_unstale":"2024-08-17T02:26:12.776719+0000","last_undegraded":"2024-08-17T02:26:12.776719+0000","last_fullsized":"2024-08-17T02:26:12.776719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:57:16.242016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.773336+0000","last_change":"2024-08-17T02:26:12.768304+0000","last_active":"2024-08-17T02:26:12.773336+0000","last_peered":"2024-08-17T02:26:12.773336+0000","last_clean":"2024-08-17T02:26:12.773336+0000","last_became_active":"2024-08-17T02:26:12.768041+0000","last_became_peered":"2024-08-17T02:26:12.768041+0000","last_unstale":"2024-08-17T02:26:12.773336+0000","last_undegraded":"2024-08-17T02:26:12.773336+0000","last_fullsized":"2024-08-17T02:26:12.773336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:12:11.738249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.782933+0000","last_change":"2024-08-17T02:26:12.770547+0000","last_active":"2024-08-17T02:26:12.782933+0000","last_peered":"2024-08-17T02:26:12.782933+0000","last_clean":"2024-08-17T02:26:12.782933+0000","last_became_active":"2024-08-17T02:26:12.770189+0000","last_became_peered":"2024-08-17T02:26:12.770189+0000","last_unstale":"2024-08-17T02:26:12.782933+0000","last_undegraded":"2024-08-17T02:26:12.782933+0000","last_fullsized":"2024-08-17T02:26:12.782933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:28:12.295650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.768543+0000","last_change":"2024-08-17T02:26:12.762340+0000","last_active":"2024-08-17T02:26:12.768543+0000","last_peered":"2024-08-17T02:26:12.768543+0000","last_clean":"2024-08-17T02:26:12.768543+0000","last_became_active":"2024-08-17T02:26:12.762033+0000","last_became_peered":"2024-08-17T02:26:12.762033+0000","last_unstale":"2024-08-17T02:26:12.768543+0000","last_undegraded":"2024-08-17T02:26:12.768543+0000","last_fullsized":"2024-08-17T02:26:12.768543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:01:31.899155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.772316+0000","last_change":"2024-08-17T02:26:12.763725+0000","last_active":"2024-08-17T02:26:12.772316+0000","last_peered":"2024-08-17T02:26:12.772316+0000","last_clean":"2024-08-17T02:26:12.772316+0000","last_became_active":"2024-08-17T02:26:12.763362+0000","last_became_peered":"2024-08-17T02:26:12.763362+0000","last_unstale":"2024-08-17T02:26:12.772316+0000","last_undegraded":"2024-08-17T02:26:12.772316+0000","last_fullsized":"2024-08-17T02:26:12.772316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:35:38.652631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.769441+0000","last_change":"2024-08-17T02:26:12.760713+0000","last_active":"2024-08-17T02:26:12.769441+0000","last_peered":"2024-08-17T02:26:12.769441+0000","last_clean":"2024-08-17T02:26:12.769441+0000","last_became_active":"2024-08-17T02:26:12.760422+0000","last_became_peered":"2024-08-17T02:26:12.760422+0000","last_unstale":"2024-08-17T02:26:12.769441+0000","last_undegraded":"2024-08-17T02:26:12.769441+0000","last_fullsized":"2024-08-17T02:26:12.769441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:47:11.421230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.769079+0000","last_change":"2024-08-17T02:26:12.763523+0000","last_active":"2024-08-17T02:26:12.769079+0000","last_peered":"2024-08-17T02:26:12.769079+0000","last_clean":"2024-08-17T02:26:12.769079+0000","last_became_active":"2024-08-17T02:26:12.762838+0000","last_became_peered":"2024-08-17T02:26:12.762838+0000","last_unstale":"2024-08-17T02:26:12.769079+0000","last_undegraded":"2024-08-17T02:26:12.769079+0000","last_fullsized":"2024-08-17T02:26:12.769079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:35:55.150476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.763560+0000","last_change":"2024-08-17T02:26:12.762220+0000","last_active":"2024-08-17T02:26:12.763560+0000","last_peered":"2024-08-17T02:26:12.763560+0000","last_clean":"2024-08-17T02:26:12.763560+0000","last_became_active":"2024-08-17T02:26:12.761872+0000","last_became_peered":"2024-08-17T02:26:12.761872+0000","last_unstale":"2024-08-17T02:26:12.763560+0000","last_undegraded":"2024-08-17T02:26:12.763560+0000","last_fullsized":"2024-08-17T02:26:12.763560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:40:15.880102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.770390+0000","last_change":"2024-08-17T02:26:12.768586+0000","last_active":"2024-08-17T02:26:12.770390+0000","last_peered":"2024-08-17T02:26:12.770390+0000","last_clean":"2024-08-17T02:26:12.770390+0000","last_became_active":"2024-08-17T02:26:12.768293+0000","last_became_peered":"2024-08-17T02:26:12.768293+0000","last_unstale":"2024-08-17T02:26:12.770390+0000","last_undegraded":"2024-08-17T02:26:12.770390+0000","last_fullsized":"2024-08-17T02:26:12.770390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:22.659534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.765002+0000","last_change":"2024-08-17T02:26:12.757448+0000","last_active":"2024-08-17T02:26:12.765002+0000","last_peered":"2024-08-17T02:26:12.765002+0000","last_clean":"2024-08-17T02:26:12.765002+0000","last_became_active":"2024-08-17T02:26:12.755026+0000","last_became_peered":"2024-08-17T02:26:12.755026+0000","last_unstale":"2024-08-17T02:26:12.765002+0000","last_undegraded":"2024-08-17T02:26:12.765002+0000","last_fullsized":"2024-08-17T02:26:12.765002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:22.659534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.774812+0000","last_change":"2024-08-17T02:26:12.770619+0000","last_active":"2024-08-17T02:26:12.774812+0000","last_peered":"2024-08-17T02:26:12.774812+0000","last_clean":"2024-08-17T02:26:12.774812+0000","last_became_active":"2024-08-17T02:26:12.770280+0000","last_became_peered":"2024-08-17T02:26:12.770280+0000","last_unstale":"2024-08-17T02:26:12.774812+0000","last_undegraded":"2024-08-17T02:26:12.774812+0000","last_fullsized":"2024-08-17T02:26:12.774812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:09:06.162369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.763960+0000","last_change":"2024-08-17T02:26:12.761378+0000","last_active":"2024-08-17T02:26:12.763960+0000","last_peered":"2024-08-17T02:26:12.763960+0000","last_clean":"2024-08-17T02:26:12.763960+0000","last_became_active":"2024-08-17T02:26:12.761023+0000","last_became_peered":"2024-08-17T02:26:12.761023+0000","last_unstale":"2024-08-17T02:26:12.763960+0000","last_undegraded":"2024-08-17T02:26:12.763960+0000","last_fullsized":"2024-08-17T02:26:12.763960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:48:08.511164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.772755+0000","last_change":"2024-08-17T02:26:12.767191+0000","last_active":"2024-08-17T02:26:12.772755+0000","last_peered":"2024-08-17T02:26:12.772755+0000","last_clean":"2024-08-17T02:26:12.772755+0000","last_became_active":"2024-08-17T02:26:12.766917+0000","last_became_peered":"2024-08-17T02:26:12.766917+0000","last_unstale":"2024-08-17T02:26:12.772755+0000","last_undegraded":"2024-08-17T02:26:12.772755+0000","last_fullsized":"2024-08-17T02:26:12.772755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:52.096067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.773863+0000","last_change":"2024-08-17T02:26:12.769217+0000","last_active":"2024-08-17T02:26:12.773863+0000","last_peered":"2024-08-17T02:26:12.773863+0000","last_clean":"2024-08-17T02:26:12.773863+0000","last_became_active":"2024-08-17T02:26:12.768948+0000","last_became_peered":"2024-08-17T02:26:12.768948+0000","last_unstale":"2024-08-17T02:26:12.773863+0000","last_undegraded":"2024-08-17T02:26:12.773863+0000","last_fullsized":"2024-08-17T02:26:12.773863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:22.659534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.767928+0000","last_change":"2024-08-17T02:26:12.764704+0000","last_active":"2024-08-17T02:26:12.767928+0000","last_peered":"2024-08-17T02:26:12.767928+0000","last_clean":"2024-08-17T02:26:12.767928+0000","last_became_active":"2024-08-17T02:26:12.764364+0000","last_became_peered":"2024-08-17T02:26:12.764364+0000","last_unstale":"2024-08-17T02:26:12.767928+0000","last_undegraded":"2024-08-17T02:26:12.767928+0000","last_fullsized":"2024-08-17T02:26:12.767928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:04:38.025404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.774928+0000","last_change":"2024-08-17T02:26:12.771719+0000","last_active":"2024-08-17T02:26:12.774928+0000","last_peered":"2024-08-17T02:26:12.774928+0000","last_clean":"2024-08-17T02:26:12.774928+0000","last_became_active":"2024-08-17T02:26:12.770932+0000","last_became_peered":"2024-08-17T02:26:12.770932+0000","last_unstale":"2024-08-17T02:26:12.774928+0000","last_undegraded":"2024-08-17T02:26:12.774928+0000","last_fullsized":"2024-08-17T02:26:12.774928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:12:11.738249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.773471+0000","last_change":"2024-08-17T02:26:12.768435+0000","last_active":"2024-08-17T02:26:12.773471+0000","last_peered":"2024-08-17T02:26:12.773471+0000","last_clean":"2024-08-17T02:26:12.773471+0000","last_became_active":"2024-08-17T02:26:12.768140+0000","last_became_peered":"2024-08-17T02:26:12.768140+0000","last_unstale":"2024-08-17T02:26:12.773471+0000","last_undegraded":"2024-08-17T02:26:12.773471+0000","last_fullsized":"2024-08-17T02:26:12.773471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:02:03.668267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.774691+0000","last_change":"2024-08-17T02:26:12.769539+0000","last_active":"2024-08-17T02:26:12.774691+0000","last_peered":"2024-08-17T02:26:12.774691+0000","last_clean":"2024-08-17T02:26:12.774691+0000","last_became_active":"2024-08-17T02:26:12.769265+0000","last_became_peered":"2024-08-17T02:26:12.769265+0000","last_unstale":"2024-08-17T02:26:12.774691+0000","last_undegraded":"2024-08-17T02:26:12.774691+0000","last_fullsized":"2024-08-17T02:26:12.774691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:30:26.589185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.777445+0000","last_change":"2024-08-17T02:26:12.770914+0000","last_active":"2024-08-17T02:26:12.777445+0000","last_peered":"2024-08-17T02:26:12.777445+0000","last_clean":"2024-08-17T02:26:12.777445+0000","last_became_active":"2024-08-17T02:26:12.770412+0000","last_became_peered":"2024-08-17T02:26:12.770412+0000","last_unstale":"2024-08-17T02:26:12.777445+0000","last_undegraded":"2024-08-17T02:26:12.777445+0000","last_fullsized":"2024-08-17T02:26:12.777445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:01:31.899155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.773947+0000","last_change":"2024-08-17T02:26:12.771500+0000","last_active":"2024-08-17T02:26:12.773947+0000","last_peered":"2024-08-17T02:26:12.773947+0000","last_clean":"2024-08-17T02:26:12.773947+0000","last_became_active":"2024-08-17T02:26:12.771244+0000","last_became_peered":"2024-08-17T02:26:12.771244+0000","last_unstale":"2024-08-17T02:26:12.773947+0000","last_undegraded":"2024-08-17T02:26:12.773947+0000","last_fullsized":"2024-08-17T02:26:12.773947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:52.096067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.771527+0000","last_change":"2024-08-17T02:26:12.769916+0000","last_active":"2024-08-17T02:26:12.771527+0000","last_peered":"2024-08-17T02:26:12.771527+0000","last_clean":"2024-08-17T02:26:12.771527+0000","last_became_active":"2024-08-17T02:26:12.769640+0000","last_became_peered":"2024-08-17T02:26:12.769640+0000","last_unstale":"2024-08-17T02:26:12.771527+0000","last_undegraded":"2024-08-17T02:26:12.771527+0000","last_fullsized":"2024-08-17T02:26:12.771527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:52.096067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.779660+0000","last_change":"2024-08-17T02:26:12.774242+0000","last_active":"2024-08-17T02:26:12.779660+0000","last_peered":"2024-08-17T02:26:12.779660+0000","last_clean":"2024-08-17T02:26:12.779660+0000","last_became_active":"2024-08-17T02:26:12.773927+0000","last_became_peered":"2024-08-17T02:26:12.773927+0000","last_unstale":"2024-08-17T02:26:12.779660+0000","last_undegraded":"2024-08-17T02:26:12.779660+0000","last_fullsized":"2024-08-17T02:26:12.779660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:57:43.119108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.773690+0000","last_change":"2024-08-17T02:26:12.771799+0000","last_active":"2024-08-17T02:26:12.773690+0000","last_peered":"2024-08-17T02:26:12.773690+0000","last_clean":"2024-08-17T02:26:12.773690+0000","last_became_active":"2024-08-17T02:26:12.771451+0000","last_became_peered":"2024-08-17T02:26:12.771451+0000","last_unstale":"2024-08-17T02:26:12.773690+0000","last_undegraded":"2024-08-17T02:26:12.773690+0000","last_fullsized":"2024-08-17T02:26:12.773690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:49:58.271852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.774907+0000","last_change":"2024-08-17T02:26:12.771407+0000","last_active":"2024-08-17T02:26:12.774907+0000","last_peered":"2024-08-17T02:26:12.774907+0000","last_clean":"2024-08-17T02:26:12.774907+0000","last_became_active":"2024-08-17T02:26:12.770406+0000","last_became_peered":"2024-08-17T02:26:12.770406+0000","last_unstale":"2024-08-17T02:26:12.774907+0000","last_undegraded":"2024-08-17T02:26:12.774907+0000","last_fullsized":"2024-08-17T02:26:12.774907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:46:54.172659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.767647+0000","last_change":"2024-08-17T02:26:12.764126+0000","last_active":"2024-08-17T02:26:12.767647+0000","last_peered":"2024-08-17T02:26:12.767647+0000","last_clean":"2024-08-17T02:26:12.767647+0000","last_became_active":"2024-08-17T02:26:12.763871+0000","last_became_peered":"2024-08-17T02:26:12.763871+0000","last_unstale":"2024-08-17T02:26:12.767647+0000","last_undegraded":"2024-08-17T02:26:12.767647+0000","last_fullsized":"2024-08-17T02:26:12.767647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:52.634628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.772373+0000","last_change":"2024-08-17T02:26:12.766452+0000","last_active":"2024-08-17T02:26:12.772373+0000","last_peered":"2024-08-17T02:26:12.772373+0000","last_clean":"2024-08-17T02:26:12.772373+0000","last_became_active":"2024-08-17T02:26:12.766197+0000","last_became_peered":"2024-08-17T02:26:12.766197+0000","last_unstale":"2024-08-17T02:26:12.772373+0000","last_undegraded":"2024-08-17T02:26:12.772373+0000","last_fullsized":"2024-08-17T02:26:12.772373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:56:34.246512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.771933+0000","last_change":"2024-08-17T02:26:12.767925+0000","last_active":"2024-08-17T02:26:12.771933+0000","last_peered":"2024-08-17T02:26:12.771933+0000","last_clean":"2024-08-17T02:26:12.771933+0000","last_became_active":"2024-08-17T02:26:12.767638+0000","last_became_peered":"2024-08-17T02:26:12.767638+0000","last_unstale":"2024-08-17T02:26:12.771933+0000","last_undegraded":"2024-08-17T02:26:12.771933+0000","last_fullsized":"2024-08-17T02:26:12.771933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:17:50.872489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.788926+0000","last_change":"2024-08-17T02:26:11.752462+0000","last_active":"2024-08-17T02:26:12.788926+0000","last_peered":"2024-08-17T02:26:12.788926+0000","last_clean":"2024-08-17T02:26:12.788926+0000","last_became_active":"2024-08-17T02:26:11.752167+0000","last_became_peered":"2024-08-17T02:26:11.752167+0000","last_unstale":"2024-08-17T02:26:12.788926+0000","last_undegraded":"2024-08-17T02:26:12.788926+0000","last_fullsized":"2024-08-17T02:26:12.788926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:28:45.373009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.763201+0000","last_change":"2024-08-17T02:26:12.761203+0000","last_active":"2024-08-17T02:26:12.763201+0000","last_peered":"2024-08-17T02:26:12.763201+0000","last_clean":"2024-08-17T02:26:12.763201+0000","last_became_active":"2024-08-17T02:26:12.759701+0000","last_became_peered":"2024-08-17T02:26:12.759701+0000","last_unstale":"2024-08-17T02:26:12.763201+0000","last_undegraded":"2024-08-17T02:26:12.763201+0000","last_fullsized":"2024-08-17T02:26:12.763201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:11:48.128685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.780138+0000","last_change":"2024-08-17T02:26:11.744002+0000","last_active":"2024-08-17T02:26:12.780138+0000","last_peered":"2024-08-17T02:26:12.780138+0000","last_clean":"2024-08-17T02:26:12.780138+0000","last_became_active":"2024-08-17T02:26:11.743661+0000","last_became_peered":"2024-08-17T02:26:11.743661+0000","last_unstale":"2024-08-17T02:26:12.780138+0000","last_undegraded":"2024-08-17T02:26:12.780138+0000","last_fullsized":"2024-08-17T02:26:12.780138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:12.144056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.760330+0000","last_change":"2024-08-17T02:26:11.742090+0000","last_active":"2024-08-17T02:26:12.760330+0000","last_peered":"2024-08-17T02:26:12.760330+0000","last_clean":"2024-08-17T02:26:12.760330+0000","last_became_active":"2024-08-17T02:26:11.741738+0000","last_became_peered":"2024-08-17T02:26:11.741738+0000","last_unstale":"2024-08-17T02:26:12.760330+0000","last_undegraded":"2024-08-17T02:26:12.760330+0000","last_fullsized":"2024-08-17T02:26:12.760330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:16.129872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.769078+0000","last_change":"2024-08-17T02:26:12.766090+0000","last_active":"2024-08-17T02:26:12.769078+0000","last_peered":"2024-08-17T02:26:12.769078+0000","last_clean":"2024-08-17T02:26:12.769078+0000","last_became_active":"2024-08-17T02:26:12.765809+0000","last_became_peered":"2024-08-17T02:26:12.765809+0000","last_unstale":"2024-08-17T02:26:12.769078+0000","last_undegraded":"2024-08-17T02:26:12.769078+0000","last_fullsized":"2024-08-17T02:26:12.769078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:30:26.589185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.749399+0000","last_change":"2024-08-17T02:26:11.747004+0000","last_active":"2024-08-17T02:26:12.749399+0000","last_peered":"2024-08-17T02:26:12.749399+0000","last_clean":"2024-08-17T02:26:12.749399+0000","last_became_active":"2024-08-17T02:26:11.742575+0000","last_became_peered":"2024-08-17T02:26:11.742575+0000","last_unstale":"2024-08-17T02:26:12.749399+0000","last_undegraded":"2024-08-17T02:26:12.749399+0000","last_fullsized":"2024-08-17T02:26:12.749399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:19:02.670677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.772394+0000","last_change":"2024-08-17T02:26:12.770011+0000","last_active":"2024-08-17T02:26:12.772394+0000","last_peered":"2024-08-17T02:26:12.772394+0000","last_clean":"2024-08-17T02:26:12.772394+0000","last_became_active":"2024-08-17T02:26:12.769717+0000","last_became_peered":"2024-08-17T02:26:12.769717+0000","last_unstale":"2024-08-17T02:26:12.772394+0000","last_undegraded":"2024-08-17T02:26:12.772394+0000","last_fullsized":"2024-08-17T02:26:12.772394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:01:31.899155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.758697+0000","last_change":"2024-08-17T02:26:11.753364+0000","last_active":"2024-08-17T02:26:12.758697+0000","last_peered":"2024-08-17T02:26:12.758697+0000","last_clean":"2024-08-17T02:26:12.758697+0000","last_became_active":"2024-08-17T02:26:11.753151+0000","last_became_peered":"2024-08-17T02:26:11.753151+0000","last_unstale":"2024-08-17T02:26:12.758697+0000","last_undegraded":"2024-08-17T02:26:12.758697+0000","last_fullsized":"2024-08-17T02:26:12.758697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:16.129872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.765940+0000","last_change":"2024-08-17T02:26:12.764566+0000","last_active":"2024-08-17T02:26:12.765940+0000","last_peered":"2024-08-17T02:26:12.765940+0000","last_clean":"2024-08-17T02:26:12.765940+0000","last_became_active":"2024-08-17T02:26:12.764233+0000","last_became_peered":"2024-08-17T02:26:12.764233+0000","last_unstale":"2024-08-17T02:26:12.765940+0000","last_undegraded":"2024-08-17T02:26:12.765940+0000","last_fullsized":"2024-08-17T02:26:12.765940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:28:12.295650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.750417+0000","last_change":"2024-08-17T02:26:11.751390+0000","last_active":"2024-08-17T02:26:12.750417+0000","last_peered":"2024-08-17T02:26:12.750417+0000","last_clean":"2024-08-17T02:26:12.750417+0000","last_became_active":"2024-08-17T02:26:11.751114+0000","last_became_peered":"2024-08-17T02:26:11.751114+0000","last_unstale":"2024-08-17T02:26:12.750417+0000","last_undegraded":"2024-08-17T02:26:12.750417+0000","last_fullsized":"2024-08-17T02:26:12.750417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:50:23.467873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.767715+0000","last_change":"2024-08-17T02:26:12.763838+0000","last_active":"2024-08-17T02:26:12.767715+0000","last_peered":"2024-08-17T02:26:12.767715+0000","last_clean":"2024-08-17T02:26:12.767715+0000","last_became_active":"2024-08-17T02:26:12.763383+0000","last_became_peered":"2024-08-17T02:26:12.763383+0000","last_unstale":"2024-08-17T02:26:12.767715+0000","last_undegraded":"2024-08-17T02:26:12.767715+0000","last_fullsized":"2024-08-17T02:26:12.767715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:58:46.781607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.781109+0000","last_change":"2024-08-17T02:26:11.749300+0000","last_active":"2024-08-17T02:26:12.781109+0000","last_peered":"2024-08-17T02:26:12.781109+0000","last_clean":"2024-08-17T02:26:12.781109+0000","last_became_active":"2024-08-17T02:26:11.748641+0000","last_became_peered":"2024-08-17T02:26:11.748641+0000","last_unstale":"2024-08-17T02:26:12.781109+0000","last_undegraded":"2024-08-17T02:26:12.781109+0000","last_fullsized":"2024-08-17T02:26:12.781109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:17:49.864348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.773125+0000","last_change":"2024-08-17T02:26:12.768314+0000","last_active":"2024-08-17T02:26:12.773125+0000","last_peered":"2024-08-17T02:26:12.773125+0000","last_clean":"2024-08-17T02:26:12.773125+0000","last_became_active":"2024-08-17T02:26:12.768066+0000","last_became_peered":"2024-08-17T02:26:12.768066+0000","last_unstale":"2024-08-17T02:26:12.773125+0000","last_undegraded":"2024-08-17T02:26:12.773125+0000","last_fullsized":"2024-08-17T02:26:12.773125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:28:46.381149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.790010+0000","last_change":"2024-08-17T02:26:11.745150+0000","last_active":"2024-08-17T02:26:12.790010+0000","last_peered":"2024-08-17T02:26:12.790010+0000","last_clean":"2024-08-17T02:26:12.790010+0000","last_became_active":"2024-08-17T02:26:11.744417+0000","last_became_peered":"2024-08-17T02:26:11.744417+0000","last_unstale":"2024-08-17T02:26:12.790010+0000","last_undegraded":"2024-08-17T02:26:12.790010+0000","last_fullsized":"2024-08-17T02:26:12.790010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:01:19.012403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.782538+0000","last_change":"2024-08-17T02:26:12.771891+0000","last_active":"2024-08-17T02:26:12.782538+0000","last_peered":"2024-08-17T02:26:12.782538+0000","last_clean":"2024-08-17T02:26:12.782538+0000","last_became_active":"2024-08-17T02:26:12.771553+0000","last_became_peered":"2024-08-17T02:26:12.771553+0000","last_unstale":"2024-08-17T02:26:12.782538+0000","last_undegraded":"2024-08-17T02:26:12.782538+0000","last_fullsized":"2024-08-17T02:26:12.782538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:09:06.162369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.783558+0000","last_change":"2024-08-17T02:26:11.743421+0000","last_active":"2024-08-17T02:26:12.783558+0000","last_peered":"2024-08-17T02:26:12.783558+0000","last_clean":"2024-08-17T02:26:12.783558+0000","last_became_active":"2024-08-17T02:26:11.743158+0000","last_became_peered":"2024-08-17T02:26:11.743158+0000","last_unstale":"2024-08-17T02:26:12.783558+0000","last_undegraded":"2024-08-17T02:26:12.783558+0000","last_fullsized":"2024-08-17T02:26:12.783558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:09:59.680512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.770940+0000","last_change":"2024-08-17T02:26:12.769818+0000","last_active":"2024-08-17T02:26:12.770940+0000","last_peered":"2024-08-17T02:26:12.770940+0000","last_clean":"2024-08-17T02:26:12.770940+0000","last_became_active":"2024-08-17T02:26:12.769239+0000","last_became_peered":"2024-08-17T02:26:12.769239+0000","last_unstale":"2024-08-17T02:26:12.770940+0000","last_undegraded":"2024-08-17T02:26:12.770940+0000","last_fullsized":"2024-08-17T02:26:12.770940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:18.753712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.754444+0000","last_change":"2024-08-17T02:26:11.750830+0000","last_active":"2024-08-17T02:26:12.754444+0000","last_peered":"2024-08-17T02:26:12.754444+0000","last_clean":"2024-08-17T02:26:12.754444+0000","last_became_active":"2024-08-17T02:26:11.750327+0000","last_became_peered":"2024-08-17T02:26:11.750327+0000","last_unstale":"2024-08-17T02:26:12.754444+0000","last_undegraded":"2024-08-17T02:26:12.754444+0000","last_fullsized":"2024-08-17T02:26:12.754444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:44:31.584691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.787928+0000","last_change":"2024-08-17T02:26:12.776592+0000","last_active":"2024-08-17T02:26:12.787928+0000","last_peered":"2024-08-17T02:26:12.787928+0000","last_clean":"2024-08-17T02:26:12.787928+0000","last_became_active":"2024-08-17T02:26:12.772976+0000","last_became_peered":"2024-08-17T02:26:12.772976+0000","last_unstale":"2024-08-17T02:26:12.787928+0000","last_undegraded":"2024-08-17T02:26:12.787928+0000","last_fullsized":"2024-08-17T02:26:12.787928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:12:11.738249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.756908+0000","last_change":"2024-08-17T02:26:11.744845+0000","last_active":"2024-08-17T02:26:12.756908+0000","last_peered":"2024-08-17T02:26:12.756908+0000","last_clean":"2024-08-17T02:26:12.756908+0000","last_became_active":"2024-08-17T02:26:11.743525+0000","last_became_peered":"2024-08-17T02:26:11.743525+0000","last_unstale":"2024-08-17T02:26:12.756908+0000","last_undegraded":"2024-08-17T02:26:12.756908+0000","last_fullsized":"2024-08-17T02:26:12.756908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:19:02.670677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.772355+0000","last_change":"2024-08-17T02:26:12.764059+0000","last_active":"2024-08-17T02:26:12.772355+0000","last_peered":"2024-08-17T02:26:12.772355+0000","last_clean":"2024-08-17T02:26:12.772355+0000","last_became_active":"2024-08-17T02:26:12.763801+0000","last_became_peered":"2024-08-17T02:26:12.763801+0000","last_unstale":"2024-08-17T02:26:12.772355+0000","last_undegraded":"2024-08-17T02:26:12.772355+0000","last_fullsized":"2024-08-17T02:26:12.772355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:00.945590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.782776+0000","last_change":"2024-08-17T02:26:11.745341+0000","last_active":"2024-08-17T02:26:12.782776+0000","last_peered":"2024-08-17T02:26:12.782776+0000","last_clean":"2024-08-17T02:26:12.782776+0000","last_became_active":"2024-08-17T02:26:11.745025+0000","last_became_peered":"2024-08-17T02:26:11.745025+0000","last_unstale":"2024-08-17T02:26:12.782776+0000","last_undegraded":"2024-08-17T02:26:12.782776+0000","last_fullsized":"2024-08-17T02:26:12.782776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:47:43.451789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.787814+0000","last_change":"2024-08-17T02:26:12.772497+0000","last_active":"2024-08-17T02:26:12.787814+0000","last_peered":"2024-08-17T02:26:12.787814+0000","last_clean":"2024-08-17T02:26:12.787814+0000","last_became_active":"2024-08-17T02:26:12.772175+0000","last_became_peered":"2024-08-17T02:26:12.772175+0000","last_unstale":"2024-08-17T02:26:12.787814+0000","last_undegraded":"2024-08-17T02:26:12.787814+0000","last_fullsized":"2024-08-17T02:26:12.787814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:36:24.497583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.779889+0000","last_change":"2024-08-17T02:26:11.742829+0000","last_active":"2024-08-17T02:26:12.779889+0000","last_peered":"2024-08-17T02:26:12.779889+0000","last_clean":"2024-08-17T02:26:12.779889+0000","last_became_active":"2024-08-17T02:26:11.742316+0000","last_became_peered":"2024-08-17T02:26:11.742316+0000","last_unstale":"2024-08-17T02:26:12.779889+0000","last_undegraded":"2024-08-17T02:26:12.779889+0000","last_fullsized":"2024-08-17T02:26:12.779889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:10.151157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.788029+0000","last_change":"2024-08-17T02:26:12.777702+0000","last_active":"2024-08-17T02:26:12.788029+0000","last_peered":"2024-08-17T02:26:12.788029+0000","last_clean":"2024-08-17T02:26:12.788029+0000","last_became_active":"2024-08-17T02:26:12.777420+0000","last_became_peered":"2024-08-17T02:26:12.777420+0000","last_unstale":"2024-08-17T02:26:12.788029+0000","last_undegraded":"2024-08-17T02:26:12.788029+0000","last_fullsized":"2024-08-17T02:26:12.788029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:32:22.491464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.782079+0000","last_change":"2024-08-17T02:26:11.746064+0000","last_active":"2024-08-17T02:26:12.782079+0000","last_peered":"2024-08-17T02:26:12.782079+0000","last_clean":"2024-08-17T02:26:12.782079+0000","last_became_active":"2024-08-17T02:26:11.745735+0000","last_became_peered":"2024-08-17T02:26:11.745735+0000","last_unstale":"2024-08-17T02:26:12.782079+0000","last_undegraded":"2024-08-17T02:26:12.782079+0000","last_fullsized":"2024-08-17T02:26:12.782079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:18:27.869243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.788259+0000","last_change":"2024-08-17T02:26:12.780624+0000","last_active":"2024-08-17T02:26:12.788259+0000","last_peered":"2024-08-17T02:26:12.788259+0000","last_clean":"2024-08-17T02:26:12.788259+0000","last_became_active":"2024-08-17T02:26:12.778112+0000","last_became_peered":"2024-08-17T02:26:12.778112+0000","last_unstale":"2024-08-17T02:26:12.788259+0000","last_undegraded":"2024-08-17T02:26:12.788259+0000","last_fullsized":"2024-08-17T02:26:12.788259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:46:54.172659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.783515+0000","last_change":"2024-08-17T02:26:11.743505+0000","last_active":"2024-08-17T02:26:12.783515+0000","last_peered":"2024-08-17T02:26:12.783515+0000","last_clean":"2024-08-17T02:26:12.783515+0000","last_became_active":"2024-08-17T02:26:11.743235+0000","last_became_peered":"2024-08-17T02:26:11.743235+0000","last_unstale":"2024-08-17T02:26:12.783515+0000","last_undegraded":"2024-08-17T02:26:12.783515+0000","last_fullsized":"2024-08-17T02:26:12.783515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:16.129872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.774742+0000","last_change":"2024-08-17T02:26:12.769747+0000","last_active":"2024-08-17T02:26:12.774742+0000","last_peered":"2024-08-17T02:26:12.774742+0000","last_clean":"2024-08-17T02:26:12.774742+0000","last_became_active":"2024-08-17T02:26:12.769129+0000","last_became_peered":"2024-08-17T02:26:12.769129+0000","last_unstale":"2024-08-17T02:26:12.774742+0000","last_undegraded":"2024-08-17T02:26:12.774742+0000","last_fullsized":"2024-08-17T02:26:12.774742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:02:03.668267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.752138+0000","last_change":"2024-08-17T02:26:11.744390+0000","last_active":"2024-08-17T02:26:12.752138+0000","last_peered":"2024-08-17T02:26:12.752138+0000","last_clean":"2024-08-17T02:26:12.752138+0000","last_became_active":"2024-08-17T02:26:11.744090+0000","last_became_peered":"2024-08-17T02:26:11.744090+0000","last_unstale":"2024-08-17T02:26:12.752138+0000","last_undegraded":"2024-08-17T02:26:12.752138+0000","last_fullsized":"2024-08-17T02:26:12.752138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:45:35.172781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.787941+0000","last_change":"2024-08-17T02:26:12.776646+0000","last_active":"2024-08-17T02:26:12.787941+0000","last_peered":"2024-08-17T02:26:12.787941+0000","last_clean":"2024-08-17T02:26:12.787941+0000","last_became_active":"2024-08-17T02:26:12.776339+0000","last_became_peered":"2024-08-17T02:26:12.776339+0000","last_unstale":"2024-08-17T02:26:12.787941+0000","last_undegraded":"2024-08-17T02:26:12.787941+0000","last_fullsized":"2024-08-17T02:26:12.787941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:39:46.134798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.759672+0000","last_change":"2024-08-17T02:26:00.033569+0000","last_active":"2024-08-17T02:26:12.759672+0000","last_peered":"2024-08-17T02:26:12.759672+0000","last_clean":"2024-08-17T02:26:12.759672+0000","last_became_active":"2024-08-17T02:26:00.031512+0000","last_became_peered":"2024-08-17T02:26:00.031512+0000","last_unstale":"2024-08-17T02:26:12.759672+0000","last_undegraded":"2024-08-17T02:26:12.759672+0000","last_fullsized":"2024-08-17T02:26:12.759672+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:58.643690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:58.643690+0000","last_clean_scrub_stamp":"2024-08-17T02:25:58.643690+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:47:24.121981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.748244+0000","last_change":"2024-08-17T02:26:11.747504+0000","last_active":"2024-08-17T02:26:12.748244+0000","last_peered":"2024-08-17T02:26:12.748244+0000","last_clean":"2024-08-17T02:26:12.748244+0000","last_became_active":"2024-08-17T02:26:11.747162+0000","last_became_peered":"2024-08-17T02:26:11.747162+0000","last_unstale":"2024-08-17T02:26:12.748244+0000","last_undegraded":"2024-08-17T02:26:12.748244+0000","last_fullsized":"2024-08-17T02:26:12.748244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:01:19.012403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.779564+0000","last_change":"2024-08-17T02:26:12.772153+0000","last_active":"2024-08-17T02:26:12.779564+0000","last_peered":"2024-08-17T02:26:12.779564+0000","last_clean":"2024-08-17T02:26:12.779564+0000","last_became_active":"2024-08-17T02:26:12.771909+0000","last_became_peered":"2024-08-17T02:26:12.771909+0000","last_unstale":"2024-08-17T02:26:12.779564+0000","last_undegraded":"2024-08-17T02:26:12.779564+0000","last_fullsized":"2024-08-17T02:26:12.779564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:46:54.172659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.759288+0000","last_change":"2024-08-17T02:26:11.755283+0000","last_active":"2024-08-17T02:26:12.759288+0000","last_peered":"2024-08-17T02:26:12.759288+0000","last_clean":"2024-08-17T02:26:12.759288+0000","last_became_active":"2024-08-17T02:26:11.754919+0000","last_became_peered":"2024-08-17T02:26:11.754919+0000","last_unstale":"2024-08-17T02:26:12.759288+0000","last_undegraded":"2024-08-17T02:26:12.759288+0000","last_fullsized":"2024-08-17T02:26:12.759288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:47:10.413089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.763629+0000","last_change":"2024-08-17T02:26:12.758664+0000","last_active":"2024-08-17T02:26:12.763629+0000","last_peered":"2024-08-17T02:26:12.763629+0000","last_clean":"2024-08-17T02:26:12.763629+0000","last_became_active":"2024-08-17T02:26:12.758221+0000","last_became_peered":"2024-08-17T02:26:12.758221+0000","last_unstale":"2024-08-17T02:26:12.763629+0000","last_undegraded":"2024-08-17T02:26:12.763629+0000","last_fullsized":"2024-08-17T02:26:12.763629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:15:37.296290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.754545+0000","last_change":"2024-08-17T02:26:11.746935+0000","last_active":"2024-08-17T02:26:12.754545+0000","last_peered":"2024-08-17T02:26:12.754545+0000","last_clean":"2024-08-17T02:26:12.754545+0000","last_became_active":"2024-08-17T02:26:11.746769+0000","last_became_peered":"2024-08-17T02:26:11.746769+0000","last_unstale":"2024-08-17T02:26:12.754545+0000","last_undegraded":"2024-08-17T02:26:12.754545+0000","last_fullsized":"2024-08-17T02:26:12.754545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:31:45.321709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.762938+0000","last_change":"2024-08-17T02:26:12.760578+0000","last_active":"2024-08-17T02:26:12.762938+0000","last_peered":"2024-08-17T02:26:12.762938+0000","last_clean":"2024-08-17T02:26:12.762938+0000","last_became_active":"2024-08-17T02:26:12.760278+0000","last_became_peered":"2024-08-17T02:26:12.760278+0000","last_unstale":"2024-08-17T02:26:12.762938+0000","last_undegraded":"2024-08-17T02:26:12.762938+0000","last_fullsized":"2024-08-17T02:26:12.762938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:57:43.119108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.754788+0000","last_change":"2024-08-17T02:26:11.751106+0000","last_active":"2024-08-17T02:26:12.754788+0000","last_peered":"2024-08-17T02:26:12.754788+0000","last_clean":"2024-08-17T02:26:12.754788+0000","last_became_active":"2024-08-17T02:26:11.750673+0000","last_became_peered":"2024-08-17T02:26:11.750673+0000","last_unstale":"2024-08-17T02:26:12.754788+0000","last_undegraded":"2024-08-17T02:26:12.754788+0000","last_fullsized":"2024-08-17T02:26:12.754788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:16.129872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.772914+0000","last_change":"2024-08-17T02:26:12.766859+0000","last_active":"2024-08-17T02:26:12.772914+0000","last_peered":"2024-08-17T02:26:12.772914+0000","last_clean":"2024-08-17T02:26:12.772914+0000","last_became_active":"2024-08-17T02:26:12.766495+0000","last_became_peered":"2024-08-17T02:26:12.766495+0000","last_unstale":"2024-08-17T02:26:12.772914+0000","last_undegraded":"2024-08-17T02:26:12.772914+0000","last_fullsized":"2024-08-17T02:26:12.772914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:33:42.790374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.755000+0000","last_change":"2024-08-17T02:26:11.743487+0000","last_active":"2024-08-17T02:26:12.755000+0000","last_peered":"2024-08-17T02:26:12.755000+0000","last_clean":"2024-08-17T02:26:12.755000+0000","last_became_active":"2024-08-17T02:26:11.743202+0000","last_became_peered":"2024-08-17T02:26:11.743202+0000","last_unstale":"2024-08-17T02:26:12.755000+0000","last_undegraded":"2024-08-17T02:26:12.755000+0000","last_fullsized":"2024-08-17T02:26:12.755000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:01:19.012403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.774677+0000","last_change":"2024-08-17T02:26:12.769587+0000","last_active":"2024-08-17T02:26:12.774677+0000","last_peered":"2024-08-17T02:26:12.774677+0000","last_clean":"2024-08-17T02:26:12.774677+0000","last_became_active":"2024-08-17T02:26:12.769320+0000","last_became_peered":"2024-08-17T02:26:12.769320+0000","last_unstale":"2024-08-17T02:26:12.774677+0000","last_undegraded":"2024-08-17T02:26:12.774677+0000","last_fullsized":"2024-08-17T02:26:12.774677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:52.096067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.760638+0000","last_change":"2024-08-17T02:26:11.751886+0000","last_active":"2024-08-17T02:26:12.760638+0000","last_peered":"2024-08-17T02:26:12.760638+0000","last_clean":"2024-08-17T02:26:12.760638+0000","last_became_active":"2024-08-17T02:26:11.751183+0000","last_became_peered":"2024-08-17T02:26:11.751183+0000","last_unstale":"2024-08-17T02:26:12.760638+0000","last_undegraded":"2024-08-17T02:26:12.760638+0000","last_fullsized":"2024-08-17T02:26:12.760638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:17:49.864348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.762902+0000","last_change":"2024-08-17T02:26:12.760992+0000","last_active":"2024-08-17T02:26:12.762902+0000","last_peered":"2024-08-17T02:26:12.762902+0000","last_clean":"2024-08-17T02:26:12.762902+0000","last_became_active":"2024-08-17T02:26:12.760709+0000","last_became_peered":"2024-08-17T02:26:12.760709+0000","last_unstale":"2024-08-17T02:26:12.762902+0000","last_undegraded":"2024-08-17T02:26:12.762902+0000","last_fullsized":"2024-08-17T02:26:12.762902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:56:34.246512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:13.765976+0000","last_change":"2024-08-17T02:26:11.744348+0000","last_active":"2024-08-17T02:26:13.765976+0000","last_peered":"2024-08-17T02:26:13.765976+0000","last_clean":"2024-08-17T02:26:13.765976+0000","last_became_active":"2024-08-17T02:26:11.744074+0000","last_became_peered":"2024-08-17T02:26:11.744074+0000","last_unstale":"2024-08-17T02:26:13.765976+0000","last_undegraded":"2024-08-17T02:26:13.765976+0000","last_fullsized":"2024-08-17T02:26:13.765976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:12.144056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.773545+0000","last_change":"2024-08-17T02:26:12.769279+0000","last_active":"2024-08-17T02:26:12.773545+0000","last_peered":"2024-08-17T02:26:12.773545+0000","last_clean":"2024-08-17T02:26:12.773545+0000","last_became_active":"2024-08-17T02:26:12.768690+0000","last_became_peered":"2024-08-17T02:26:12.768690+0000","last_unstale":"2024-08-17T02:26:12.773545+0000","last_undegraded":"2024-08-17T02:26:12.773545+0000","last_fullsized":"2024-08-17T02:26:12.773545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:57:16.242016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.788598+0000","last_change":"2024-08-17T02:26:11.752392+0000","last_active":"2024-08-17T02:26:12.788598+0000","last_peered":"2024-08-17T02:26:12.788598+0000","last_clean":"2024-08-17T02:26:12.788598+0000","last_became_active":"2024-08-17T02:26:11.751991+0000","last_became_peered":"2024-08-17T02:26:11.751991+0000","last_unstale":"2024-08-17T02:26:12.788598+0000","last_undegraded":"2024-08-17T02:26:12.788598+0000","last_fullsized":"2024-08-17T02:26:12.788598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:28:45.373009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.763790+0000","last_change":"2024-08-17T02:26:12.759849+0000","last_active":"2024-08-17T02:26:12.763790+0000","last_peered":"2024-08-17T02:26:12.763790+0000","last_clean":"2024-08-17T02:26:12.763790+0000","last_became_active":"2024-08-17T02:26:12.759502+0000","last_became_peered":"2024-08-17T02:26:12.759502+0000","last_unstale":"2024-08-17T02:26:12.763790+0000","last_undegraded":"2024-08-17T02:26:12.763790+0000","last_fullsized":"2024-08-17T02:26:12.763790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:00:16.197120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.758942+0000","last_change":"2024-08-17T02:26:11.749500+0000","last_active":"2024-08-17T02:26:12.758942+0000","last_peered":"2024-08-17T02:26:12.758942+0000","last_clean":"2024-08-17T02:26:12.758942+0000","last_became_active":"2024-08-17T02:26:11.749109+0000","last_became_peered":"2024-08-17T02:26:11.749109+0000","last_unstale":"2024-08-17T02:26:12.758942+0000","last_undegraded":"2024-08-17T02:26:12.758942+0000","last_fullsized":"2024-08-17T02:26:12.758942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:33:41.782234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.771792+0000","last_change":"2024-08-17T02:26:12.767588+0000","last_active":"2024-08-17T02:26:12.771792+0000","last_peered":"2024-08-17T02:26:12.771792+0000","last_clean":"2024-08-17T02:26:12.771792+0000","last_became_active":"2024-08-17T02:26:12.767340+0000","last_became_peered":"2024-08-17T02:26:12.767340+0000","last_unstale":"2024-08-17T02:26:12.771792+0000","last_undegraded":"2024-08-17T02:26:12.771792+0000","last_fullsized":"2024-08-17T02:26:12.771792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:13.152196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.754893+0000","last_change":"2024-08-17T02:26:11.752823+0000","last_active":"2024-08-17T02:26:12.754893+0000","last_peered":"2024-08-17T02:26:12.754893+0000","last_clean":"2024-08-17T02:26:12.754893+0000","last_became_active":"2024-08-17T02:26:11.752550+0000","last_became_peered":"2024-08-17T02:26:11.752550+0000","last_unstale":"2024-08-17T02:26:12.754893+0000","last_undegraded":"2024-08-17T02:26:12.754893+0000","last_fullsized":"2024-08-17T02:26:12.754893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:28:45.373009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.769060+0000","last_change":"2024-08-17T02:26:12.765817+0000","last_active":"2024-08-17T02:26:12.769060+0000","last_peered":"2024-08-17T02:26:12.769060+0000","last_clean":"2024-08-17T02:26:12.769060+0000","last_became_active":"2024-08-17T02:26:12.765318+0000","last_became_peered":"2024-08-17T02:26:12.765318+0000","last_unstale":"2024-08-17T02:26:12.769060+0000","last_undegraded":"2024-08-17T02:26:12.769060+0000","last_fullsized":"2024-08-17T02:26:12.769060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:28:12.295650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.755330+0000","last_change":"2024-08-17T02:26:11.747437+0000","last_active":"2024-08-17T02:26:12.755330+0000","last_peered":"2024-08-17T02:26:12.755330+0000","last_clean":"2024-08-17T02:26:12.755330+0000","last_became_active":"2024-08-17T02:26:11.747213+0000","last_became_peered":"2024-08-17T02:26:11.747213+0000","last_unstale":"2024-08-17T02:26:12.755330+0000","last_undegraded":"2024-08-17T02:26:12.755330+0000","last_fullsized":"2024-08-17T02:26:12.755330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:33:41.782234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.769100+0000","last_change":"2024-08-17T02:26:12.765628+0000","last_active":"2024-08-17T02:26:12.769100+0000","last_peered":"2024-08-17T02:26:12.769100+0000","last_clean":"2024-08-17T02:26:12.769100+0000","last_became_active":"2024-08-17T02:26:12.765332+0000","last_became_peered":"2024-08-17T02:26:12.765332+0000","last_unstale":"2024-08-17T02:26:12.769100+0000","last_undegraded":"2024-08-17T02:26:12.769100+0000","last_fullsized":"2024-08-17T02:26:12.769100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:35:38.652631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.788340+0000","last_change":"2024-08-17T02:26:11.751615+0000","last_active":"2024-08-17T02:26:12.788340+0000","last_peered":"2024-08-17T02:26:12.788340+0000","last_clean":"2024-08-17T02:26:12.788340+0000","last_became_active":"2024-08-17T02:26:11.751145+0000","last_became_peered":"2024-08-17T02:26:11.751145+0000","last_unstale":"2024-08-17T02:26:12.788340+0000","last_undegraded":"2024-08-17T02:26:12.788340+0000","last_fullsized":"2024-08-17T02:26:12.788340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:28:45.373009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.773892+0000","last_change":"2024-08-17T02:26:12.769204+0000","last_active":"2024-08-17T02:26:12.773892+0000","last_peered":"2024-08-17T02:26:12.773892+0000","last_clean":"2024-08-17T02:26:12.773892+0000","last_became_active":"2024-08-17T02:26:12.768909+0000","last_became_peered":"2024-08-17T02:26:12.768909+0000","last_unstale":"2024-08-17T02:26:12.773892+0000","last_undegraded":"2024-08-17T02:26:12.773892+0000","last_fullsized":"2024-08-17T02:26:12.773892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:57:43.119108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.773689+0000","last_change":"2024-08-17T02:26:12.765911+0000","last_active":"2024-08-17T02:26:12.773689+0000","last_peered":"2024-08-17T02:26:12.773689+0000","last_clean":"2024-08-17T02:26:12.773689+0000","last_became_active":"2024-08-17T02:26:12.765109+0000","last_became_peered":"2024-08-17T02:26:12.765109+0000","last_unstale":"2024-08-17T02:26:12.773689+0000","last_undegraded":"2024-08-17T02:26:12.773689+0000","last_fullsized":"2024-08-17T02:26:12.773689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:58:46.756190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.788301+0000","last_change":"2024-08-17T02:26:11.755644+0000","last_active":"2024-08-17T02:26:12.788301+0000","last_peered":"2024-08-17T02:26:12.788301+0000","last_clean":"2024-08-17T02:26:12.788301+0000","last_became_active":"2024-08-17T02:26:11.755257+0000","last_became_peered":"2024-08-17T02:26:11.755257+0000","last_unstale":"2024-08-17T02:26:12.788301+0000","last_undegraded":"2024-08-17T02:26:12.788301+0000","last_fullsized":"2024-08-17T02:26:12.788301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:44:31.584691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.762324+0000","last_change":"2024-08-17T02:26:12.759902+0000","last_active":"2024-08-17T02:26:12.762324+0000","last_peered":"2024-08-17T02:26:12.762324+0000","last_clean":"2024-08-17T02:26:12.762324+0000","last_became_active":"2024-08-17T02:26:12.759616+0000","last_became_peered":"2024-08-17T02:26:12.759616+0000","last_unstale":"2024-08-17T02:26:12.762324+0000","last_undegraded":"2024-08-17T02:26:12.762324+0000","last_fullsized":"2024-08-17T02:26:12.762324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:57:43.119108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.788334+0000","last_change":"2024-08-17T02:26:11.751645+0000","last_active":"2024-08-17T02:26:12.788334+0000","last_peered":"2024-08-17T02:26:12.788334+0000","last_clean":"2024-08-17T02:26:12.788334+0000","last_became_active":"2024-08-17T02:26:11.751331+0000","last_became_peered":"2024-08-17T02:26:11.751331+0000","last_unstale":"2024-08-17T02:26:12.788334+0000","last_undegraded":"2024-08-17T02:26:12.788334+0000","last_fullsized":"2024-08-17T02:26:12.788334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:12.144056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.765093+0000","last_change":"2024-08-17T02:26:12.763641+0000","last_active":"2024-08-17T02:26:12.765093+0000","last_peered":"2024-08-17T02:26:12.765093+0000","last_clean":"2024-08-17T02:26:12.765093+0000","last_became_active":"2024-08-17T02:26:12.763027+0000","last_became_peered":"2024-08-17T02:26:12.763027+0000","last_unstale":"2024-08-17T02:26:12.765093+0000","last_undegraded":"2024-08-17T02:26:12.765093+0000","last_fullsized":"2024-08-17T02:26:12.765093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:49:37.970276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.780543+0000","last_change":"2024-08-17T02:26:11.748898+0000","last_active":"2024-08-17T02:26:12.780543+0000","last_peered":"2024-08-17T02:26:12.780543+0000","last_clean":"2024-08-17T02:26:12.780543+0000","last_became_active":"2024-08-17T02:26:11.748630+0000","last_became_peered":"2024-08-17T02:26:11.748630+0000","last_unstale":"2024-08-17T02:26:12.780543+0000","last_undegraded":"2024-08-17T02:26:12.780543+0000","last_fullsized":"2024-08-17T02:26:12.780543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:12.144056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.769043+0000","last_change":"2024-08-17T02:26:12.763150+0000","last_active":"2024-08-17T02:26:12.769043+0000","last_peered":"2024-08-17T02:26:12.769043+0000","last_clean":"2024-08-17T02:26:12.769043+0000","last_became_active":"2024-08-17T02:26:12.762858+0000","last_became_peered":"2024-08-17T02:26:12.762858+0000","last_unstale":"2024-08-17T02:26:12.769043+0000","last_undegraded":"2024-08-17T02:26:12.769043+0000","last_fullsized":"2024-08-17T02:26:12.769043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:11.716679+0000","last_clean_scrub_stamp":"2024-08-17T02:26:11.716679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:09:06.162369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:12.789331+0000","last_change":"2024-08-17T02:26:11.750667+0000","last_active":"2024-08-17T02:26:12.789331+0000","last_peered":"2024-08-17T02:26:12.789331+0000","last_clean":"2024-08-17T02:26:12.789331+0000","last_became_active":"2024-08-17T02:26:11.750353+0000","last_became_peered":"2024-08-17T02:26:11.750353+0000","last_unstale":"2024-08-17T02:26:12.789331+0000","last_undegraded":"2024-08-17T02:26:12.789331+0000","last_fullsized":"2024-08-17T02:26:12.789331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:10.708539+0000","last_clean_scrub_stamp":"2024-08-17T02:26:10.708539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:57:03.276859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298144,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073696,"statfs":{"total":96636764160,"available":96331464704,"internally_reserved":0,"allocated":806912,"data_stored":662605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.196}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3169999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":221184,"data_stored":73219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2809999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":212992,"data_stored":71757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":221184,"data_stored":71793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2250000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":221184,"data_stored":73219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4259999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":217088,"data_stored":71827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":208896,"data_stored":71667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]}]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298152,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073688,"statfs":{"total":96636764160,"available":96331456512,"internally_reserved":0,"allocated":815104,"data_stored":662661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:26:19.984 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:26:19.984 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-17T02:26:19.984 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-08-17T02:26:19.985 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-08-17T02:26:20.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.081+0000 7fe57359e700 1 Processor -- start 2024-08-17T02:26:20.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.081+0000 7fe57359e700 1 -- start start 2024-08-17T02:26:20.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.081+0000 7fe57359e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe5741553e0 0x7fe5740af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:20.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.081+0000 7fe57359e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe5740686a0 0x7fe574068b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:20.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.081+0000 7fe57359e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe574155c00 con 0x7fe5741557b0 2024-08-17T02:26:20.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.081+0000 7fe57359e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe574069040 con 0x7fe5741553e0 2024-08-17T02:26:20.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.081+0000 7fe57359e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe574155e30 con 0x7fe5740686a0 2024-08-17T02:26:20.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.081+0000 7fe57259c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe5741553e0 0x7fe5740af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:20.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.081+0000 7fe571d9b700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fe5741557b0 0x7fe5740b1d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35822/0 (socket says 172.21.15.153:35822) 2024-08-17T02:26:20.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.081+0000 7fe571d9b700 1 -- 172.21.15.153:0/1712556998 learned_addr learned my addr 172.21.15.153:0/1712556998 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:20.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.081+0000 7fe572d9d700 1 --2- 172.21.15.153:0/1712556998 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe5740686a0 0x7fe574068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:20.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.081+0000 7fe57259c700 1 -- 172.21.15.153:0/1712556998 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe5740686a0 msgr2=0x7fe574068b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:20.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.081+0000 7fe57259c700 1 --2- 172.21.15.153:0/1712556998 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe5740686a0 0x7fe574068b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.081+0000 7fe57259c700 1 -- 172.21.15.153:0/1712556998 >> v1:172.21.15.153:6789/0 conn(0x7fe5741557b0 legacy=0x7fe5740b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:20.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.081+0000 7fe57259c700 1 -- 172.21.15.153:0/1712556998 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe574156110 con 0x7fe5741553e0 2024-08-17T02:26:20.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.081+0000 7fe57259c700 1 --2- 172.21.15.153:0/1712556998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5741553e0 0x7fe5740af4d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe5640098e0 tx=0x7fe5640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8dd112e0fb44c1c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:20.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.081+0000 7fe57159a700 1 -- 172.21.15.153:0/1712556998 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe564009e80 con 0x7fe5741553e0 2024-08-17T02:26:20.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.081+0000 7fe57159a700 1 -- 172.21.15.153:0/1712556998 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56400b860 con 0x7fe5741553e0 2024-08-17T02:26:20.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.081+0000 7fe57159a700 1 -- 172.21.15.153:0/1712556998 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56400bbe0 con 0x7fe5741553e0 2024-08-17T02:26:20.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.081+0000 7fe57359e700 1 -- 172.21.15.153:0/1712556998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5741553e0 msgr2=0x7fe5740af4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:20.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.081+0000 7fe57359e700 1 --2- 172.21.15.153:0/1712556998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5741553e0 0x7fe5740af4d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe5640098e0 tx=0x7fe5640091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.081+0000 7fe57359e700 1 -- 172.21.15.153:0/1712556998 shutdown_connections 2024-08-17T02:26:20.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.081+0000 7fe57359e700 1 --2- 172.21.15.153:0/1712556998 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe5740686a0 0x7fe574068b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.081+0000 7fe57359e700 1 --2- 172.21.15.153:0/1712556998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5741553e0 0x7fe5740af4d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.081+0000 7fe57359e700 1 -- 172.21.15.153:0/1712556998 >> 172.21.15.153:0/1712556998 conn(0x7fe57406d800 msgr2=0x7fe57406dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:20.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.081+0000 7fe57359e700 1 -- 172.21.15.153:0/1712556998 shutdown_connections 2024-08-17T02:26:20.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.081+0000 7fe57359e700 1 -- 172.21.15.153:0/1712556998 wait complete. 2024-08-17T02:26:20.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.085+0000 7fe57359e700 1 Processor -- start 2024-08-17T02:26:20.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.085+0000 7fe57359e700 1 -- start start 2024-08-17T02:26:20.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.085+0000 7fe57359e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5740686a0 0x7fe5741505c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:20.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.085+0000 7fe57359e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5741557b0 0x7fe5740a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:20.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.085+0000 7fe57359e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe5740a6000 0x7fe574159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:20.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.085+0000 7fe57359e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5740a64a0 con 0x7fe5740686a0 2024-08-17T02:26:20.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.085+0000 7fe57359e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57415ab20 con 0x7fe5741557b0 2024-08-17T02:26:20.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.085+0000 7fe57359e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe574150b00 con 0x7fe5740a6000 2024-08-17T02:26:20.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.085+0000 7fe57259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5740686a0 0x7fe5741505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:20.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.085+0000 7fe57259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5740686a0 0x7fe5741505c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57754/0 (socket says 172.21.15.153:57754) 2024-08-17T02:26:20.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.085+0000 7fe57259c700 1 -- 172.21.15.153:0/4165023770 learned_addr learned my addr 172.21.15.153:0/4165023770 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:20.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.085+0000 7fe571d9b700 1 --2- 172.21.15.153:0/4165023770 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5741557b0 0x7fe5740a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:20.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.085+0000 7fe572d9d700 1 --2- 172.21.15.153:0/4165023770 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe5740a6000 0x7fe574159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:20.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.085+0000 7fe57259c700 1 -- 172.21.15.153:0/4165023770 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe5740a6000 msgr2=0x7fe574159220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:20.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.085+0000 7fe57259c700 1 --2- 172.21.15.153:0/4165023770 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe5740a6000 0x7fe574159220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.085+0000 7fe57259c700 1 -- 172.21.15.153:0/4165023770 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5741557b0 msgr2=0x7fe5740a5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:20.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.085+0000 7fe57259c700 1 --2- 172.21.15.153:0/4165023770 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5741557b0 0x7fe5740a5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.085+0000 7fe57259c700 1 -- 172.21.15.153:0/4165023770 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe564009420 con 0x7fe5740686a0 2024-08-17T02:26:20.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.085+0000 7fe571d9b700 1 --2- 172.21.15.153:0/4165023770 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5741557b0 0x7fe5740a5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:20.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.085+0000 7fe57259c700 1 --2- 172.21.15.153:0/4165023770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5740686a0 0x7fe5741505c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe564013000 tx=0x7fe564017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:20.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.085+0000 7fe5627fc700 1 -- 172.21.15.153:0/4165023770 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56400bbe0 con 0x7fe5740686a0 2024-08-17T02:26:20.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.085+0000 7fe5627fc700 1 -- 172.21.15.153:0/4165023770 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe564011420 con 0x7fe5740686a0 2024-08-17T02:26:20.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.085+0000 7fe57359e700 1 -- 172.21.15.153:0/4165023770 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe574159f10 con 0x7fe5740686a0 2024-08-17T02:26:20.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.085+0000 7fe5627fc700 1 -- 172.21.15.153:0/4165023770 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5640117e0 con 0x7fe5740686a0 2024-08-17T02:26:20.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.085+0000 7fe57359e700 1 -- 172.21.15.153:0/4165023770 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe57415a4d0 con 0x7fe5740686a0 2024-08-17T02:26:20.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.085+0000 7fe57359e700 1 -- 172.21.15.153:0/4165023770 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5740638f0 con 0x7fe5740686a0 2024-08-17T02:26:20.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.089+0000 7fe5627fc700 1 -- 172.21.15.153:0/4165023770 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe564011bd0 con 0x7fe5740686a0 2024-08-17T02:26:20.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.089+0000 7fe5627fc700 1 --2- 172.21.15.153:0/4165023770 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fe554060860 0x7fe554062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:20.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.089+0000 7fe5627fc700 1 -- 172.21.15.153:0/4165023770 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe56407ee10 con 0x7fe5740686a0 2024-08-17T02:26:20.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.089+0000 7fe571d9b700 1 --2- 172.21.15.153:0/4165023770 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fe554060860 0x7fe554062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:20.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.089+0000 7fe571d9b700 1 --2- 172.21.15.153:0/4165023770 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fe554060860 0x7fe554062d10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe5740a7a50 tx=0x7fe56c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:20.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.097+0000 7fe5627fc700 1 -- 172.21.15.153:0/4165023770 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe56404f260 con 0x7fe5740686a0 2024-08-17T02:26:20.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.277+0000 7fe57359e700 1 -- 172.21.15.153:0/4165023770 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe5740cba90 con 0x7fe5740686a0 2024-08-17T02:26:20.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.277+0000 7fe5627fc700 1 -- 172.21.15.153:0/4165023770 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fe564052880 con 0x7fe5740686a0 2024-08-17T02:26:20.282 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:20.282 INFO:teuthology.orchestra.run.smithi153.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-17T02:26:20.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.281+0000 7fe57359e700 1 -- 172.21.15.153:0/4165023770 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fe554060860 msgr2=0x7fe554062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:20.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.281+0000 7fe57359e700 1 --2- 172.21.15.153:0/4165023770 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fe554060860 0x7fe554062d10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe5740a7a50 tx=0x7fe56c009040 comp rx=0 tx=0).stop 2024-08-17T02:26:20.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.281+0000 7fe57359e700 1 -- 172.21.15.153:0/4165023770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5740686a0 msgr2=0x7fe5741505c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:20.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.281+0000 7fe57359e700 1 --2- 172.21.15.153:0/4165023770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5740686a0 0x7fe5741505c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe564013000 tx=0x7fe564017000 comp rx=0 tx=0).stop 2024-08-17T02:26:20.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.281+0000 7fe57359e700 1 -- 172.21.15.153:0/4165023770 shutdown_connections 2024-08-17T02:26:20.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.281+0000 7fe57359e700 1 --2- 172.21.15.153:0/4165023770 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fe554060860 0x7fe554062d10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.281+0000 7fe57359e700 1 --2- 172.21.15.153:0/4165023770 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe5740a6000 0x7fe574159220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.281+0000 7fe57359e700 1 --2- 172.21.15.153:0/4165023770 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5741557b0 0x7fe5740a5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.281+0000 7fe57359e700 1 --2- 172.21.15.153:0/4165023770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5740686a0 0x7fe5741505c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.281+0000 7fe57359e700 1 -- 172.21.15.153:0/4165023770 >> 172.21.15.153:0/4165023770 conn(0x7fe57406d800 msgr2=0x7fe574063060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:20.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.281+0000 7fe57359e700 1 -- 172.21.15.153:0/4165023770 shutdown_connections 2024-08-17T02:26:20.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.281+0000 7fe57359e700 1 -- 172.21.15.153:0/4165023770 wait complete. 2024-08-17T02:26:20.295 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-08-17T02:26:20.295 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:20.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.393+0000 7f6df3fff700 1 Processor -- start 2024-08-17T02:26:20.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.393+0000 7f6df3fff700 1 -- start start 2024-08-17T02:26:20.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.393+0000 7f6df3fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6df40ad1b0 0x7f6df40b0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:20.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.393+0000 7f6df3fff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6df40c86e0 con 0x7f6df415cd90 2024-08-17T02:26:20.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.393+0000 7f6df3fff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6df40cb850 con 0x7f6df415c620 2024-08-17T02:26:20.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.393+0000 7f6df3fff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df415d1c0 con 0x7f6df40ad1b0 2024-08-17T02:26:20.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.393+0000 7f6df37fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f6df415cd90 0x7f6df40c8b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35826/0 (socket says 172.21.15.153:35826) 2024-08-17T02:26:20.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.393+0000 7f6df37fe700 1 -- 172.21.15.153:0/426552165 learned_addr learned my addr 172.21.15.153:0/426552165 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:20.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.393+0000 7f6df27fc700 1 --2- 172.21.15.153:0/426552165 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6df40ad1b0 0x7f6df40b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:20.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.393+0000 7f6df1ffb700 1 -- 172.21.15.153:0/426552165 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3122906035 0 0) 0x7f6df40c86e0 con 0x7f6df415cd90 2024-08-17T02:26:20.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.393+0000 7f6df1ffb700 1 -- 172.21.15.153:0/426552165 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ddc003570 con 0x7f6df415cd90 2024-08-17T02:26:20.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.393+0000 7f6df1ffb700 1 -- 172.21.15.153:0/426552165 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3230257130 0 0) 0x7f6df40cb850 con 0x7f6df415c620 2024-08-17T02:26:20.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.393+0000 7f6df1ffb700 1 -- 172.21.15.153:0/426552165 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6df40c86e0 con 0x7f6df415c620 2024-08-17T02:26:20.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.393+0000 7f6df1ffb700 1 -- 172.21.15.153:0/426552165 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3176360112 0 0) 0x7f6ddc003570 con 0x7f6df415cd90 2024-08-17T02:26:20.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.393+0000 7f6df27fc700 1 -- 172.21.15.153:0/426552165 >> v1:172.21.15.174:6789/0 conn(0x7f6df415c620 legacy=0x7f6df40acaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:20.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.393+0000 7f6df27fc700 1 -- 172.21.15.153:0/426552165 >> v1:172.21.15.153:6789/0 conn(0x7f6df415cd90 legacy=0x7f6df40c8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:20.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.393+0000 7f6df27fc700 1 -- 172.21.15.153:0/426552165 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df415d490 con 0x7f6df40ad1b0 2024-08-17T02:26:20.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.393+0000 7f6df27fc700 1 --2- 172.21.15.153:0/426552165 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6df40ad1b0 0x7f6df40b0320 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6de8009910 tx=0x7f6de80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d895a47fae727ba7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:20.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.393+0000 7f6df1ffb700 1 -- 172.21.15.153:0/426552165 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dec0017f0 con 0x7f6df40ad1b0 2024-08-17T02:26:20.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.393+0000 7f6df1ffb700 1 -- 172.21.15.153:0/426552165 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de8011420 con 0x7f6df40ad1b0 2024-08-17T02:26:20.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.393+0000 7f6df1ffb700 1 -- 172.21.15.153:0/426552165 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de80117c0 con 0x7f6df40ad1b0 2024-08-17T02:26:20.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.397+0000 7f6df3fff700 1 -- 172.21.15.153:0/426552165 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6df40ad1b0 msgr2=0x7f6df40b0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:20.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.397+0000 7f6df3fff700 1 --2- 172.21.15.153:0/426552165 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6df40ad1b0 0x7f6df40b0320 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6de8009910 tx=0x7f6de80091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.397+0000 7f6df3fff700 1 -- 172.21.15.153:0/426552165 shutdown_connections 2024-08-17T02:26:20.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.397+0000 7f6df3fff700 1 --2- 172.21.15.153:0/426552165 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6df40ad1b0 0x7f6df40b0320 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.397+0000 7f6df3fff700 1 -- 172.21.15.153:0/426552165 >> 172.21.15.153:0/426552165 conn(0x7f6df40ca900 msgr2=0x7f6df40cad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:20.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.397+0000 7f6df3fff700 1 -- 172.21.15.153:0/426552165 shutdown_connections 2024-08-17T02:26:20.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.397+0000 7f6df3fff700 1 -- 172.21.15.153:0/426552165 wait complete. 2024-08-17T02:26:20.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.397+0000 7f6df3fff700 1 Processor -- start 2024-08-17T02:26:20.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.397+0000 7f6df3fff700 1 -- start start 2024-08-17T02:26:20.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.397+0000 7f6df3fff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6df40ad1b0 0x7f6df414c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:20.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.397+0000 7f6df3fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6df415c620 0x7f6df40c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:20.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.397+0000 7f6df3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6df415cd90 0x7f6df40b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:20.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.397+0000 7f6df3fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df40aa8c0 con 0x7f6df415cd90 2024-08-17T02:26:20.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.397+0000 7f6df3fff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df40a9cb0 con 0x7f6df40ad1b0 2024-08-17T02:26:20.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.397+0000 7f6df3fff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df40a9f90 con 0x7f6df415c620 2024-08-17T02:26:20.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.397+0000 7f6df37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6df415cd90 0x7f6df40b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:20.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.397+0000 7f6df27fc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6df415c620 0x7f6df40c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:20.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.397+0000 7f6df27fc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6df415c620 0x7f6df40c7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.153:35104/0 (socket says 172.21.15.153:35104) 2024-08-17T02:26:20.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.397+0000 7f6df37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6df415cd90 0x7f6df40b1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57770/0 (socket says 172.21.15.153:57770) 2024-08-17T02:26:20.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.397+0000 7f6df27fc700 1 -- 172.21.15.153:0/3246481498 learned_addr learned my addr 172.21.15.153:0/3246481498 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:20.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.397+0000 7f6df2ffd700 1 --2- 172.21.15.153:0/3246481498 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6df40ad1b0 0x7f6df414c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:20.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.397+0000 7f6df37fe700 1 -- 172.21.15.153:0/3246481498 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6df415c620 msgr2=0x7f6df40c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:20.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.397+0000 7f6df37fe700 1 --2- 172.21.15.153:0/3246481498 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6df415c620 0x7f6df40c7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.397+0000 7f6df37fe700 1 -- 172.21.15.153:0/3246481498 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6df40ad1b0 msgr2=0x7f6df414c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:20.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.397+0000 7f6df37fe700 1 --2- 172.21.15.153:0/3246481498 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6df40ad1b0 0x7f6df414c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.397+0000 7f6df37fe700 1 -- 172.21.15.153:0/3246481498 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de8009420 con 0x7f6df415cd90 2024-08-17T02:26:20.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.397+0000 7f6df27fc700 1 --2- 172.21.15.153:0/3246481498 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6df415c620 0x7f6df40c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:20.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.397+0000 7f6df37fe700 1 --2- 172.21.15.153:0/3246481498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6df415cd90 0x7f6df40b1c40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6dec001370 tx=0x7f6dec007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:20.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.397+0000 7f6ddaffd700 1 -- 172.21.15.153:0/3246481498 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dec004dc0 con 0x7f6df415cd90 2024-08-17T02:26:20.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.397+0000 7f6ddaffd700 1 -- 172.21.15.153:0/3246481498 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dec00a5d0 con 0x7f6df415cd90 2024-08-17T02:26:20.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.397+0000 7f6df3fff700 1 -- 172.21.15.153:0/3246481498 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6df40aa270 con 0x7f6df415cd90 2024-08-17T02:26:20.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.397+0000 7f6ddaffd700 1 -- 172.21.15.153:0/3246481498 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dec00a990 con 0x7f6df415cd90 2024-08-17T02:26:20.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.397+0000 7f6df3fff700 1 -- 172.21.15.153:0/3246481498 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6df414cd90 con 0x7f6df415cd90 2024-08-17T02:26:20.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.401+0000 7f6df3fff700 1 -- 172.21.15.153:0/3246481498 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6df40aaab0 con 0x7f6df415cd90 2024-08-17T02:26:20.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.401+0000 7f6ddaffd700 1 -- 172.21.15.153:0/3246481498 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6dec00ad40 con 0x7f6df415cd90 2024-08-17T02:26:20.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.401+0000 7f6ddaffd700 1 --2- 172.21.15.153:0/3246481498 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6de0060890 0x7f6de0062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:20.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.401+0000 7f6ddaffd700 1 -- 172.21.15.153:0/3246481498 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6dec07c3f0 con 0x7f6df415cd90 2024-08-17T02:26:20.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.401+0000 7f6df2ffd700 1 --2- 172.21.15.153:0/3246481498 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6de0060890 0x7f6de0062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:20.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.401+0000 7f6df2ffd700 1 --2- 172.21.15.153:0/3246481498 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6de0060890 0x7f6de0062d40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6de4007fd0 tx=0x7f6de4007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:20.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.405+0000 7f6ddaffd700 1 -- 172.21.15.153:0/3246481498 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f6df40aaab0 con 0x7f6df415cd90 2024-08-17T02:26:20.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.561+0000 7f6df3fff700 1 -- 172.21.15.153:0/3246481498 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6df40aaab0 con 0x7f6df415cd90 2024-08-17T02:26:20.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.561+0000 7f6ddaffd700 1 -- 172.21.15.153:0/3246481498 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f6df40aaab0 con 0x7f6df415cd90 2024-08-17T02:26:20.564 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:20.564 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":21,"fsid":"56d41c33-b929-456d-96be-2aac4ecd299d","created":"2024-08-17T02:25:47.756085+0000","modified":"2024-08-17T02:26:13.759246+0000","last_up_change":"2024-08-17T02:25:58.643690+0000","last_in_change":"2024-08-17T02:25:49.809186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:58.093273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:09.856520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:11.080706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0736f8e6-818e-42e6-a0dc-8aaf813315d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":24234},{"type":"v1","addr":"172.21.15.153:6817","nonce":24234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":24234},{"type":"v1","addr":"172.21.15.153:6819","nonce":24234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":24234},{"type":"v1","addr":"172.21.15.153:6823","nonce":24234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":24234},{"type":"v1","addr":"172.21.15.153:6821","nonce":24234}]},"public_addr":"172.21.15.153:6817/24234","cluster_addr":"172.21.15.153:6819/24234","heartbeat_back_addr":"172.21.15.153:6823/24234","heartbeat_front_addr":"172.21.15.153:6821/24234","state":["exists","up"]},{"osd":1,"uuid":"011762e9-6c2d-441a-aa56-68474639d72f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":24232},{"type":"v1","addr":"172.21.15.153:6801","nonce":24232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":24232},{"type":"v1","addr":"172.21.15.153:6803","nonce":24232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":24232},{"type":"v1","addr":"172.21.15.153:6809","nonce":24232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":24232},{"type":"v1","addr":"172.21.15.153:6806","nonce":24232}]},"public_addr":"172.21.15.153:6801/24232","cluster_addr":"172.21.15.153:6803/24232","heartbeat_back_addr":"172.21.15.153:6809/24232","heartbeat_front_addr":"172.21.15.153:6806/24232","state":["exists","up"]},{"osd":2,"uuid":"b562cd97-aa12-455e-b46a-e720a2ec9d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":24235},{"type":"v1","addr":"172.21.15.153:6808","nonce":24235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":24235},{"type":"v1","addr":"172.21.15.153:6811","nonce":24235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":24235},{"type":"v1","addr":"172.21.15.153:6815","nonce":24235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":24235},{"type":"v1","addr":"172.21.15.153:6813","nonce":24235}]},"public_addr":"172.21.15.153:6808/24235","cluster_addr":"172.21.15.153:6811/24235","heartbeat_back_addr":"172.21.15.153:6815/24235","heartbeat_front_addr":"172.21.15.153:6813/24235","state":["exists","up"]},{"osd":3,"uuid":"222da52f-90c2-4132-a5d2-6f6cf83d4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":24236},{"type":"v1","addr":"172.21.15.153:6825","nonce":24236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":24236},{"type":"v1","addr":"172.21.15.153:6827","nonce":24236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":24236},{"type":"v1","addr":"172.21.15.153:6831","nonce":24236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":24236},{"type":"v1","addr":"172.21.15.153:6829","nonce":24236}]},"public_addr":"172.21.15.153:6825/24236","cluster_addr":"172.21.15.153:6827/24236","heartbeat_back_addr":"172.21.15.153:6831/24236","heartbeat_front_addr":"172.21.15.153:6829/24236","state":["exists","up"]},{"osd":4,"uuid":"a38a04cd-032b-4977-a260-1ef3567d0c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24456},{"type":"v1","addr":"172.21.15.174:6809","nonce":24456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24456},{"type":"v1","addr":"172.21.15.174:6811","nonce":24456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24456},{"type":"v1","addr":"172.21.15.174:6815","nonce":24456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24456},{"type":"v1","addr":"172.21.15.174:6813","nonce":24456}]},"public_addr":"172.21.15.174:6809/24456","cluster_addr":"172.21.15.174:6811/24456","heartbeat_back_addr":"172.21.15.174:6815/24456","heartbeat_front_addr":"172.21.15.174:6813/24456","state":["exists","up"]},{"osd":5,"uuid":"c7778084-e751-48da-87a1-ab8bbe85aa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24457},{"type":"v1","addr":"172.21.15.174:6825","nonce":24457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24457},{"type":"v1","addr":"172.21.15.174:6827","nonce":24457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24457},{"type":"v1","addr":"172.21.15.174:6831","nonce":24457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24457},{"type":"v1","addr":"172.21.15.174:6829","nonce":24457}]},"public_addr":"172.21.15.174:6825/24457","cluster_addr":"172.21.15.174:6827/24457","heartbeat_back_addr":"172.21.15.174:6831/24457","heartbeat_front_addr":"172.21.15.174:6829/24457","state":["exists","up"]},{"osd":6,"uuid":"2d8e0715-254f-442c-9625-50721d0bc858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24477},{"type":"v1","addr":"172.21.15.174:6801","nonce":24477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24477},{"type":"v1","addr":"172.21.15.174:6803","nonce":24477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24477},{"type":"v1","addr":"172.21.15.174:6807","nonce":24477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24477},{"type":"v1","addr":"172.21.15.174:6805","nonce":24477}]},"public_addr":"172.21.15.174:6801/24477","cluster_addr":"172.21.15.174:6803/24477","heartbeat_back_addr":"172.21.15.174:6807/24477","heartbeat_front_addr":"172.21.15.174:6805/24477","state":["exists","up"]},{"osd":7,"uuid":"dffda25a-4601-4ddb-9a27-b0be1cadde27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24455},{"type":"v1","addr":"172.21.15.174:6817","nonce":24455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24455},{"type":"v1","addr":"172.21.15.174:6819","nonce":24455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24455},{"type":"v1","addr":"172.21.15.174:6823","nonce":24455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24455},{"type":"v1","addr":"172.21.15.174:6821","nonce":24455}]},"public_addr":"172.21.15.174:6817/24455","cluster_addr":"172.21.15.174:6819/24455","heartbeat_back_addr":"172.21.15.174:6823/24455","heartbeat_front_addr":"172.21.15.174:6821/24455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.990117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.033862+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.748087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.112877+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.070448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.360961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.110940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.226377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:20.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.561+0000 7f6df3fff700 1 -- 172.21.15.153:0/3246481498 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6de0060890 msgr2=0x7f6de0062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:20.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.561+0000 7f6df3fff700 1 --2- 172.21.15.153:0/3246481498 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6de0060890 0x7f6de0062d40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6de4007fd0 tx=0x7f6de4007d50 comp rx=0 tx=0).stop 2024-08-17T02:26:20.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.561+0000 7f6df3fff700 1 -- 172.21.15.153:0/3246481498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6df415cd90 msgr2=0x7f6df40b1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:20.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.561+0000 7f6df3fff700 1 --2- 172.21.15.153:0/3246481498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6df415cd90 0x7f6df40b1c40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6dec001370 tx=0x7f6dec007c70 comp rx=0 tx=0).stop 2024-08-17T02:26:20.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.561+0000 7f6df3fff700 1 -- 172.21.15.153:0/3246481498 shutdown_connections 2024-08-17T02:26:20.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.561+0000 7f6df3fff700 1 --2- 172.21.15.153:0/3246481498 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6de0060890 0x7f6de0062d40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.561+0000 7f6df3fff700 1 --2- 172.21.15.153:0/3246481498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6df415cd90 0x7f6df40b1c40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.565+0000 7f6df3fff700 1 --2- 172.21.15.153:0/3246481498 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6df415c620 0x7f6df40c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.565+0000 7f6df3fff700 1 --2- 172.21.15.153:0/3246481498 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6df40ad1b0 0x7f6df414c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.565+0000 7f6df3fff700 1 -- 172.21.15.153:0/3246481498 >> 172.21.15.153:0/3246481498 conn(0x7f6df40ca900 msgr2=0x7f6df40c9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:20.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.565+0000 7f6df3fff700 1 -- 172.21.15.153:0/3246481498 shutdown_connections 2024-08-17T02:26:20.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.565+0000 7f6df3fff700 1 -- 172.21.15.153:0/3246481498 wait complete. 2024-08-17T02:26:20.578 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:58.093273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:26:09.856520+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:26:11.080706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:26:20.578 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:20.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.681+0000 7f03d9b5c700 1 Processor -- start 2024-08-17T02:26:20.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.681+0000 7f03d9b5c700 1 -- start start 2024-08-17T02:26:20.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.685+0000 7f03d9b5c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f03d40ab2e0 0x7f03d40ab710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:20.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.685+0000 7f03d9b5c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f03d40c9930 0x7f03d40c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:20.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.685+0000 7f03d9b5c700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03d40aae50 con 0x7f03d40afd50 2024-08-17T02:26:20.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.685+0000 7f03d9b5c700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03d40abc50 con 0x7f03d40c9930 2024-08-17T02:26:20.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.685+0000 7f03d9b5c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03d40ca2d0 con 0x7f03d40ab2e0 2024-08-17T02:26:20.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.685+0000 7f03d8b5a700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f03d40afd50 0x7f03d40a9860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35828/0 (socket says 172.21.15.153:35828) 2024-08-17T02:26:20.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.685+0000 7f03d8b5a700 1 -- 172.21.15.153:0/779127276 learned_addr learned my addr 172.21.15.153:0/779127276 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:20.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.685+0000 7f03d935b700 1 --2- 172.21.15.153:0/779127276 >> v2:172.21.15.153:3300/0 conn(0x7f03d40c9930 0x7f03d40c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:20.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.685+0000 7f03d3fff700 1 --2- 172.21.15.153:0/779127276 >> v2:172.21.15.174:3300/0 conn(0x7f03d40ab2e0 0x7f03d40ab710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:20.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.685+0000 7f03d37fe700 1 -- 172.21.15.153:0/779127276 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2479175297 0 0) 0x7f03d40aae50 con 0x7f03d40afd50 2024-08-17T02:26:20.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.685+0000 7f03d37fe700 1 -- 172.21.15.153:0/779127276 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03c0003570 con 0x7f03d40afd50 2024-08-17T02:26:20.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.685+0000 7f03d935b700 1 -- 172.21.15.153:0/779127276 >> v2:172.21.15.174:3300/0 conn(0x7f03d40ab2e0 msgr2=0x7f03d40ab710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:20.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.685+0000 7f03d935b700 1 --2- 172.21.15.153:0/779127276 >> v2:172.21.15.174:3300/0 conn(0x7f03d40ab2e0 0x7f03d40ab710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.685+0000 7f03d935b700 1 -- 172.21.15.153:0/779127276 >> v1:172.21.15.153:6789/0 conn(0x7f03d40afd50 legacy=0x7f03d40a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:20.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.685+0000 7f03d935b700 1 -- 172.21.15.153:0/779127276 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d40a9f70 con 0x7f03d40c9930 2024-08-17T02:26:20.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.685+0000 7f03d935b700 1 --2- 172.21.15.153:0/779127276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03d40c9930 0x7f03d40c9d90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f03d40c97e0 tx=0x7f03cc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e91210389d895b0a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:20.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.685+0000 7f03d37fe700 1 -- 172.21.15.153:0/779127276 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03cc00e070 con 0x7f03d40c9930 2024-08-17T02:26:20.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.685+0000 7f03d37fe700 1 -- 172.21.15.153:0/779127276 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03cc00ba70 con 0x7f03d40c9930 2024-08-17T02:26:20.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.685+0000 7f03d37fe700 1 -- 172.21.15.153:0/779127276 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03cc00be10 con 0x7f03d40c9930 2024-08-17T02:26:20.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.685+0000 7f03d9b5c700 1 -- 172.21.15.153:0/779127276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03d40c9930 msgr2=0x7f03d40c9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:20.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.685+0000 7f03d9b5c700 1 --2- 172.21.15.153:0/779127276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03d40c9930 0x7f03d40c9d90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f03d40c97e0 tx=0x7f03cc009780 comp rx=0 tx=0).stop 2024-08-17T02:26:20.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.685+0000 7f03d9b5c700 1 -- 172.21.15.153:0/779127276 shutdown_connections 2024-08-17T02:26:20.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.685+0000 7f03d9b5c700 1 --2- 172.21.15.153:0/779127276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03d40c9930 0x7f03d40c9d90 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.685+0000 7f03d9b5c700 1 --2- 172.21.15.153:0/779127276 >> v2:172.21.15.174:3300/0 conn(0x7f03d40ab2e0 0x7f03d40ab710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.685+0000 7f03d9b5c700 1 -- 172.21.15.153:0/779127276 >> 172.21.15.153:0/779127276 conn(0x7f03d406e170 msgr2=0x7f03d406e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:20.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.685+0000 7f03d9b5c700 1 -- 172.21.15.153:0/779127276 shutdown_connections 2024-08-17T02:26:20.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.685+0000 7f03d9b5c700 1 -- 172.21.15.153:0/779127276 wait complete. 2024-08-17T02:26:20.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.689+0000 7f03d9b5c700 1 Processor -- start 2024-08-17T02:26:20.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.689+0000 7f03d9b5c700 1 -- start start 2024-08-17T02:26:20.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.689+0000 7f03d9b5c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03d40ab2e0 0x7f03d40698b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:20.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.689+0000 7f03d9b5c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03d40afd50 0x7f03d406a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:20.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.689+0000 7f03d9b5c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03d40c9930 0x7f03d4068050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:20.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.689+0000 7f03d9b5c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d4069420 con 0x7f03d40c9930 2024-08-17T02:26:20.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.689+0000 7f03d9b5c700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d406aae0 con 0x7f03d40ab2e0 2024-08-17T02:26:20.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.689+0000 7f03d9b5c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03d4068590 con 0x7f03d40afd50 2024-08-17T02:26:20.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.689+0000 7f03d935b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03d40c9930 0x7f03d4068050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:20.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.689+0000 7f03d935b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03d40c9930 0x7f03d4068050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57798/0 (socket says 172.21.15.153:57798) 2024-08-17T02:26:20.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.689+0000 7f03d935b700 1 -- 172.21.15.153:0/2316788568 learned_addr learned my addr 172.21.15.153:0/2316788568 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:20.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.689+0000 7f03d8b5a700 1 --2- 172.21.15.153:0/2316788568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03d40ab2e0 0x7f03d40698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:20.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.689+0000 7f03d3fff700 1 --2- 172.21.15.153:0/2316788568 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03d40afd50 0x7f03d406a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:20.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.689+0000 7f03d935b700 1 -- 172.21.15.153:0/2316788568 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03d40afd50 msgr2=0x7f03d406a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:20.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.689+0000 7f03d935b700 1 --2- 172.21.15.153:0/2316788568 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03d40afd50 0x7f03d406a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.689+0000 7f03d935b700 1 -- 172.21.15.153:0/2316788568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03d40ab2e0 msgr2=0x7f03d40698b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:20.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.689+0000 7f03d935b700 1 --2- 172.21.15.153:0/2316788568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03d40ab2e0 0x7f03d40698b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.689+0000 7f03d935b700 1 -- 172.21.15.153:0/2316788568 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03cc009a20 con 0x7f03d40c9930 2024-08-17T02:26:20.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.689+0000 7f03d8b5a700 1 --2- 172.21.15.153:0/2316788568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03d40ab2e0 0x7f03d40698b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:20.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.689+0000 7f03d935b700 1 --2- 172.21.15.153:0/2316788568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03d40c9930 0x7f03d4068050 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f03cc012970 tx=0x7f03cc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:20.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.689+0000 7f03d0ff9700 1 -- 172.21.15.153:0/2316788568 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03cc025440 con 0x7f03d40c9930 2024-08-17T02:26:20.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.689+0000 7f03d0ff9700 1 -- 172.21.15.153:0/2316788568 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03cc0255a0 con 0x7f03d40c9930 2024-08-17T02:26:20.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.689+0000 7f03d0ff9700 1 -- 172.21.15.153:0/2316788568 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03cc025960 con 0x7f03d40c9930 2024-08-17T02:26:20.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.689+0000 7f03d9b5c700 1 -- 172.21.15.153:0/2316788568 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03d4068810 con 0x7f03d40c9930 2024-08-17T02:26:20.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.689+0000 7f03d9b5c700 1 -- 172.21.15.153:0/2316788568 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03d4068dd0 con 0x7f03d40c9930 2024-08-17T02:26:20.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.693+0000 7f03d9b5c700 1 -- 172.21.15.153:0/2316788568 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03d4069590 con 0x7f03d40c9930 2024-08-17T02:26:20.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.693+0000 7f03d0ff9700 1 -- 172.21.15.153:0/2316788568 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f03cc025d50 con 0x7f03d40c9930 2024-08-17T02:26:20.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.693+0000 7f03d0ff9700 1 --2- 172.21.15.153:0/2316788568 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f03b4060890 0x7f03b4062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:20.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.693+0000 7f03d0ff9700 1 -- 172.21.15.153:0/2316788568 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f03cc07ebd0 con 0x7f03d40c9930 2024-08-17T02:26:20.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.693+0000 7f03d8b5a700 1 --2- 172.21.15.153:0/2316788568 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f03b4060890 0x7f03b4062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:20.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.693+0000 7f03d8b5a700 1 --2- 172.21.15.153:0/2316788568 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f03b4060890 0x7f03b4062d40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f03bc007fd0 tx=0x7f03bc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:20.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.701+0000 7f03d0ff9700 1 -- 172.21.15.153:0/2316788568 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f03cc04f020 con 0x7f03d40c9930 2024-08-17T02:26:20.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.865+0000 7f03d9b5c700 1 -- 172.21.15.153:0/2316788568 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f03d40638f0 con 0x7f03d40c9930 2024-08-17T02:26:20.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.865+0000 7f03d0ff9700 1 -- 172.21.15.153:0/2316788568 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f03cc052640 con 0x7f03d40c9930 2024-08-17T02:26:20.868 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2024-08-17T02:26:20.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.869+0000 7f03d9b5c700 1 -- 172.21.15.153:0/2316788568 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f03b4060890 msgr2=0x7f03b4062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:20.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.869+0000 7f03d9b5c700 1 --2- 172.21.15.153:0/2316788568 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f03b4060890 0x7f03b4062d40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f03bc007fd0 tx=0x7f03bc009040 comp rx=0 tx=0).stop 2024-08-17T02:26:20.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.869+0000 7f03d9b5c700 1 -- 172.21.15.153:0/2316788568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03d40c9930 msgr2=0x7f03d4068050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:20.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.869+0000 7f03d9b5c700 1 --2- 172.21.15.153:0/2316788568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03d40c9930 0x7f03d4068050 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f03cc012970 tx=0x7f03cc019000 comp rx=0 tx=0).stop 2024-08-17T02:26:20.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.869+0000 7f03d9b5c700 1 -- 172.21.15.153:0/2316788568 shutdown_connections 2024-08-17T02:26:20.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.869+0000 7f03d9b5c700 1 --2- 172.21.15.153:0/2316788568 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f03b4060890 0x7f03b4062d40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.869+0000 7f03d9b5c700 1 --2- 172.21.15.153:0/2316788568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03d40c9930 0x7f03d4068050 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.869+0000 7f03d9b5c700 1 --2- 172.21.15.153:0/2316788568 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03d40afd50 0x7f03d406a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.869+0000 7f03d9b5c700 1 --2- 172.21.15.153:0/2316788568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03d40ab2e0 0x7f03d40698b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.869+0000 7f03d9b5c700 1 -- 172.21.15.153:0/2316788568 >> 172.21.15.153:0/2316788568 conn(0x7f03d406e170 msgr2=0x7f03d415bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:20.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.869+0000 7f03d9b5c700 1 -- 172.21.15.153:0/2316788568 shutdown_connections 2024-08-17T02:26:20.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.869+0000 7f03d9b5c700 1 -- 172.21.15.153:0/2316788568 wait complete. 2024-08-17T02:26:20.888 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:26:21.001 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.997+0000 7f5eb2df0700 1 Processor -- start 2024-08-17T02:26:21.001 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.997+0000 7f5eb2df0700 1 -- start start 2024-08-17T02:26:21.002 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.997+0000 7f5eb2df0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5eac06ead0 0x7f5eac06eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.002 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.997+0000 7f5eb2df0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5eac0b1830 0x7f5eac155c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.002 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.997+0000 7f5eb2df0700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eac0ace30 con 0x7f5eac06e010 2024-08-17T02:26:21.003 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.997+0000 7f5eb2df0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eac0b1c80 con 0x7f5eac0b1830 2024-08-17T02:26:21.003 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.997+0000 7f5eb2df0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac0ae6b0 con 0x7f5eac06ead0 2024-08-17T02:26:21.003 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.997+0000 7f5eb25ef700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f5eac06e010 0x7f5eac152bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35840/0 (socket says 172.21.15.153:35840) 2024-08-17T02:26:21.003 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:20.997+0000 7f5eb25ef700 1 -- 172.21.15.153:0/458948033 learned_addr learned my addr 172.21.15.153:0/458948033 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:21.003 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.001+0000 7f5eb15ed700 1 --2- 172.21.15.153:0/458948033 >> v2:172.21.15.174:3300/0 conn(0x7f5eac0b1830 0x7f5eac155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.003 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.001+0000 7f5eb1dee700 1 --2- 172.21.15.153:0/458948033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5eac06ead0 0x7f5eac06eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.003 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.001+0000 7f5eb0dec700 1 -- 172.21.15.153:0/458948033 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3999366256 0 0) 0x7f5eac0ace30 con 0x7f5eac06e010 2024-08-17T02:26:21.003 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.001+0000 7f5eb0dec700 1 -- 172.21.15.153:0/458948033 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e94003570 con 0x7f5eac06e010 2024-08-17T02:26:21.004 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.001+0000 7f5eb0dec700 1 -- 172.21.15.153:0/458948033 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3900692441 0 0) 0x7f5e94003570 con 0x7f5eac06e010 2024-08-17T02:26:21.004 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.001+0000 7f5eb15ed700 1 -- 172.21.15.153:0/458948033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5eac06ead0 msgr2=0x7f5eac06eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:21.004 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.001+0000 7f5eb15ed700 1 --2- 172.21.15.153:0/458948033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5eac06ead0 0x7f5eac06eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.004 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.001+0000 7f5eb15ed700 1 -- 172.21.15.153:0/458948033 >> v1:172.21.15.153:6789/0 conn(0x7f5eac06e010 legacy=0x7f5eac152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.001+0000 7f5eb15ed700 1 -- 172.21.15.153:0/458948033 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eac156dd0 con 0x7f5eac0b1830 2024-08-17T02:26:21.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.001+0000 7f5eb15ed700 1 --2- 172.21.15.153:0/458948033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5eac0b1830 0x7f5eac155c00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5ea8009e60 tx=0x7f5ea8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3041efb2b0b855e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:21.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.001+0000 7f5eb0dec700 1 -- 172.21.15.153:0/458948033 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea800e070 con 0x7f5eac0b1830 2024-08-17T02:26:21.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.001+0000 7f5eb0dec700 1 -- 172.21.15.153:0/458948033 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea800b7a0 con 0x7f5eac0b1830 2024-08-17T02:26:21.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.001+0000 7f5eb0dec700 1 -- 172.21.15.153:0/458948033 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea4001470 con 0x7f5eac0b1830 2024-08-17T02:26:21.006 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.001+0000 7f5eb2df0700 1 -- 172.21.15.153:0/458948033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5eac0b1830 msgr2=0x7f5eac155c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.006 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.001+0000 7f5eb2df0700 1 --2- 172.21.15.153:0/458948033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5eac0b1830 0x7f5eac155c00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5ea8009e60 tx=0x7f5ea8009780 comp rx=0 tx=0).stop 2024-08-17T02:26:21.006 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.001+0000 7f5eb2df0700 1 -- 172.21.15.153:0/458948033 shutdown_connections 2024-08-17T02:26:21.006 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.001+0000 7f5eb2df0700 1 --2- 172.21.15.153:0/458948033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5eac0b1830 0x7f5eac155c00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.006 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.001+0000 7f5eb2df0700 1 --2- 172.21.15.153:0/458948033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5eac06ead0 0x7f5eac06eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.006 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.001+0000 7f5eb2df0700 1 -- 172.21.15.153:0/458948033 >> 172.21.15.153:0/458948033 conn(0x7f5eac0678a0 msgr2=0x7f5eac067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:21.006 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.001+0000 7f5eb2df0700 1 -- 172.21.15.153:0/458948033 shutdown_connections 2024-08-17T02:26:21.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.001+0000 7f5eb2df0700 1 -- 172.21.15.153:0/458948033 wait complete. 2024-08-17T02:26:21.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.005+0000 7f5eb2df0700 1 Processor -- start 2024-08-17T02:26:21.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.005+0000 7f5eb2df0700 1 -- start start 2024-08-17T02:26:21.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.005+0000 7f5eb2df0700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5eac06e010 0x7f5eac153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.005+0000 7f5eb2df0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5eac06ead0 0x7f5eac1529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.005+0000 7f5eb2df0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5eac0b1830 0x7f5eac14b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.005+0000 7f5eb2df0700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac150ae0 con 0x7f5eac0b1830 2024-08-17T02:26:21.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.005+0000 7f5eb2df0700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac152ee0 con 0x7f5eac06e010 2024-08-17T02:26:21.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.005+0000 7f5eb2df0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac153960 con 0x7f5eac06ead0 2024-08-17T02:26:21.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.005+0000 7f5eb25ef700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5eac0b1830 0x7f5eac14b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.005+0000 7f5eb25ef700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5eac0b1830 0x7f5eac14b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57806/0 (socket says 172.21.15.153:57806) 2024-08-17T02:26:21.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.005+0000 7f5eb25ef700 1 -- 172.21.15.153:0/1792141887 learned_addr learned my addr 172.21.15.153:0/1792141887 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:21.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.005+0000 7f5eb1dee700 1 --2- 172.21.15.153:0/1792141887 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5eac06e010 0x7f5eac153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.005+0000 7f5eb15ed700 1 --2- 172.21.15.153:0/1792141887 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5eac06ead0 0x7f5eac1529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.005+0000 7f5eb25ef700 1 -- 172.21.15.153:0/1792141887 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5eac06ead0 msgr2=0x7f5eac1529a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.005+0000 7f5eb25ef700 1 --2- 172.21.15.153:0/1792141887 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5eac06ead0 0x7f5eac1529a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.005+0000 7f5eb25ef700 1 -- 172.21.15.153:0/1792141887 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5eac06e010 msgr2=0x7f5eac153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.005+0000 7f5eb25ef700 1 --2- 172.21.15.153:0/1792141887 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5eac06e010 0x7f5eac153380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.005+0000 7f5eb25ef700 1 -- 172.21.15.153:0/1792141887 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea8009a20 con 0x7f5eac0b1830 2024-08-17T02:26:21.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.005+0000 7f5eb25ef700 1 --2- 172.21.15.153:0/1792141887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5eac0b1830 0x7f5eac14b1c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5ea400c7e0 tx=0x7f5ea4001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:21.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.009+0000 7f5ea1ffb700 1 -- 172.21.15.153:0/1792141887 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea4007360 con 0x7f5eac0b1830 2024-08-17T02:26:21.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.009+0000 7f5ea1ffb700 1 -- 172.21.15.153:0/1792141887 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea40074c0 con 0x7f5eac0b1830 2024-08-17T02:26:21.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.009+0000 7f5eb2df0700 1 -- 172.21.15.153:0/1792141887 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eac150d30 con 0x7f5eac0b1830 2024-08-17T02:26:21.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.009+0000 7f5ea1ffb700 1 -- 172.21.15.153:0/1792141887 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea4004830 con 0x7f5eac0b1830 2024-08-17T02:26:21.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.009+0000 7f5eb2df0700 1 -- 172.21.15.153:0/1792141887 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eac1512f0 con 0x7f5eac0b1830 2024-08-17T02:26:21.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.009+0000 7f5eb2df0700 1 -- 172.21.15.153:0/1792141887 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eac1514e0 con 0x7f5eac0b1830 2024-08-17T02:26:21.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.009+0000 7f5ea1ffb700 1 -- 172.21.15.153:0/1792141887 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5ea4004c20 con 0x7f5eac0b1830 2024-08-17T02:26:21.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.009+0000 7f5ea1ffb700 1 --2- 172.21.15.153:0/1792141887 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f5e98060860 0x7f5e98062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.009+0000 7f5ea1ffb700 1 -- 172.21.15.153:0/1792141887 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5ea407c270 con 0x7f5eac0b1830 2024-08-17T02:26:21.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.009+0000 7f5eb1dee700 1 --2- 172.21.15.153:0/1792141887 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f5e98060860 0x7f5e98062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.009+0000 7f5eb1dee700 1 --2- 172.21.15.153:0/1792141887 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f5e98060860 0x7f5e98062d10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c009d40 tx=0x7f5e9c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:21.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.017+0000 7f5ea1ffb700 1 -- 172.21.15.153:0/1792141887 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f5ea404c740 con 0x7f5eac0b1830 2024-08-17T02:26:21.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.173+0000 7f5eb2df0700 1 -- 172.21.15.153:0/1792141887 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5eac064330 con 0x7f5eac0b1830 2024-08-17T02:26:21.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.177+0000 7f5ea1ffb700 1 -- 172.21.15.153:0/1792141887 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5ea404fd60 con 0x7f5eac0b1830 2024-08-17T02:26:21.179 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2024-08-17T02:26:21.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.177+0000 7f5eb2df0700 1 -- 172.21.15.153:0/1792141887 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f5e98060860 msgr2=0x7f5e98062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.177+0000 7f5eb2df0700 1 --2- 172.21.15.153:0/1792141887 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f5e98060860 0x7f5e98062d10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c009d40 tx=0x7f5e9c008040 comp rx=0 tx=0).stop 2024-08-17T02:26:21.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.177+0000 7f5eb2df0700 1 -- 172.21.15.153:0/1792141887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5eac0b1830 msgr2=0x7f5eac14b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.177+0000 7f5eb2df0700 1 --2- 172.21.15.153:0/1792141887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5eac0b1830 0x7f5eac14b1c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5ea400c7e0 tx=0x7f5ea4001a00 comp rx=0 tx=0).stop 2024-08-17T02:26:21.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.177+0000 7f5eb2df0700 1 -- 172.21.15.153:0/1792141887 shutdown_connections 2024-08-17T02:26:21.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.177+0000 7f5eb2df0700 1 --2- 172.21.15.153:0/1792141887 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f5e98060860 0x7f5e98062d10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.177+0000 7f5eb2df0700 1 --2- 172.21.15.153:0/1792141887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5eac0b1830 0x7f5eac14b1c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.177+0000 7f5eb2df0700 1 --2- 172.21.15.153:0/1792141887 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5eac06ead0 0x7f5eac1529a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.177+0000 7f5eb2df0700 1 --2- 172.21.15.153:0/1792141887 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5eac06e010 0x7f5eac153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.177+0000 7f5eb2df0700 1 -- 172.21.15.153:0/1792141887 >> 172.21.15.153:0/1792141887 conn(0x7f5eac0678a0 msgr2=0x7f5eac1592e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:21.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.177+0000 7f5eb2df0700 1 -- 172.21.15.153:0/1792141887 shutdown_connections 2024-08-17T02:26:21.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.177+0000 7f5eb2df0700 1 -- 172.21.15.153:0/1792141887 wait complete. 2024-08-17T02:26:21.192 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:26:21.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.297+0000 7fd9365c7700 1 Processor -- start 2024-08-17T02:26:21.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.297+0000 7fd9365c7700 1 -- start start 2024-08-17T02:26:21.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.297+0000 7fd9365c7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd9300cfb00 0x7fd930067400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.297+0000 7fd9365c7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd930158cc0 0x7fd9301590f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.297+0000 7fd9365c7700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9300cf670 con 0x7fd930067030 2024-08-17T02:26:21.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.297+0000 7fd9365c7700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9300cea60 con 0x7fd930158cc0 2024-08-17T02:26:21.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.297+0000 7fd9365c7700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9300ced40 con 0x7fd9300cfb00 2024-08-17T02:26:21.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.301+0000 7fd934dc4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd9300cfb00 0x7fd930067400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.301+0000 7fd935dc6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd930158cc0 0x7fd9301590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.301+0000 7fd9355c5700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fd930067030 0x7fd9300cb080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.153:60076/0 (socket says 172.21.15.153:60076) 2024-08-17T02:26:21.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.301+0000 7fd9355c5700 1 -- 172.21.15.153:0/2034573852 learned_addr learned my addr 172.21.15.153:0/2034573852 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:21.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.301+0000 7fd92ffff700 1 -- 172.21.15.153:0/2034573852 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 105156388 0 0) 0x7fd9300cf670 con 0x7fd930067030 2024-08-17T02:26:21.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.301+0000 7fd92ffff700 1 -- 172.21.15.153:0/2034573852 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd920003570 con 0x7fd930067030 2024-08-17T02:26:21.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.301+0000 7fd934dc4700 1 -- 172.21.15.153:0/2034573852 >> v2:172.21.15.174:3300/0 conn(0x7fd930158cc0 msgr2=0x7fd9301590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:21.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.301+0000 7fd934dc4700 1 --2- 172.21.15.153:0/2034573852 >> v2:172.21.15.174:3300/0 conn(0x7fd930158cc0 0x7fd9301590f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.301+0000 7fd934dc4700 1 -- 172.21.15.153:0/2034573852 >> v1:172.21.15.174:6789/0 conn(0x7fd930067030 legacy=0x7fd9300cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.301+0000 7fd934dc4700 1 -- 172.21.15.153:0/2034573852 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9300cf020 con 0x7fd9300cfb00 2024-08-17T02:26:21.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.301+0000 7fd935dc6700 1 --2- 172.21.15.153:0/2034573852 >> v2:172.21.15.174:3300/0 conn(0x7fd930158cc0 0x7fd9301590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:21.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.301+0000 7fd934dc4700 1 --2- 172.21.15.153:0/2034573852 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd9300cfb00 0x7fd930067400 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd91c0098e0 tx=0x7fd91c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f04e9ca7b0e9581 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:21.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.301+0000 7fd92ffff700 1 -- 172.21.15.153:0/2034573852 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91c011630 con 0x7fd9300cfb00 2024-08-17T02:26:21.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.301+0000 7fd92ffff700 1 -- 172.21.15.153:0/2034573852 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd91c011790 con 0x7fd9300cfb00 2024-08-17T02:26:21.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.301+0000 7fd92ffff700 1 -- 172.21.15.153:0/2034573852 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91c011b30 con 0x7fd9300cfb00 2024-08-17T02:26:21.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.301+0000 7fd9365c7700 1 -- 172.21.15.153:0/2034573852 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd9300cfb00 msgr2=0x7fd930067400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.301+0000 7fd9365c7700 1 --2- 172.21.15.153:0/2034573852 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd9300cfb00 0x7fd930067400 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd91c0098e0 tx=0x7fd91c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.301+0000 7fd9365c7700 1 -- 172.21.15.153:0/2034573852 shutdown_connections 2024-08-17T02:26:21.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.301+0000 7fd9365c7700 1 --2- 172.21.15.153:0/2034573852 >> v2:172.21.15.174:3300/0 conn(0x7fd930158cc0 0x7fd9301590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.301+0000 7fd9365c7700 1 --2- 172.21.15.153:0/2034573852 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd9300cfb00 0x7fd930067400 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.301+0000 7fd9365c7700 1 -- 172.21.15.153:0/2034573852 >> 172.21.15.153:0/2034573852 conn(0x7fd9300d0b50 msgr2=0x7fd9300ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:21.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.301+0000 7fd9365c7700 1 -- 172.21.15.153:0/2034573852 shutdown_connections 2024-08-17T02:26:21.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.301+0000 7fd9365c7700 1 -- 172.21.15.153:0/2034573852 wait complete. 2024-08-17T02:26:21.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.305+0000 7fd9365c7700 1 Processor -- start 2024-08-17T02:26:21.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.305+0000 7fd9365c7700 1 -- start start 2024-08-17T02:26:21.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.305+0000 7fd9365c7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd930067030 0x7fd9300b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.305+0000 7fd9365c7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd9300cfb00 0x7fd9300b1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.305+0000 7fd9365c7700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd930158cc0 0x7fd93015b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.305+0000 7fd9365c7700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd930143ed0 con 0x7fd930067030 2024-08-17T02:26:21.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.305+0000 7fd9365c7700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9301432c0 con 0x7fd930158cc0 2024-08-17T02:26:21.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.305+0000 7fd9365c7700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9301435a0 con 0x7fd9300cfb00 2024-08-17T02:26:21.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.305+0000 7fd9355c5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd930067030 0x7fd9300b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.305+0000 7fd9355c5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd930067030 0x7fd9300b0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57808/0 (socket says 172.21.15.153:57808) 2024-08-17T02:26:21.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.305+0000 7fd9355c5700 1 -- 172.21.15.153:0/3561368208 learned_addr learned my addr 172.21.15.153:0/3561368208 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:21.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.305+0000 7fd934dc4700 1 --2- 172.21.15.153:0/3561368208 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd9300cfb00 0x7fd9300b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.305+0000 7fd935dc6700 1 --2- 172.21.15.153:0/3561368208 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd930158cc0 0x7fd93015b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.305+0000 7fd9355c5700 1 -- 172.21.15.153:0/3561368208 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd9300cfb00 msgr2=0x7fd9300b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.305+0000 7fd9355c5700 1 --2- 172.21.15.153:0/3561368208 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd9300cfb00 0x7fd9300b1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.305+0000 7fd9355c5700 1 -- 172.21.15.153:0/3561368208 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd930158cc0 msgr2=0x7fd93015b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.305+0000 7fd9355c5700 1 --2- 172.21.15.153:0/3561368208 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd930158cc0 0x7fd93015b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.305+0000 7fd9355c5700 1 -- 172.21.15.153:0/3561368208 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd928009420 con 0x7fd930067030 2024-08-17T02:26:21.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.305+0000 7fd9355c5700 1 --2- 172.21.15.153:0/3561368208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd930067030 0x7fd9300b0d00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd92400cd30 tx=0x7fd924001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:21.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.305+0000 7fd92d7fa700 1 -- 172.21.15.153:0/3561368208 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92400ab70 con 0x7fd930067030 2024-08-17T02:26:21.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.305+0000 7fd92d7fa700 1 -- 172.21.15.153:0/3561368208 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd92400acf0 con 0x7fd930067030 2024-08-17T02:26:21.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.305+0000 7fd9365c7700 1 -- 172.21.15.153:0/3561368208 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd91c009420 con 0x7fd930067030 2024-08-17T02:26:21.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.305+0000 7fd92d7fa700 1 -- 172.21.15.153:0/3561368208 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd924007340 con 0x7fd930067030 2024-08-17T02:26:21.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.305+0000 7fd9365c7700 1 -- 172.21.15.153:0/3561368208 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd930143b60 con 0x7fd930067030 2024-08-17T02:26:21.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.309+0000 7fd9365c7700 1 -- 172.21.15.153:0/3561368208 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9300638f0 con 0x7fd930067030 2024-08-17T02:26:21.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.309+0000 7fd92d7fa700 1 -- 172.21.15.153:0/3561368208 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd924007770 con 0x7fd930067030 2024-08-17T02:26:21.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.309+0000 7fd92d7fa700 1 --2- 172.21.15.153:0/3561368208 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd914060860 0x7fd914062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.309+0000 7fd92d7fa700 1 -- 172.21.15.153:0/3561368208 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd92407d0e0 con 0x7fd930067030 2024-08-17T02:26:21.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.309+0000 7fd934dc4700 1 --2- 172.21.15.153:0/3561368208 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd914060860 0x7fd914062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.309+0000 7fd934dc4700 1 --2- 172.21.15.153:0/3561368208 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd914060860 0x7fd914062d10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd91c0091e0 tx=0x7fd91c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:21.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.313+0000 7fd92d7fa700 1 -- 172.21.15.153:0/3561368208 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd92404d5b0 con 0x7fd930067030 2024-08-17T02:26:21.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.477+0000 7fd9365c7700 1 -- 172.21.15.153:0/3561368208 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd930152bd0 con 0x7fd930067030 2024-08-17T02:26:21.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.477+0000 7fd92d7fa700 1 -- 172.21.15.153:0/3561368208 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd92400ae60 con 0x7fd930067030 2024-08-17T02:26:21.482 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2024-08-17T02:26:21.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.481+0000 7fd9365c7700 1 -- 172.21.15.153:0/3561368208 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd914060860 msgr2=0x7fd914062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.481+0000 7fd9365c7700 1 --2- 172.21.15.153:0/3561368208 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd914060860 0x7fd914062d10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd91c0091e0 tx=0x7fd91c017000 comp rx=0 tx=0).stop 2024-08-17T02:26:21.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.481+0000 7fd9365c7700 1 -- 172.21.15.153:0/3561368208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd930067030 msgr2=0x7fd9300b0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.481+0000 7fd9365c7700 1 --2- 172.21.15.153:0/3561368208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd930067030 0x7fd9300b0d00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd92400cd30 tx=0x7fd924001b10 comp rx=0 tx=0).stop 2024-08-17T02:26:21.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.481+0000 7fd9365c7700 1 -- 172.21.15.153:0/3561368208 shutdown_connections 2024-08-17T02:26:21.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.481+0000 7fd9365c7700 1 --2- 172.21.15.153:0/3561368208 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd914060860 0x7fd914062d10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.481+0000 7fd9365c7700 1 --2- 172.21.15.153:0/3561368208 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd930158cc0 0x7fd93015b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.481+0000 7fd9365c7700 1 --2- 172.21.15.153:0/3561368208 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd9300cfb00 0x7fd9300b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.481+0000 7fd9365c7700 1 --2- 172.21.15.153:0/3561368208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd930067030 0x7fd9300b0d00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.481+0000 7fd9365c7700 1 -- 172.21.15.153:0/3561368208 >> 172.21.15.153:0/3561368208 conn(0x7fd9300d0b50 msgr2=0x7fd9300cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:21.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.481+0000 7fd9365c7700 1 -- 172.21.15.153:0/3561368208 shutdown_connections 2024-08-17T02:26:21.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.481+0000 7fd9365c7700 1 -- 172.21.15.153:0/3561368208 wait complete. 2024-08-17T02:26:21.496 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:21.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.601+0000 7fb9d73bd700 1 Processor -- start 2024-08-17T02:26:21.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.601+0000 7fb9d73bd700 1 -- start start 2024-08-17T02:26:21.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.601+0000 7fb9d73bd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb9d00b0d20 0x7fb9d006df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.601+0000 7fb9d73bd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9d00b1800 0x7fb9d0141e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.601+0000 7fb9d73bd700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9d0141a00 con 0x7fb9d006e450 2024-08-17T02:26:21.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.601+0000 7fb9d73bd700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9d006e8a0 con 0x7fb9d00b0d20 2024-08-17T02:26:21.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.601+0000 7fb9d73bd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d0140b10 con 0x7fb9d00b1800 2024-08-17T02:26:21.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.601+0000 7fb9d63bb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb9d00b0d20 0x7fb9d006df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.601+0000 7fb9d6bbc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9d00b1800 0x7fb9d0141e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.601+0000 7fb9d5bba700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fb9d006e450 0x7fb9d00b10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.153:60088/0 (socket says 172.21.15.153:60088) 2024-08-17T02:26:21.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.601+0000 7fb9d5bba700 1 -- 172.21.15.153:0/3194216812 learned_addr learned my addr 172.21.15.153:0/3194216812 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:21.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.601+0000 7fb9d63bb700 1 --2- 172.21.15.153:0/3194216812 >> v2:172.21.15.174:3300/0 conn(0x7fb9d00b0d20 0x7fb9d006df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.153:49854/0 (socket says 172.21.15.153:49854) 2024-08-17T02:26:21.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.601+0000 7fb9d63bb700 1 -- 172.21.15.153:0/3194216812 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9d00b1800 msgr2=0x7fb9d0141e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:21.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.601+0000 7fb9d63bb700 1 --2- 172.21.15.153:0/3194216812 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9d00b1800 0x7fb9d0141e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.601+0000 7fb9d63bb700 1 -- 172.21.15.153:0/3194216812 >> v1:172.21.15.174:6789/0 conn(0x7fb9d006e450 legacy=0x7fb9d00b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.601+0000 7fb9d63bb700 1 -- 172.21.15.153:0/3194216812 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d0140df0 con 0x7fb9d00b0d20 2024-08-17T02:26:21.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.601+0000 7fb9d63bb700 1 --2- 172.21.15.153:0/3194216812 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9d00b0d20 0x7fb9d006df10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc009e60 tx=0x7fb9cc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d8fa2290b8289a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:21.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.601+0000 7fb9d53b9700 1 -- 172.21.15.153:0/3194216812 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc00e070 con 0x7fb9d00b0d20 2024-08-17T02:26:21.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.601+0000 7fb9d53b9700 1 -- 172.21.15.153:0/3194216812 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9cc00bb60 con 0x7fb9d00b0d20 2024-08-17T02:26:21.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.601+0000 7fb9d53b9700 1 -- 172.21.15.153:0/3194216812 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc012430 con 0x7fb9d00b0d20 2024-08-17T02:26:21.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.601+0000 7fb9d73bd700 1 -- 172.21.15.153:0/3194216812 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9d00b0d20 msgr2=0x7fb9d006df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.601+0000 7fb9d73bd700 1 --2- 172.21.15.153:0/3194216812 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9d00b0d20 0x7fb9d006df10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc009e60 tx=0x7fb9cc009780 comp rx=0 tx=0).stop 2024-08-17T02:26:21.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.601+0000 7fb9d73bd700 1 -- 172.21.15.153:0/3194216812 shutdown_connections 2024-08-17T02:26:21.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.601+0000 7fb9d73bd700 1 --2- 172.21.15.153:0/3194216812 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9d00b1800 0x7fb9d0141e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.601+0000 7fb9d73bd700 1 --2- 172.21.15.153:0/3194216812 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9d00b0d20 0x7fb9d006df10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.601+0000 7fb9d73bd700 1 -- 172.21.15.153:0/3194216812 >> 172.21.15.153:0/3194216812 conn(0x7fb9d00678d0 msgr2=0x7fb9d0067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:21.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.601+0000 7fb9d73bd700 1 -- 172.21.15.153:0/3194216812 shutdown_connections 2024-08-17T02:26:21.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.601+0000 7fb9d73bd700 1 -- 172.21.15.153:0/3194216812 wait complete. 2024-08-17T02:26:21.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.605+0000 7fb9d73bd700 1 Processor -- start 2024-08-17T02:26:21.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.605+0000 7fb9d73bd700 1 -- start start 2024-08-17T02:26:21.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.605+0000 7fb9d73bd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9d006e450 0x7fb9d00a60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.605+0000 7fb9d73bd700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9d00b0d20 0x7fb9d013fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.605+0000 7fb9d73bd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9d00b1800 0x7fb9d0146250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.605+0000 7fb9d73bd700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d0146f80 con 0x7fb9d00b1800 2024-08-17T02:26:21.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.605+0000 7fb9d73bd700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d00a5c40 con 0x7fb9d00b0d20 2024-08-17T02:26:21.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.605+0000 7fb9d73bd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d0146ca0 con 0x7fb9d006e450 2024-08-17T02:26:21.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.605+0000 7fb9d6bbc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9d00b1800 0x7fb9d0146250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.605+0000 7fb9d6bbc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9d00b1800 0x7fb9d0146250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57810/0 (socket says 172.21.15.153:57810) 2024-08-17T02:26:21.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.605+0000 7fb9d5bba700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9d00b0d20 0x7fb9d013fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.605+0000 7fb9d6bbc700 1 -- 172.21.15.153:0/2271977667 learned_addr learned my addr 172.21.15.153:0/2271977667 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:21.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.605+0000 7fb9d63bb700 1 --2- 172.21.15.153:0/2271977667 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9d006e450 0x7fb9d00a60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.605+0000 7fb9d6bbc700 1 -- 172.21.15.153:0/2271977667 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9d006e450 msgr2=0x7fb9d00a60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.605+0000 7fb9d6bbc700 1 --2- 172.21.15.153:0/2271977667 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9d006e450 0x7fb9d00a60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.605+0000 7fb9d6bbc700 1 -- 172.21.15.153:0/2271977667 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9d00b0d20 msgr2=0x7fb9d013fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.605+0000 7fb9d6bbc700 1 --2- 172.21.15.153:0/2271977667 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9d00b0d20 0x7fb9d013fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.605+0000 7fb9d6bbc700 1 -- 172.21.15.153:0/2271977667 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9cc009a20 con 0x7fb9d00b1800 2024-08-17T02:26:21.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.605+0000 7fb9d5bba700 1 --2- 172.21.15.153:0/2271977667 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9d00b0d20 0x7fb9d013fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:21.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.605+0000 7fb9d63bb700 1 --2- 172.21.15.153:0/2271977667 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9d006e450 0x7fb9d00a60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:21.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.609+0000 7fb9d6bbc700 1 --2- 172.21.15.153:0/2271977667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9d00b1800 0x7fb9d0146250 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb9c800ea50 tx=0x7fb9c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:21.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.609+0000 7fb9c67fc700 1 -- 172.21.15.153:0/2271977667 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c800ee90 con 0x7fb9d00b1800 2024-08-17T02:26:21.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.609+0000 7fb9c67fc700 1 -- 172.21.15.153:0/2271977667 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c800c850 con 0x7fb9d00b1800 2024-08-17T02:26:21.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.609+0000 7fb9d73bd700 1 -- 172.21.15.153:0/2271977667 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9d00a55f0 con 0x7fb9d00b1800 2024-08-17T02:26:21.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.609+0000 7fb9c67fc700 1 -- 172.21.15.153:0/2271977667 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c800cc10 con 0x7fb9d00b1800 2024-08-17T02:26:21.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.609+0000 7fb9d73bd700 1 -- 172.21.15.153:0/2271977667 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9d0140390 con 0x7fb9d00b1800 2024-08-17T02:26:21.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.609+0000 7fb9d73bd700 1 -- 172.21.15.153:0/2271977667 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9d00a5450 con 0x7fb9d00b1800 2024-08-17T02:26:21.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.609+0000 7fb9c67fc700 1 -- 172.21.15.153:0/2271977667 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb9c8013470 con 0x7fb9d00b1800 2024-08-17T02:26:21.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.609+0000 7fb9c67fc700 1 --2- 172.21.15.153:0/2271977667 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb9b4060860 0x7fb9b4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.609+0000 7fb9c67fc700 1 -- 172.21.15.153:0/2271977667 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb9c807ce70 con 0x7fb9d00b1800 2024-08-17T02:26:21.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.609+0000 7fb9d63bb700 1 --2- 172.21.15.153:0/2271977667 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb9b4060860 0x7fb9b4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.613+0000 7fb9d63bb700 1 --2- 172.21.15.153:0/2271977667 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb9b4060860 0x7fb9b4062d10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0097c0 tx=0x7fb9cc019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:21.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.617+0000 7fb9c67fc700 1 -- 172.21.15.153:0/2271977667 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb9d00a5450 con 0x7fb9d00b1800 2024-08-17T02:26:21.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.817+0000 7fb9d73bd700 1 -- 172.21.15.153:0/2271977667 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb9d00a5450 con 0x7fb9d00b1800 2024-08-17T02:26:21.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.817+0000 7fb9c67fc700 1 -- 172.21.15.153:0/2271977667 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4597 (secure 0 0 0) 0x7fb9d00a5450 con 0x7fb9d00b1800 2024-08-17T02:26:21.820 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:21.820 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/610991976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":610991976},{"type":"v1","addr":"172.21.15.153:6835","nonce":610991976}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/3521472122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3521472122},{"type":"v1","addr":"172.21.15.153:6837","nonce":3521472122}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1184225885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1184225885},{"type":"v1","addr":"172.21.15.174:6833","nonce":1184225885}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:12.082812+0000","modified":"2024-08-17T02:26:14.770527+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/477398839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":477398839},{"type":"v1","addr":"172.21.15.174:6835","nonce":477398839}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:26:21.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.821+0000 7fb9d73bd700 1 -- 172.21.15.153:0/2271977667 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb9b4060860 msgr2=0x7fb9b4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.821+0000 7fb9d73bd700 1 --2- 172.21.15.153:0/2271977667 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb9b4060860 0x7fb9b4062d10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0097c0 tx=0x7fb9cc019000 comp rx=0 tx=0).stop 2024-08-17T02:26:21.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.821+0000 7fb9d73bd700 1 -- 172.21.15.153:0/2271977667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9d00b1800 msgr2=0x7fb9d0146250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.821+0000 7fb9d73bd700 1 --2- 172.21.15.153:0/2271977667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9d00b1800 0x7fb9d0146250 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb9c800ea50 tx=0x7fb9c80091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.821+0000 7fb9d73bd700 1 -- 172.21.15.153:0/2271977667 shutdown_connections 2024-08-17T02:26:21.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.821+0000 7fb9d73bd700 1 --2- 172.21.15.153:0/2271977667 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb9b4060860 0x7fb9b4062d10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.821+0000 7fb9d73bd700 1 --2- 172.21.15.153:0/2271977667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9d00b1800 0x7fb9d0146250 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.821+0000 7fb9d73bd700 1 --2- 172.21.15.153:0/2271977667 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9d00b0d20 0x7fb9d013fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.821+0000 7fb9d73bd700 1 --2- 172.21.15.153:0/2271977667 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9d006e450 0x7fb9d00a60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.821+0000 7fb9d73bd700 1 -- 172.21.15.153:0/2271977667 >> 172.21.15.153:0/2271977667 conn(0x7fb9d00678d0 msgr2=0x7fb9d015eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:21.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.821+0000 7fb9d73bd700 1 -- 172.21.15.153:0/2271977667 shutdown_connections 2024-08-17T02:26:21.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.821+0000 7fb9d73bd700 1 -- 172.21.15.153:0/2271977667 wait complete. 2024-08-17T02:26:21.824 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 6 2024-08-17T02:26:21.835 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:21.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.933+0000 7feb7d75f700 1 Processor -- start 2024-08-17T02:26:21.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.933+0000 7feb7d75f700 1 -- start start 2024-08-17T02:26:21.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.933+0000 7feb7d75f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb78159040 0x7feb780cf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.933+0000 7feb7d75f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7feb780d0010 0x7feb780d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.933+0000 7feb7d75f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7feb7815cea0 0x7feb7815d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.933+0000 7feb7d75f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb780cf190 con 0x7feb7815cea0 2024-08-17T02:26:21.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.933+0000 7feb7d75f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb780d09a0 con 0x7feb780d0010 2024-08-17T02:26:21.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.933+0000 7feb7d75f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb780ce5e0 con 0x7feb78159040 2024-08-17T02:26:21.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.933+0000 7feb7cf5e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7feb7815cea0 0x7feb7815d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.933+0000 7feb7cf5e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7feb7815cea0 0x7feb7815d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57816/0 (socket says 172.21.15.153:57816) 2024-08-17T02:26:21.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.933+0000 7feb7cf5e700 1 -- 172.21.15.153:0/216849571 learned_addr learned my addr 172.21.15.153:0/216849571 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:21.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.933+0000 7feb777fe700 1 --2- 172.21.15.153:0/216849571 >> v2:172.21.15.174:3300/0 conn(0x7feb780d0010 0x7feb780d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.933+0000 7feb77fff700 1 --2- 172.21.15.153:0/216849571 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb78159040 0x7feb780cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.937+0000 7feb7cf5e700 1 -- 172.21.15.153:0/216849571 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb78159040 msgr2=0x7feb780cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:21.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.937+0000 7feb7cf5e700 1 --2- 172.21.15.153:0/216849571 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb78159040 0x7feb780cf620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.937+0000 7feb7cf5e700 1 -- 172.21.15.153:0/216849571 >> v2:172.21.15.174:3300/0 conn(0x7feb780d0010 msgr2=0x7feb780d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:21.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.937+0000 7feb7cf5e700 1 --2- 172.21.15.153:0/216849571 >> v2:172.21.15.174:3300/0 conn(0x7feb780d0010 0x7feb780d0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.937+0000 7feb7cf5e700 1 -- 172.21.15.153:0/216849571 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb780ce860 con 0x7feb7815cea0 2024-08-17T02:26:21.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.937+0000 7feb777fe700 1 --2- 172.21.15.153:0/216849571 >> v2:172.21.15.174:3300/0 conn(0x7feb780d0010 0x7feb780d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:21.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.937+0000 7feb7cf5e700 1 --2- 172.21.15.153:0/216849571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb7815cea0 0x7feb7815d320 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7feb78067f20 tx=0x7feb70009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e21844c7c6b861 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:21.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.937+0000 7feb76ffd700 1 -- 172.21.15.153:0/216849571 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7000e070 con 0x7feb7815cea0 2024-08-17T02:26:21.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.937+0000 7feb76ffd700 1 -- 172.21.15.153:0/216849571 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7000ba50 con 0x7feb7815cea0 2024-08-17T02:26:21.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.937+0000 7feb76ffd700 1 -- 172.21.15.153:0/216849571 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb700092e0 con 0x7feb7815cea0 2024-08-17T02:26:21.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.937+0000 7feb7d75f700 1 -- 172.21.15.153:0/216849571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb7815cea0 msgr2=0x7feb7815d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.937+0000 7feb7d75f700 1 --2- 172.21.15.153:0/216849571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb7815cea0 0x7feb7815d320 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7feb78067f20 tx=0x7feb70009840 comp rx=0 tx=0).stop 2024-08-17T02:26:21.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.937+0000 7feb7d75f700 1 -- 172.21.15.153:0/216849571 shutdown_connections 2024-08-17T02:26:21.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.937+0000 7feb7d75f700 1 --2- 172.21.15.153:0/216849571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb7815cea0 0x7feb7815d320 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.937+0000 7feb7d75f700 1 --2- 172.21.15.153:0/216849571 >> v2:172.21.15.174:3300/0 conn(0x7feb780d0010 0x7feb780d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.937+0000 7feb7d75f700 1 --2- 172.21.15.153:0/216849571 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb78159040 0x7feb780cf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.937+0000 7feb7d75f700 1 -- 172.21.15.153:0/216849571 >> 172.21.15.153:0/216849571 conn(0x7feb78068250 msgr2=0x7feb78068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:21.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.937+0000 7feb7d75f700 1 -- 172.21.15.153:0/216849571 shutdown_connections 2024-08-17T02:26:21.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.937+0000 7feb7d75f700 1 -- 172.21.15.153:0/216849571 wait complete. 2024-08-17T02:26:21.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.941+0000 7feb7d75f700 1 Processor -- start 2024-08-17T02:26:21.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.941+0000 7feb7d75f700 1 -- start start 2024-08-17T02:26:21.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.941+0000 7feb7d75f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb780d0010 0x7feb7815e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.941+0000 7feb7d75f700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb78159040 0x7feb7815bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.941+0000 7feb7d75f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb7815cea0 0x7feb78151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.941+0000 7feb77fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb780d0010 0x7feb7815e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.941+0000 7feb7d75f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7815e2e0 con 0x7feb780d0010 2024-08-17T02:26:21.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.941+0000 7feb7d75f700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7815f9c0 con 0x7feb78159040 2024-08-17T02:26:21.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.941+0000 7feb7d75f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb7815fca0 con 0x7feb7815cea0 2024-08-17T02:26:21.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.941+0000 7feb77fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb780d0010 0x7feb7815e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57822/0 (socket says 172.21.15.153:57822) 2024-08-17T02:26:21.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.941+0000 7feb77fff700 1 -- 172.21.15.153:0/2449077424 learned_addr learned my addr 172.21.15.153:0/2449077424 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:21.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.941+0000 7feb7cf5e700 1 --2- 172.21.15.153:0/2449077424 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb7815cea0 0x7feb78151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.941+0000 7feb777fe700 1 --2- 172.21.15.153:0/2449077424 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb78159040 0x7feb7815bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.945+0000 7feb77fff700 1 -- 172.21.15.153:0/2449077424 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb7815cea0 msgr2=0x7feb78151aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.945+0000 7feb77fff700 1 --2- 172.21.15.153:0/2449077424 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb7815cea0 0x7feb78151aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.945+0000 7feb77fff700 1 -- 172.21.15.153:0/2449077424 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb78159040 msgr2=0x7feb7815bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.945+0000 7feb77fff700 1 --2- 172.21.15.153:0/2449077424 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb78159040 0x7feb7815bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.945+0000 7feb77fff700 1 -- 172.21.15.153:0/2449077424 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb70009ae0 con 0x7feb780d0010 2024-08-17T02:26:21.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.945+0000 7feb777fe700 1 --2- 172.21.15.153:0/2449077424 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb78159040 0x7feb7815bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:21.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.945+0000 7feb77fff700 1 --2- 172.21.15.153:0/2449077424 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb780d0010 0x7feb7815e770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7feb6800d890 tx=0x7feb68008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:21.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.945+0000 7feb6ffff700 1 -- 172.21.15.153:0/2449077424 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb680125f0 con 0x7feb780d0010 2024-08-17T02:26:21.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.945+0000 7feb6ffff700 1 -- 172.21.15.153:0/2449077424 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb68012750 con 0x7feb780d0010 2024-08-17T02:26:21.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.945+0000 7feb7d75f700 1 -- 172.21.15.153:0/2449077424 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb7815dc90 con 0x7feb780d0010 2024-08-17T02:26:21.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.945+0000 7feb6ffff700 1 -- 172.21.15.153:0/2449077424 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb68012ad0 con 0x7feb780d0010 2024-08-17T02:26:21.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.945+0000 7feb7d75f700 1 -- 172.21.15.153:0/2449077424 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb7815c2f0 con 0x7feb780d0010 2024-08-17T02:26:21.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.945+0000 7feb7d75f700 1 -- 172.21.15.153:0/2449077424 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb7815c510 con 0x7feb780d0010 2024-08-17T02:26:21.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.945+0000 7feb6ffff700 1 -- 172.21.15.153:0/2449077424 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7feb6801e460 con 0x7feb780d0010 2024-08-17T02:26:21.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.945+0000 7feb6ffff700 1 --2- 172.21.15.153:0/2449077424 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7feb58060860 0x7feb58062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.945+0000 7feb777fe700 1 --2- 172.21.15.153:0/2449077424 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7feb58060860 0x7feb58062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.945+0000 7feb6ffff700 1 -- 172.21.15.153:0/2449077424 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feb6807d1f0 con 0x7feb780d0010 2024-08-17T02:26:21.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.949+0000 7feb777fe700 1 --2- 172.21.15.153:0/2449077424 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7feb58060860 0x7feb58062d10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7feb60006f00 tx=0x7feb60008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:21.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:21.953+0000 7feb6ffff700 1 -- 172.21.15.153:0/2449077424 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7feb680510d0 con 0x7feb780d0010 2024-08-17T02:26:22.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.117+0000 7feb7d75f700 1 -- 172.21.15.153:0/2449077424 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb7815e110 con 0x7feb780d0010 2024-08-17T02:26:22.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.121+0000 7feb6ffff700 1 -- 172.21.15.153:0/2449077424 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7feb68050c60 con 0x7feb780d0010 2024-08-17T02:26:22.123 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:22.123 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":21,"fsid":"56d41c33-b929-456d-96be-2aac4ecd299d","created":"2024-08-17T02:25:47.756085+0000","modified":"2024-08-17T02:26:13.759246+0000","last_up_change":"2024-08-17T02:25:58.643690+0000","last_in_change":"2024-08-17T02:25:49.809186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:58.093273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:09.856520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:11.080706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0736f8e6-818e-42e6-a0dc-8aaf813315d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":24234},{"type":"v1","addr":"172.21.15.153:6817","nonce":24234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":24234},{"type":"v1","addr":"172.21.15.153:6819","nonce":24234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":24234},{"type":"v1","addr":"172.21.15.153:6823","nonce":24234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":24234},{"type":"v1","addr":"172.21.15.153:6821","nonce":24234}]},"public_addr":"172.21.15.153:6817/24234","cluster_addr":"172.21.15.153:6819/24234","heartbeat_back_addr":"172.21.15.153:6823/24234","heartbeat_front_addr":"172.21.15.153:6821/24234","state":["exists","up"]},{"osd":1,"uuid":"011762e9-6c2d-441a-aa56-68474639d72f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":24232},{"type":"v1","addr":"172.21.15.153:6801","nonce":24232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":24232},{"type":"v1","addr":"172.21.15.153:6803","nonce":24232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":24232},{"type":"v1","addr":"172.21.15.153:6809","nonce":24232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":24232},{"type":"v1","addr":"172.21.15.153:6806","nonce":24232}]},"public_addr":"172.21.15.153:6801/24232","cluster_addr":"172.21.15.153:6803/24232","heartbeat_back_addr":"172.21.15.153:6809/24232","heartbeat_front_addr":"172.21.15.153:6806/24232","state":["exists","up"]},{"osd":2,"uuid":"b562cd97-aa12-455e-b46a-e720a2ec9d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":24235},{"type":"v1","addr":"172.21.15.153:6808","nonce":24235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":24235},{"type":"v1","addr":"172.21.15.153:6811","nonce":24235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":24235},{"type":"v1","addr":"172.21.15.153:6815","nonce":24235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":24235},{"type":"v1","addr":"172.21.15.153:6813","nonce":24235}]},"public_addr":"172.21.15.153:6808/24235","cluster_addr":"172.21.15.153:6811/24235","heartbeat_back_addr":"172.21.15.153:6815/24235","heartbeat_front_addr":"172.21.15.153:6813/24235","state":["exists","up"]},{"osd":3,"uuid":"222da52f-90c2-4132-a5d2-6f6cf83d4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":24236},{"type":"v1","addr":"172.21.15.153:6825","nonce":24236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":24236},{"type":"v1","addr":"172.21.15.153:6827","nonce":24236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":24236},{"type":"v1","addr":"172.21.15.153:6831","nonce":24236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":24236},{"type":"v1","addr":"172.21.15.153:6829","nonce":24236}]},"public_addr":"172.21.15.153:6825/24236","cluster_addr":"172.21.15.153:6827/24236","heartbeat_back_addr":"172.21.15.153:6831/24236","heartbeat_front_addr":"172.21.15.153:6829/24236","state":["exists","up"]},{"osd":4,"uuid":"a38a04cd-032b-4977-a260-1ef3567d0c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24456},{"type":"v1","addr":"172.21.15.174:6809","nonce":24456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24456},{"type":"v1","addr":"172.21.15.174:6811","nonce":24456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24456},{"type":"v1","addr":"172.21.15.174:6815","nonce":24456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24456},{"type":"v1","addr":"172.21.15.174:6813","nonce":24456}]},"public_addr":"172.21.15.174:6809/24456","cluster_addr":"172.21.15.174:6811/24456","heartbeat_back_addr":"172.21.15.174:6815/24456","heartbeat_front_addr":"172.21.15.174:6813/24456","state":["exists","up"]},{"osd":5,"uuid":"c7778084-e751-48da-87a1-ab8bbe85aa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24457},{"type":"v1","addr":"172.21.15.174:6825","nonce":24457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24457},{"type":"v1","addr":"172.21.15.174:6827","nonce":24457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24457},{"type":"v1","addr":"172.21.15.174:6831","nonce":24457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24457},{"type":"v1","addr":"172.21.15.174:6829","nonce":24457}]},"public_addr":"172.21.15.174:6825/24457","cluster_addr":"172.21.15.174:6827/24457","heartbeat_back_addr":"172.21.15.174:6831/24457","heartbeat_front_addr":"172.21.15.174:6829/24457","state":["exists","up"]},{"osd":6,"uuid":"2d8e0715-254f-442c-9625-50721d0bc858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24477},{"type":"v1","addr":"172.21.15.174:6801","nonce":24477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24477},{"type":"v1","addr":"172.21.15.174:6803","nonce":24477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24477},{"type":"v1","addr":"172.21.15.174:6807","nonce":24477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24477},{"type":"v1","addr":"172.21.15.174:6805","nonce":24477}]},"public_addr":"172.21.15.174:6801/24477","cluster_addr":"172.21.15.174:6803/24477","heartbeat_back_addr":"172.21.15.174:6807/24477","heartbeat_front_addr":"172.21.15.174:6805/24477","state":["exists","up"]},{"osd":7,"uuid":"dffda25a-4601-4ddb-9a27-b0be1cadde27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24455},{"type":"v1","addr":"172.21.15.174:6817","nonce":24455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24455},{"type":"v1","addr":"172.21.15.174:6819","nonce":24455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24455},{"type":"v1","addr":"172.21.15.174:6823","nonce":24455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24455},{"type":"v1","addr":"172.21.15.174:6821","nonce":24455}]},"public_addr":"172.21.15.174:6817/24455","cluster_addr":"172.21.15.174:6819/24455","heartbeat_back_addr":"172.21.15.174:6823/24455","heartbeat_front_addr":"172.21.15.174:6821/24455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.990117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.033862+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.748087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.112877+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.070448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.360961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.110940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.226377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:22.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.121+0000 7feb7d75f700 1 -- 172.21.15.153:0/2449077424 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7feb58060860 msgr2=0x7feb58062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.121+0000 7feb7d75f700 1 --2- 172.21.15.153:0/2449077424 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7feb58060860 0x7feb58062d10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7feb60006f00 tx=0x7feb60008040 comp rx=0 tx=0).stop 2024-08-17T02:26:22.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.121+0000 7feb7d75f700 1 -- 172.21.15.153:0/2449077424 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb780d0010 msgr2=0x7feb7815e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.121+0000 7feb7d75f700 1 --2- 172.21.15.153:0/2449077424 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb780d0010 0x7feb7815e770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7feb6800d890 tx=0x7feb68008040 comp rx=0 tx=0).stop 2024-08-17T02:26:22.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.121+0000 7feb7d75f700 1 -- 172.21.15.153:0/2449077424 shutdown_connections 2024-08-17T02:26:22.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.121+0000 7feb7d75f700 1 --2- 172.21.15.153:0/2449077424 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7feb58060860 0x7feb58062d10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.121+0000 7feb7d75f700 1 --2- 172.21.15.153:0/2449077424 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb7815cea0 0x7feb78151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.121+0000 7feb7d75f700 1 --2- 172.21.15.153:0/2449077424 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb78159040 0x7feb7815bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.121+0000 7feb7d75f700 1 --2- 172.21.15.153:0/2449077424 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb780d0010 0x7feb7815e770 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.121+0000 7feb7d75f700 1 -- 172.21.15.153:0/2449077424 >> 172.21.15.153:0/2449077424 conn(0x7feb78068250 msgr2=0x7feb781579b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:22.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.121+0000 7feb7d75f700 1 -- 172.21.15.153:0/2449077424 shutdown_connections 2024-08-17T02:26:22.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.121+0000 7feb7d75f700 1 -- 172.21.15.153:0/2449077424 wait complete. 2024-08-17T02:26:22.138 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:58.093273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:26:09.856520+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:26:11.080706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:26:22.138 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:22.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.245+0000 7f9b0fd6a700 1 Processor -- start 2024-08-17T02:26:22.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.245+0000 7f9b0fd6a700 1 -- start start 2024-08-17T02:26:22.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.245+0000 7f9b0fd6a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b08153ba0 0x7f9b080ca480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.245+0000 7f9b0fd6a700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9b08159b90 0x7f9b080c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.245+0000 7f9b0fd6a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b08157580 con 0x7f9b080c9090 2024-08-17T02:26:22.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.245+0000 7f9b0fd6a700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b080c9510 con 0x7f9b08159b90 2024-08-17T02:26:22.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.245+0000 7f9b0fd6a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b08153f70 con 0x7f9b08153ba0 2024-08-17T02:26:22.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.245+0000 7f9b0d305700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9b08159b90 0x7f9b080c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.245+0000 7f9b0d305700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9b08159b90 0x7f9b080c8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51390/0 (socket says 172.21.15.153:51390) 2024-08-17T02:26:22.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.245+0000 7f9b0d305700 1 -- 172.21.15.153:0/3524057083 learned_addr learned my addr 172.21.15.153:0/3524057083 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:22.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.249+0000 7f9b0db06700 1 --2- 172.21.15.153:0/3524057083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b08153ba0 0x7f9b080ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.249+0000 7f9b0d305700 1 -- 172.21.15.153:0/3524057083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b08153ba0 msgr2=0x7f9b080ca480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:22.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.249+0000 7f9b0d305700 1 --2- 172.21.15.153:0/3524057083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b08153ba0 0x7f9b080ca480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.249+0000 7f9b0d305700 1 -- 172.21.15.153:0/3524057083 >> v1:172.21.15.174:6789/0 conn(0x7f9b080c9090 legacy=0x7f9b080c74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.249+0000 7f9b0d305700 1 -- 172.21.15.153:0/3524057083 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b0806ae70 con 0x7f9b08159b90 2024-08-17T02:26:22.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.249+0000 7f9b0d305700 1 --2- 172.21.15.153:0/3524057083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b08159b90 0x7f9b080c8b50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9b040099b0 tx=0x7f9b04009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcbb6414726540cd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:22.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.249+0000 7f9b0cb04700 1 -- 172.21.15.153:0/3524057083 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b04009ea0 con 0x7f9b08159b90 2024-08-17T02:26:22.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.249+0000 7f9b0cb04700 1 -- 172.21.15.153:0/3524057083 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0400b860 con 0x7f9b08159b90 2024-08-17T02:26:22.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.249+0000 7f9b0cb04700 1 -- 172.21.15.153:0/3524057083 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0400bc00 con 0x7f9b08159b90 2024-08-17T02:26:22.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.249+0000 7f9b0fd6a700 1 -- 172.21.15.153:0/3524057083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b08159b90 msgr2=0x7f9b080c8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.249+0000 7f9b0fd6a700 1 --2- 172.21.15.153:0/3524057083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b08159b90 0x7f9b080c8b50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9b040099b0 tx=0x7f9b04009250 comp rx=0 tx=0).stop 2024-08-17T02:26:22.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.249+0000 7f9b0fd6a700 1 -- 172.21.15.153:0/3524057083 shutdown_connections 2024-08-17T02:26:22.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.249+0000 7f9b0fd6a700 1 --2- 172.21.15.153:0/3524057083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b08159b90 0x7f9b080c8b50 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.249+0000 7f9b0fd6a700 1 --2- 172.21.15.153:0/3524057083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b08153ba0 0x7f9b080ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.249+0000 7f9b0fd6a700 1 -- 172.21.15.153:0/3524057083 >> 172.21.15.153:0/3524057083 conn(0x7f9b080cd9c0 msgr2=0x7f9b080c99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:22.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.249+0000 7f9b0fd6a700 1 -- 172.21.15.153:0/3524057083 shutdown_connections 2024-08-17T02:26:22.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.249+0000 7f9b0fd6a700 1 -- 172.21.15.153:0/3524057083 wait complete. 2024-08-17T02:26:22.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.249+0000 7f9b0fd6a700 1 Processor -- start 2024-08-17T02:26:22.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.249+0000 7f9b0fd6a700 1 -- start start 2024-08-17T02:26:22.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.253+0000 7f9b0fd6a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b080c9090 0x7f9b080b0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.253+0000 7f9b0fd6a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b08153ba0 0x7f9b08142860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.253+0000 7f9b0fd6a700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b08159b90 0x7f9b080c3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.253+0000 7f9b0fd6a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b08157a90 con 0x7f9b080c9090 2024-08-17T02:26:22.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.253+0000 7f9b0fd6a700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0814ffc0 con 0x7f9b08159b90 2024-08-17T02:26:22.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.253+0000 7f9b0fd6a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b080c4a90 con 0x7f9b08153ba0 2024-08-17T02:26:22.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.253+0000 7f9b0db06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b080c9090 0x7f9b080b0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.253+0000 7f9b0db06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b080c9090 0x7f9b080b0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51396/0 (socket says 172.21.15.153:51396) 2024-08-17T02:26:22.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.253+0000 7f9b0db06700 1 -- 172.21.15.153:0/788315451 learned_addr learned my addr 172.21.15.153:0/788315451 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:22.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.253+0000 7f9b0d305700 1 --2- 172.21.15.153:0/788315451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b08153ba0 0x7f9b08142860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.253+0000 7f9b0e307700 1 --2- 172.21.15.153:0/788315451 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b08159b90 0x7f9b080c3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.253+0000 7f9b0db06700 1 -- 172.21.15.153:0/788315451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b08153ba0 msgr2=0x7f9b08142860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.253+0000 7f9b0db06700 1 --2- 172.21.15.153:0/788315451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b08153ba0 0x7f9b08142860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.253+0000 7f9b0db06700 1 -- 172.21.15.153:0/788315451 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b08159b90 msgr2=0x7f9b080c3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.253+0000 7f9b0db06700 1 --2- 172.21.15.153:0/788315451 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b08159b90 0x7f9b080c3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.253+0000 7f9b0db06700 1 -- 172.21.15.153:0/788315451 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b040094f0 con 0x7f9b080c9090 2024-08-17T02:26:22.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.253+0000 7f9b0db06700 1 --2- 172.21.15.153:0/788315451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b080c9090 0x7f9b080b0470 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9af800e930 tx=0x7f9af80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:22.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.253+0000 7f9afdffb700 1 -- 172.21.15.153:0/788315451 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af8013680 con 0x7f9b080c9090 2024-08-17T02:26:22.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.253+0000 7f9afdffb700 1 -- 172.21.15.153:0/788315451 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af80137e0 con 0x7f9b080c9090 2024-08-17T02:26:22.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.253+0000 7f9b0fd6a700 1 -- 172.21.15.153:0/788315451 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b080c4d70 con 0x7f9b080c9090 2024-08-17T02:26:22.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.253+0000 7f9afdffb700 1 -- 172.21.15.153:0/788315451 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af8013b80 con 0x7f9b080c9090 2024-08-17T02:26:22.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.253+0000 7f9b0fd6a700 1 -- 172.21.15.153:0/788315451 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b08157ce0 con 0x7f9b080c9090 2024-08-17T02:26:22.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.257+0000 7f9b0fd6a700 1 -- 172.21.15.153:0/788315451 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b080c7d40 con 0x7f9b080c9090 2024-08-17T02:26:22.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.257+0000 7f9afdffb700 1 -- 172.21.15.153:0/788315451 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9af800c3e0 con 0x7f9b080c9090 2024-08-17T02:26:22.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.257+0000 7f9afdffb700 1 --2- 172.21.15.153:0/788315451 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9aec060860 0x7f9aec062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.257+0000 7f9afdffb700 1 -- 172.21.15.153:0/788315451 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9af807cc60 con 0x7f9b080c9090 2024-08-17T02:26:22.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.257+0000 7f9b0d305700 1 --2- 172.21.15.153:0/788315451 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9aec060860 0x7f9aec062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.257+0000 7f9b0d305700 1 --2- 172.21.15.153:0/788315451 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9aec060860 0x7f9aec062d10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9b040099b0 tx=0x7f9b04017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:22.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.265+0000 7f9afdffb700 1 -- 172.21.15.153:0/788315451 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f9af804d0b0 con 0x7f9b080c9090 2024-08-17T02:26:22.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.425+0000 7f9b0fd6a700 1 -- 172.21.15.153:0/788315451 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9b080cc790 con 0x7f9b080c9090 2024-08-17T02:26:22.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.425+0000 7f9afdffb700 1 -- 172.21.15.153:0/788315451 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9af80506d0 con 0x7f9b080c9090 2024-08-17T02:26:22.428 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2024-08-17T02:26:22.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.425+0000 7f9b0fd6a700 1 -- 172.21.15.153:0/788315451 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9aec060860 msgr2=0x7f9aec062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.425+0000 7f9b0fd6a700 1 --2- 172.21.15.153:0/788315451 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9aec060860 0x7f9aec062d10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9b040099b0 tx=0x7f9b04017000 comp rx=0 tx=0).stop 2024-08-17T02:26:22.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.425+0000 7f9b0fd6a700 1 -- 172.21.15.153:0/788315451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b080c9090 msgr2=0x7f9b080b0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.425+0000 7f9b0fd6a700 1 --2- 172.21.15.153:0/788315451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b080c9090 0x7f9b080b0470 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9af800e930 tx=0x7f9af80091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.429+0000 7f9b0fd6a700 1 -- 172.21.15.153:0/788315451 shutdown_connections 2024-08-17T02:26:22.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.429+0000 7f9b0fd6a700 1 --2- 172.21.15.153:0/788315451 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9aec060860 0x7f9aec062d10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.429+0000 7f9b0fd6a700 1 --2- 172.21.15.153:0/788315451 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b08159b90 0x7f9b080c3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.429+0000 7f9b0fd6a700 1 --2- 172.21.15.153:0/788315451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b08153ba0 0x7f9b08142860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.429+0000 7f9b0fd6a700 1 --2- 172.21.15.153:0/788315451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b080c9090 0x7f9b080b0470 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.429+0000 7f9b0fd6a700 1 -- 172.21.15.153:0/788315451 >> 172.21.15.153:0/788315451 conn(0x7f9b080cd9c0 msgr2=0x7f9b080cb6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:22.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.429+0000 7f9b0fd6a700 1 -- 172.21.15.153:0/788315451 shutdown_connections 2024-08-17T02:26:22.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.429+0000 7f9b0fd6a700 1 -- 172.21.15.153:0/788315451 wait complete. 2024-08-17T02:26:22.442 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:26:22.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.549+0000 7f439bd85700 1 Processor -- start 2024-08-17T02:26:22.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.549+0000 7f439bd85700 1 -- start start 2024-08-17T02:26:22.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.549+0000 7f439bd85700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4394067510 0x7f4394164330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.549+0000 7f439bd85700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43940cba90 con 0x7f4394159300 2024-08-17T02:26:22.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.549+0000 7f439bd85700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43940cb160 con 0x7f43941596d0 2024-08-17T02:26:22.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.549+0000 7f439bd85700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43940b2b60 con 0x7f4394067510 2024-08-17T02:26:22.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.553+0000 7f439a322700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4394067510 0x7f4394164330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.553+0000 7f4399b21700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f4394159300 0x7f43940b2230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:54626/0 (socket says 172.21.15.153:54626) 2024-08-17T02:26:22.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.553+0000 7f4399b21700 1 -- 172.21.15.153:0/3718602131 learned_addr learned my addr 172.21.15.153:0/3718602131 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:22.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.553+0000 7f439a322700 1 -- 172.21.15.153:0/3718602131 >> v1:172.21.15.174:6789/0 conn(0x7f43941596d0 legacy=0x7f4394066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.553+0000 7f439a322700 1 -- 172.21.15.153:0/3718602131 >> v1:172.21.15.153:6789/0 conn(0x7f4394159300 legacy=0x7f43940b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.553+0000 7f439a322700 1 -- 172.21.15.153:0/3718602131 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43940cb440 con 0x7f4394067510 2024-08-17T02:26:22.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.553+0000 7f439a322700 1 --2- 172.21.15.153:0/3718602131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4394067510 0x7f4394164330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f438c009e60 tx=0x7f438c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66997e3b33f85f8a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:22.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.553+0000 7f4398b1f700 1 -- 172.21.15.153:0/3718602131 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438c00e070 con 0x7f4394067510 2024-08-17T02:26:22.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.553+0000 7f4398b1f700 1 -- 172.21.15.153:0/3718602131 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f438c00bc30 con 0x7f4394067510 2024-08-17T02:26:22.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.553+0000 7f4398b1f700 1 -- 172.21.15.153:0/3718602131 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438c012430 con 0x7f4394067510 2024-08-17T02:26:22.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.553+0000 7f439bd85700 1 -- 172.21.15.153:0/3718602131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4394067510 msgr2=0x7f4394164330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.553+0000 7f439bd85700 1 --2- 172.21.15.153:0/3718602131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4394067510 0x7f4394164330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f438c009e60 tx=0x7f438c009780 comp rx=0 tx=0).stop 2024-08-17T02:26:22.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.553+0000 7f439bd85700 1 -- 172.21.15.153:0/3718602131 shutdown_connections 2024-08-17T02:26:22.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.553+0000 7f439bd85700 1 --2- 172.21.15.153:0/3718602131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4394067510 0x7f4394164330 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.553+0000 7f439bd85700 1 -- 172.21.15.153:0/3718602131 >> 172.21.15.153:0/3718602131 conn(0x7f43940682c0 msgr2=0x7f43940686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:22.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.553+0000 7f439bd85700 1 -- 172.21.15.153:0/3718602131 shutdown_connections 2024-08-17T02:26:22.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.553+0000 7f439bd85700 1 -- 172.21.15.153:0/3718602131 wait complete. 2024-08-17T02:26:22.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.553+0000 7f439bd85700 1 Processor -- start 2024-08-17T02:26:22.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.553+0000 7f439bd85700 1 -- start start 2024-08-17T02:26:22.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.557+0000 7f439bd85700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4394067510 0x7f43940c7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.557+0000 7f439bd85700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4394159300 0x7f4394150a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.557+0000 7f439bd85700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43941596d0 0x7f43940ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.557+0000 7f439bd85700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43940ca140 con 0x7f4394067510 2024-08-17T02:26:22.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.557+0000 7f439bd85700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43940c77a0 con 0x7f4394159300 2024-08-17T02:26:22.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.557+0000 7f439bd85700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43940c85e0 con 0x7f43941596d0 2024-08-17T02:26:22.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.557+0000 7f4399b21700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4394067510 0x7f43940c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.557+0000 7f4399b21700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4394067510 0x7f43940c7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51408/0 (socket says 172.21.15.153:51408) 2024-08-17T02:26:22.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.557+0000 7f4399b21700 1 -- 172.21.15.153:0/43282329 learned_addr learned my addr 172.21.15.153:0/43282329 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:22.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.557+0000 7f4399320700 1 --2- 172.21.15.153:0/43282329 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4394159300 0x7f4394150a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.557+0000 7f439a322700 1 --2- 172.21.15.153:0/43282329 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43941596d0 0x7f43940ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.557+0000 7f4399b21700 1 -- 172.21.15.153:0/43282329 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43941596d0 msgr2=0x7f43940ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.557+0000 7f4399b21700 1 --2- 172.21.15.153:0/43282329 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43941596d0 0x7f43940ce5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.557+0000 7f4399b21700 1 -- 172.21.15.153:0/43282329 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4394159300 msgr2=0x7f4394150a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.557+0000 7f4399b21700 1 --2- 172.21.15.153:0/43282329 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4394159300 0x7f4394150a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.557+0000 7f4399b21700 1 -- 172.21.15.153:0/43282329 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f438c009a20 con 0x7f4394067510 2024-08-17T02:26:22.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.557+0000 7f439a322700 1 --2- 172.21.15.153:0/43282329 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43941596d0 0x7f43940ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:22.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.557+0000 7f4399b21700 1 --2- 172.21.15.153:0/43282329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4394067510 0x7f43940c7260 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f438400c7f0 tx=0x7f4384007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:22.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.557+0000 7f4389ffb700 1 -- 172.21.15.153:0/43282329 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4384005b30 con 0x7f4394067510 2024-08-17T02:26:22.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.557+0000 7f4389ffb700 1 -- 172.21.15.153:0/43282329 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4384005c90 con 0x7f4394067510 2024-08-17T02:26:22.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.557+0000 7f439bd85700 1 -- 172.21.15.153:0/43282329 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43940c79d0 con 0x7f4394067510 2024-08-17T02:26:22.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.557+0000 7f4389ffb700 1 -- 172.21.15.153:0/43282329 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4384007320 con 0x7f4394067510 2024-08-17T02:26:22.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.557+0000 7f439bd85700 1 -- 172.21.15.153:0/43282329 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43940c7f90 con 0x7f4394067510 2024-08-17T02:26:22.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.557+0000 7f439bd85700 1 -- 172.21.15.153:0/43282329 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f439415af70 con 0x7f4394067510 2024-08-17T02:26:22.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.557+0000 7f4389ffb700 1 -- 172.21.15.153:0/43282329 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4384007690 con 0x7f4394067510 2024-08-17T02:26:22.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.561+0000 7f4389ffb700 1 --2- 172.21.15.153:0/43282329 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4378060860 0x7f4378062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.561+0000 7f4389ffb700 1 -- 172.21.15.153:0/43282329 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f438407c100 con 0x7f4394067510 2024-08-17T02:26:22.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.561+0000 7f4399320700 1 --2- 172.21.15.153:0/43282329 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4378060860 0x7f4378062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.561+0000 7f4399320700 1 --2- 172.21.15.153:0/43282329 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4378060860 0x7f4378062d10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4394154880 tx=0x7f4390009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:22.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.565+0000 7f4389ffb700 1 -- 172.21.15.153:0/43282329 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f439415af70 con 0x7f4394067510 2024-08-17T02:26:22.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.729+0000 7f439bd85700 1 -- 172.21.15.153:0/43282329 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f439415af70 con 0x7f4394067510 2024-08-17T02:26:22.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.733+0000 7f4389ffb700 1 -- 172.21.15.153:0/43282329 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f439415af70 con 0x7f4394067510 2024-08-17T02:26:22.735 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2024-08-17T02:26:22.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.733+0000 7f439bd85700 1 -- 172.21.15.153:0/43282329 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4378060860 msgr2=0x7f4378062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.733+0000 7f439bd85700 1 --2- 172.21.15.153:0/43282329 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4378060860 0x7f4378062d10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4394154880 tx=0x7f4390009040 comp rx=0 tx=0).stop 2024-08-17T02:26:22.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.733+0000 7f439bd85700 1 -- 172.21.15.153:0/43282329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4394067510 msgr2=0x7f43940c7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.733+0000 7f439bd85700 1 --2- 172.21.15.153:0/43282329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4394067510 0x7f43940c7260 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f438400c7f0 tx=0x7f4384007f30 comp rx=0 tx=0).stop 2024-08-17T02:26:22.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.733+0000 7f439bd85700 1 -- 172.21.15.153:0/43282329 shutdown_connections 2024-08-17T02:26:22.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.733+0000 7f439bd85700 1 --2- 172.21.15.153:0/43282329 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4378060860 0x7f4378062d10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.733+0000 7f439bd85700 1 --2- 172.21.15.153:0/43282329 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43941596d0 0x7f43940ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.733+0000 7f439bd85700 1 --2- 172.21.15.153:0/43282329 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4394159300 0x7f4394150a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.733+0000 7f439bd85700 1 --2- 172.21.15.153:0/43282329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4394067510 0x7f43940c7260 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.733+0000 7f439bd85700 1 -- 172.21.15.153:0/43282329 >> 172.21.15.153:0/43282329 conn(0x7f43940682c0 msgr2=0x7f43940d0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:22.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.733+0000 7f439bd85700 1 -- 172.21.15.153:0/43282329 shutdown_connections 2024-08-17T02:26:22.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.733+0000 7f439bd85700 1 -- 172.21.15.153:0/43282329 wait complete. 2024-08-17T02:26:22.750 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:26:22.863 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.861+0000 7f268a8e9700 1 Processor -- start 2024-08-17T02:26:22.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.861+0000 7f268a8e9700 1 -- start start 2024-08-17T02:26:22.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.861+0000 7f268a8e9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f268413e810 0x7f26840b16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.861+0000 7f268a8e9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f268406e720 0x7f2684157790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.861+0000 7f268a8e9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2684156a70 con 0x7f2684155760 2024-08-17T02:26:22.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.861+0000 7f268a8e9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2684155bb0 con 0x7f268406e720 2024-08-17T02:26:22.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.861+0000 7f268a8e9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2684155e60 con 0x7f268413e810 2024-08-17T02:26:22.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.861+0000 7f26890e6700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f2684155760 0x7f268406e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:54632/0 (socket says 172.21.15.153:54632) 2024-08-17T02:26:22.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.861+0000 7f26890e6700 1 -- 172.21.15.153:0/2941625094 learned_addr learned my addr 172.21.15.153:0/2941625094 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:22.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.861+0000 7f268a0e8700 1 --2- 172.21.15.153:0/2941625094 >> v2:172.21.15.153:3300/0 conn(0x7f268406e720 0x7f2684157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.861+0000 7f26898e7700 1 --2- 172.21.15.153:0/2941625094 >> v2:172.21.15.174:3300/0 conn(0x7f268413e810 0x7f26840b16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.861+0000 7f26888e5700 1 -- 172.21.15.153:0/2941625094 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3346589248 0 0) 0x7f2684156a70 con 0x7f2684155760 2024-08-17T02:26:22.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.861+0000 7f26888e5700 1 -- 172.21.15.153:0/2941625094 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f266c003570 con 0x7f2684155760 2024-08-17T02:26:22.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.861+0000 7f268a0e8700 1 -- 172.21.15.153:0/2941625094 >> v2:172.21.15.174:3300/0 conn(0x7f268413e810 msgr2=0x7f26840b16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:22.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.861+0000 7f268a0e8700 1 --2- 172.21.15.153:0/2941625094 >> v2:172.21.15.174:3300/0 conn(0x7f268413e810 0x7f26840b16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.861+0000 7f268a0e8700 1 -- 172.21.15.153:0/2941625094 >> v1:172.21.15.153:6789/0 conn(0x7f2684155760 legacy=0x7f268406e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.861+0000 7f268a0e8700 1 -- 172.21.15.153:0/2941625094 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2684156140 con 0x7f268406e720 2024-08-17T02:26:22.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.861+0000 7f268a0e8700 1 --2- 172.21.15.153:0/2941625094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f268406e720 0x7f2684157790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f26840b1d10 tx=0x7f267c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7a196a104cd5b36 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:22.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.861+0000 7f26888e5700 1 -- 172.21.15.153:0/2941625094 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267c011630 con 0x7f268406e720 2024-08-17T02:26:22.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.861+0000 7f26888e5700 1 -- 172.21.15.153:0/2941625094 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f267c0117b0 con 0x7f268406e720 2024-08-17T02:26:22.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.861+0000 7f26888e5700 1 -- 172.21.15.153:0/2941625094 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267c011b70 con 0x7f268406e720 2024-08-17T02:26:22.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.865+0000 7f268a8e9700 1 -- 172.21.15.153:0/2941625094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f268406e720 msgr2=0x7f2684157790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.865+0000 7f268a8e9700 1 --2- 172.21.15.153:0/2941625094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f268406e720 0x7f2684157790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f26840b1d10 tx=0x7f267c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.865+0000 7f268a8e9700 1 -- 172.21.15.153:0/2941625094 shutdown_connections 2024-08-17T02:26:22.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.865+0000 7f268a8e9700 1 --2- 172.21.15.153:0/2941625094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f268406e720 0x7f2684157790 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.865+0000 7f268a8e9700 1 --2- 172.21.15.153:0/2941625094 >> v2:172.21.15.174:3300/0 conn(0x7f268413e810 0x7f26840b16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.865+0000 7f268a8e9700 1 -- 172.21.15.153:0/2941625094 >> 172.21.15.153:0/2941625094 conn(0x7f26840678a0 msgr2=0x7f2684067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:22.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.865+0000 7f268a8e9700 1 -- 172.21.15.153:0/2941625094 shutdown_connections 2024-08-17T02:26:22.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.865+0000 7f268a8e9700 1 -- 172.21.15.153:0/2941625094 wait complete. 2024-08-17T02:26:22.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.865+0000 7f268a8e9700 1 Processor -- start 2024-08-17T02:26:22.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.865+0000 7f268a8e9700 1 -- start start 2024-08-17T02:26:22.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.865+0000 7f268a8e9700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f268406e720 0x7f2684063060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.865+0000 7f268a8e9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f268413e810 0x7f26840635a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.865+0000 7f268a8e9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2684155760 0x7f2684153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.865+0000 7f268a8e9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2684152da0 con 0x7f2684155760 2024-08-17T02:26:22.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.865+0000 7f268a8e9700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2684152190 con 0x7f268406e720 2024-08-17T02:26:22.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.865+0000 7f268a8e9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2684152470 con 0x7f268413e810 2024-08-17T02:26:22.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.865+0000 7f268a0e8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2684155760 0x7f2684153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.865+0000 7f268a0e8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2684155760 0x7f2684153e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51418/0 (socket says 172.21.15.153:51418) 2024-08-17T02:26:22.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.865+0000 7f268a0e8700 1 -- 172.21.15.153:0/1277291219 learned_addr learned my addr 172.21.15.153:0/1277291219 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:22.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.865+0000 7f26898e7700 1 --2- 172.21.15.153:0/1277291219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f268406e720 0x7f2684063060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.865+0000 7f26890e6700 1 --2- 172.21.15.153:0/1277291219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f268413e810 0x7f26840635a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.865+0000 7f268a0e8700 1 -- 172.21.15.153:0/1277291219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f268413e810 msgr2=0x7f26840635a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.865+0000 7f268a0e8700 1 --2- 172.21.15.153:0/1277291219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f268413e810 0x7f26840635a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.865+0000 7f268a0e8700 1 -- 172.21.15.153:0/1277291219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f268406e720 msgr2=0x7f2684063060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.865+0000 7f268a0e8700 1 --2- 172.21.15.153:0/1277291219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f268406e720 0x7f2684063060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.865+0000 7f268a0e8700 1 -- 172.21.15.153:0/1277291219 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f267c009420 con 0x7f2684155760 2024-08-17T02:26:22.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.865+0000 7f26898e7700 1 --2- 172.21.15.153:0/1277291219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f268406e720 0x7f2684063060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:22.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.865+0000 7f268a0e8700 1 --2- 172.21.15.153:0/1277291219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2684155760 0x7f2684153e40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f267c0093f0 tx=0x7f267c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:22.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.869+0000 7f2681ffb700 1 -- 172.21.15.153:0/1277291219 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267c01f070 con 0x7f2684155760 2024-08-17T02:26:22.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.869+0000 7f2681ffb700 1 -- 172.21.15.153:0/1277291219 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f267c011920 con 0x7f2684155760 2024-08-17T02:26:22.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.869+0000 7f268a8e9700 1 -- 172.21.15.153:0/1277291219 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2684152750 con 0x7f2684155760 2024-08-17T02:26:22.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.869+0000 7f2681ffb700 1 -- 172.21.15.153:0/1277291219 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267c025420 con 0x7f2684155760 2024-08-17T02:26:22.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.869+0000 7f268a8e9700 1 -- 172.21.15.153:0/1277291219 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2684132f50 con 0x7f2684155760 2024-08-17T02:26:22.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.869+0000 7f268a8e9700 1 -- 172.21.15.153:0/1277291219 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2684064330 con 0x7f2684155760 2024-08-17T02:26:22.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.869+0000 7f2681ffb700 1 -- 172.21.15.153:0/1277291219 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f267c023070 con 0x7f2684155760 2024-08-17T02:26:22.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.873+0000 7f2681ffb700 1 --2- 172.21.15.153:0/1277291219 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2670060890 0x7f2670062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.873+0000 7f26898e7700 1 --2- 172.21.15.153:0/1277291219 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2670060890 0x7f2670062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.873+0000 7f2681ffb700 1 -- 172.21.15.153:0/1277291219 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f267c07e0f0 con 0x7f2684155760 2024-08-17T02:26:22.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.873+0000 7f26898e7700 1 --2- 172.21.15.153:0/1277291219 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2670060890 0x7f2670062d40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f26840afa20 tx=0x7f2674008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:22.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:22.877+0000 7f2681ffb700 1 -- 172.21.15.153:0/1277291219 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f267c04e540 con 0x7f2684155760 2024-08-17T02:26:23.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.037+0000 7f268a8e9700 1 -- 172.21.15.153:0/1277291219 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2684158ad0 con 0x7f2684155760 2024-08-17T02:26:23.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.041+0000 7f2681ffb700 1 -- 172.21.15.153:0/1277291219 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f267c051b60 con 0x7f2684155760 2024-08-17T02:26:23.043 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2024-08-17T02:26:23.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.041+0000 7f268a8e9700 1 -- 172.21.15.153:0/1277291219 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2670060890 msgr2=0x7f2670062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.041+0000 7f268a8e9700 1 --2- 172.21.15.153:0/1277291219 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2670060890 0x7f2670062d40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f26840afa20 tx=0x7f2674008040 comp rx=0 tx=0).stop 2024-08-17T02:26:23.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.041+0000 7f268a8e9700 1 -- 172.21.15.153:0/1277291219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2684155760 msgr2=0x7f2684153e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.041+0000 7f268a8e9700 1 --2- 172.21.15.153:0/1277291219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2684155760 0x7f2684153e40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f267c0093f0 tx=0x7f267c017000 comp rx=0 tx=0).stop 2024-08-17T02:26:23.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.041+0000 7f268a8e9700 1 -- 172.21.15.153:0/1277291219 shutdown_connections 2024-08-17T02:26:23.046 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.041+0000 7f268a8e9700 1 --2- 172.21.15.153:0/1277291219 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2670060890 0x7f2670062d40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.046 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.041+0000 7f268a8e9700 1 --2- 172.21.15.153:0/1277291219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2684155760 0x7f2684153e40 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.046 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.041+0000 7f268a8e9700 1 --2- 172.21.15.153:0/1277291219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f268413e810 0x7f26840635a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.046 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.041+0000 7f268a8e9700 1 --2- 172.21.15.153:0/1277291219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f268406e720 0x7f2684063060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.046 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.041+0000 7f268a8e9700 1 -- 172.21.15.153:0/1277291219 >> 172.21.15.153:0/1277291219 conn(0x7f26840678a0 msgr2=0x7f2684136720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:23.046 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.041+0000 7f268a8e9700 1 -- 172.21.15.153:0/1277291219 shutdown_connections 2024-08-17T02:26:23.046 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.041+0000 7f268a8e9700 1 -- 172.21.15.153:0/1277291219 wait complete. 2024-08-17T02:26:23.061 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:23.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.165+0000 7f1d9f020700 1 Processor -- start 2024-08-17T02:26:23.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.165+0000 7f1d9f020700 1 -- start start 2024-08-17T02:26:23.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.169+0000 7f1d9f020700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1d98155d20 0x7f1d980b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.169+0000 7f1d9f020700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1d980ad7c0 0x7f1d980aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.169+0000 7f1d9f020700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d980af2b0 con 0x7f1d9806df10 2024-08-17T02:26:23.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.169+0000 7f1d9f020700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d980adc10 con 0x7f1d980ad7c0 2024-08-17T02:26:23.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.169+0000 7f1d9f020700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d980af590 con 0x7f1d98155d20 2024-08-17T02:26:23.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.169+0000 7f1d9d81d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1d980ad7c0 0x7f1d980aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.169+0000 7f1d9e81f700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f1d9806df10 0x7f1d9806e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:54640/0 (socket says 172.21.15.153:54640) 2024-08-17T02:26:23.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.169+0000 7f1d9e81f700 1 -- 172.21.15.153:0/3891453719 learned_addr learned my addr 172.21.15.153:0/3891453719 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:23.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.169+0000 7f1d9e01e700 1 --2- 172.21.15.153:0/3891453719 >> v2:172.21.15.174:3300/0 conn(0x7f1d98155d20 0x7f1d980b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.169+0000 7f1d9d01c700 1 -- 172.21.15.153:0/3891453719 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 209993976 0 0) 0x7f1d980af2b0 con 0x7f1d9806df10 2024-08-17T02:26:23.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.169+0000 7f1d9d01c700 1 -- 172.21.15.153:0/3891453719 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d84003570 con 0x7f1d9806df10 2024-08-17T02:26:23.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.169+0000 7f1d9d81d700 1 -- 172.21.15.153:0/3891453719 >> v2:172.21.15.174:3300/0 conn(0x7f1d98155d20 msgr2=0x7f1d980b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:23.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.169+0000 7f1d9d81d700 1 --2- 172.21.15.153:0/3891453719 >> v2:172.21.15.174:3300/0 conn(0x7f1d98155d20 0x7f1d980b0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.169+0000 7f1d9d81d700 1 -- 172.21.15.153:0/3891453719 >> v1:172.21.15.153:6789/0 conn(0x7f1d9806df10 legacy=0x7f1d9806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.169+0000 7f1d9d81d700 1 -- 172.21.15.153:0/3891453719 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d980af870 con 0x7f1d980ad7c0 2024-08-17T02:26:23.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.169+0000 7f1d9d01c700 1 -- 172.21.15.153:0/3891453719 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 814876404 0 0) 0x7f1d84003570 con 0x7f1d9806df10 2024-08-17T02:26:23.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.169+0000 7f1d9d81d700 1 --2- 172.21.15.153:0/3891453719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d980ad7c0 0x7f1d980aea80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1d980b1d50 tx=0x7f1d880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a88c6f27157bd05a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:23.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.169+0000 7f1d9d01c700 1 -- 172.21.15.153:0/3891453719 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d900017f0 con 0x7f1d980ad7c0 2024-08-17T02:26:23.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.169+0000 7f1d9d01c700 1 -- 172.21.15.153:0/3891453719 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8800f4a0 con 0x7f1d980ad7c0 2024-08-17T02:26:23.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.169+0000 7f1d9d01c700 1 -- 172.21.15.153:0/3891453719 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8800f840 con 0x7f1d980ad7c0 2024-08-17T02:26:23.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.169+0000 7f1d9f020700 1 -- 172.21.15.153:0/3891453719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d980ad7c0 msgr2=0x7f1d980aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.169+0000 7f1d9f020700 1 --2- 172.21.15.153:0/3891453719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d980ad7c0 0x7f1d980aea80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1d980b1d50 tx=0x7f1d880091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.169+0000 7f1d9f020700 1 -- 172.21.15.153:0/3891453719 shutdown_connections 2024-08-17T02:26:23.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.169+0000 7f1d9f020700 1 --2- 172.21.15.153:0/3891453719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d980ad7c0 0x7f1d980aea80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.169+0000 7f1d9f020700 1 --2- 172.21.15.153:0/3891453719 >> v2:172.21.15.174:3300/0 conn(0x7f1d98155d20 0x7f1d980b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.169+0000 7f1d9f020700 1 -- 172.21.15.153:0/3891453719 >> 172.21.15.153:0/3891453719 conn(0x7f1d980678d0 msgr2=0x7f1d98067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:23.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.169+0000 7f1d9f020700 1 -- 172.21.15.153:0/3891453719 shutdown_connections 2024-08-17T02:26:23.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.169+0000 7f1d9f020700 1 -- 172.21.15.153:0/3891453719 wait complete. 2024-08-17T02:26:23.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.173+0000 7f1d9f020700 1 Processor -- start 2024-08-17T02:26:23.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.173+0000 7f1d9f020700 1 -- start start 2024-08-17T02:26:23.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.177+0000 7f1d9f020700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d9806df10 0x7f1d980aa780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.177+0000 7f1d9f020700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d980ad7c0 0x7f1d981560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.177+0000 7f1d9f020700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d98155d20 0x7f1d98145a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.177+0000 7f1d9f020700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d981574e0 con 0x7f1d9806df10 2024-08-17T02:26:23.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.177+0000 7f1d9f020700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d98156630 con 0x7f1d980ad7c0 2024-08-17T02:26:23.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.177+0000 7f1d9f020700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d98145f70 con 0x7f1d98155d20 2024-08-17T02:26:23.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.177+0000 7f1d9e01e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d9806df10 0x7f1d980aa780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.177+0000 7f1d9e01e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d9806df10 0x7f1d980aa780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51426/0 (socket says 172.21.15.153:51426) 2024-08-17T02:26:23.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.177+0000 7f1d9e01e700 1 -- 172.21.15.153:0/182088213 learned_addr learned my addr 172.21.15.153:0/182088213 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:23.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.177+0000 7f1d9d81d700 1 --2- 172.21.15.153:0/182088213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d980ad7c0 0x7f1d981560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.177+0000 7f1d9e81f700 1 --2- 172.21.15.153:0/182088213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d98155d20 0x7f1d98145a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.177+0000 7f1d9d81d700 1 -- 172.21.15.153:0/182088213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d98155d20 msgr2=0x7f1d98145a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.177+0000 7f1d9d81d700 1 --2- 172.21.15.153:0/182088213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d98155d20 0x7f1d98145a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.177+0000 7f1d9d81d700 1 -- 172.21.15.153:0/182088213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d9806df10 msgr2=0x7f1d980aa780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.177+0000 7f1d9d81d700 1 --2- 172.21.15.153:0/182088213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d9806df10 0x7f1d980aa780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.177+0000 7f1d9d81d700 1 -- 172.21.15.153:0/182088213 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d88009420 con 0x7f1d980ad7c0 2024-08-17T02:26:23.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.177+0000 7f1d9d81d700 1 --2- 172.21.15.153:0/182088213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d980ad7c0 0x7f1d981560f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1d88017000 tx=0x7f1d88018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:23.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.177+0000 7f1d8e7fc700 1 -- 172.21.15.153:0/182088213 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d88000d10 con 0x7f1d980ad7c0 2024-08-17T02:26:23.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.177+0000 7f1d8e7fc700 1 -- 172.21.15.153:0/182088213 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d88010b30 con 0x7f1d980ad7c0 2024-08-17T02:26:23.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.177+0000 7f1d8e7fc700 1 -- 172.21.15.153:0/182088213 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d88023420 con 0x7f1d980ad7c0 2024-08-17T02:26:23.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.177+0000 7f1d9f020700 1 -- 172.21.15.153:0/182088213 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d981568d0 con 0x7f1d980ad7c0 2024-08-17T02:26:23.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.177+0000 7f1d9f020700 1 -- 172.21.15.153:0/182088213 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d98156e90 con 0x7f1d980ad7c0 2024-08-17T02:26:23.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.177+0000 7f1d9f020700 1 -- 172.21.15.153:0/182088213 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d980643a0 con 0x7f1d980ad7c0 2024-08-17T02:26:23.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.181+0000 7f1d8e7fc700 1 -- 172.21.15.153:0/182088213 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1d8802c430 con 0x7f1d980ad7c0 2024-08-17T02:26:23.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.181+0000 7f1d8e7fc700 1 --2- 172.21.15.153:0/182088213 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1d7c0608e0 0x7f1d7c062d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.181+0000 7f1d8e7fc700 1 -- 172.21.15.153:0/182088213 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1d8801f070 con 0x7f1d980ad7c0 2024-08-17T02:26:23.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.181+0000 7f1d9e01e700 1 --2- 172.21.15.153:0/182088213 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1d7c0608e0 0x7f1d7c062d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.181+0000 7f1d9e01e700 1 --2- 172.21.15.153:0/182088213 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1d7c0608e0 0x7f1d7c062d90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1d94009e70 tx=0x7f1d940091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:23.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.193+0000 7f1d8e7fc700 1 -- 172.21.15.153:0/182088213 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1d8804e2d0 con 0x7f1d980ad7c0 2024-08-17T02:26:23.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.393+0000 7f1d9f020700 1 -- 172.21.15.153:0/182088213 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d9806f5f0 con 0x7f1d980ad7c0 2024-08-17T02:26:23.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.393+0000 7f1d8e7fc700 1 -- 172.21.15.153:0/182088213 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f1d880518f0 con 0x7f1d980ad7c0 2024-08-17T02:26:23.398 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:23.398 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/610991976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":610991976},{"type":"v1","addr":"172.21.15.153:6835","nonce":610991976}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/3521472122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3521472122},{"type":"v1","addr":"172.21.15.153:6837","nonce":3521472122}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1184225885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1184225885},{"type":"v1","addr":"172.21.15.174:6833","nonce":1184225885}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:12.082812+0000","modified":"2024-08-17T02:26:14.770527+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/477398839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":477398839},{"type":"v1","addr":"172.21.15.174:6835","nonce":477398839}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:26:23.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.397+0000 7f1d9f020700 1 -- 172.21.15.153:0/182088213 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1d7c0608e0 msgr2=0x7f1d7c062d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.397+0000 7f1d9f020700 1 --2- 172.21.15.153:0/182088213 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1d7c0608e0 0x7f1d7c062d90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1d94009e70 tx=0x7f1d940091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.397+0000 7f1d9f020700 1 -- 172.21.15.153:0/182088213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d980ad7c0 msgr2=0x7f1d981560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.397+0000 7f1d9f020700 1 --2- 172.21.15.153:0/182088213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d980ad7c0 0x7f1d981560f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1d88017000 tx=0x7f1d88018000 comp rx=0 tx=0).stop 2024-08-17T02:26:23.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.397+0000 7f1d9f020700 1 -- 172.21.15.153:0/182088213 shutdown_connections 2024-08-17T02:26:23.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.397+0000 7f1d9f020700 1 --2- 172.21.15.153:0/182088213 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1d7c0608e0 0x7f1d7c062d90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.397+0000 7f1d9f020700 1 --2- 172.21.15.153:0/182088213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d98155d20 0x7f1d98145a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.397+0000 7f1d9f020700 1 --2- 172.21.15.153:0/182088213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d980ad7c0 0x7f1d981560f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.397+0000 7f1d9f020700 1 --2- 172.21.15.153:0/182088213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d9806df10 0x7f1d980aa780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.397+0000 7f1d9f020700 1 -- 172.21.15.153:0/182088213 >> 172.21.15.153:0/182088213 conn(0x7f1d980678d0 msgr2=0x7f1d980acd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:23.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.397+0000 7f1d9f020700 1 -- 172.21.15.153:0/182088213 shutdown_connections 2024-08-17T02:26:23.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.397+0000 7f1d9f020700 1 -- 172.21.15.153:0/182088213 wait complete. 2024-08-17T02:26:23.403 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 6 2024-08-17T02:26:23.417 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:23.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.517+0000 7f3fbf59e700 1 Processor -- start 2024-08-17T02:26:23.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.517+0000 7f3fbf59e700 1 -- start start 2024-08-17T02:26:23.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.521+0000 7f3fbf59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fc0159040 0x7f3fc00cf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.521+0000 7f3fbf59e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3fc00d0010 0x7f3fc00d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.521+0000 7f3fbf59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc00cf190 con 0x7f3fc015cea0 2024-08-17T02:26:23.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.521+0000 7f3fbf59e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc00d09a0 con 0x7f3fc00d0010 2024-08-17T02:26:23.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.521+0000 7f3fbf59e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc00ce5e0 con 0x7f3fc0159040 2024-08-17T02:26:23.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.521+0000 7f3fbed9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f3fc015cea0 0x7f3fc015d320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:54644/0 (socket says 172.21.15.153:54644) 2024-08-17T02:26:23.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.521+0000 7f3fbed9d700 1 -- 172.21.15.153:0/1193685555 learned_addr learned my addr 172.21.15.153:0/1193685555 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:23.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.521+0000 7f3fbe59c700 1 --2- 172.21.15.153:0/1193685555 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fc0159040 0x7f3fc00cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.521+0000 7f3fb5d9b700 1 --2- 172.21.15.153:0/1193685555 >> v2:172.21.15.174:3300/0 conn(0x7f3fc00d0010 0x7f3fc00d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.521+0000 7f3fbdd9b700 1 -- 172.21.15.153:0/1193685555 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3173686607 0 0) 0x7f3fc00cf190 con 0x7f3fc015cea0 2024-08-17T02:26:23.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.521+0000 7f3fbdd9b700 1 -- 172.21.15.153:0/1193685555 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fac003570 con 0x7f3fc015cea0 2024-08-17T02:26:23.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.521+0000 7f3fbe59c700 1 -- 172.21.15.153:0/1193685555 >> v2:172.21.15.174:3300/0 conn(0x7f3fc00d0010 msgr2=0x7f3fc00d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:23.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.521+0000 7f3fbe59c700 1 --2- 172.21.15.153:0/1193685555 >> v2:172.21.15.174:3300/0 conn(0x7f3fc00d0010 0x7f3fc00d0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.521+0000 7f3fbe59c700 1 -- 172.21.15.153:0/1193685555 >> v1:172.21.15.153:6789/0 conn(0x7f3fc015cea0 legacy=0x7f3fc015d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.521+0000 7f3fbe59c700 1 -- 172.21.15.153:0/1193685555 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc00ce860 con 0x7f3fc0159040 2024-08-17T02:26:23.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.521+0000 7f3fb5d9b700 1 --2- 172.21.15.153:0/1193685555 >> v2:172.21.15.174:3300/0 conn(0x7f3fc00d0010 0x7f3fc00d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:23.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.521+0000 7f3fbe59c700 1 --2- 172.21.15.153:0/1193685555 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fc0159040 0x7f3fc00cf620 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3fb00098e0 tx=0x7f3fb00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42bcf3aafb503b7c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:23.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.521+0000 7f3fbdd9b700 1 -- 172.21.15.153:0/1193685555 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0011630 con 0x7f3fc0159040 2024-08-17T02:26:23.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.521+0000 7f3fbdd9b700 1 -- 172.21.15.153:0/1193685555 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb0011790 con 0x7f3fc0159040 2024-08-17T02:26:23.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.521+0000 7f3fbdd9b700 1 -- 172.21.15.153:0/1193685555 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0011b10 con 0x7f3fc0159040 2024-08-17T02:26:23.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.521+0000 7f3fbf59e700 1 -- 172.21.15.153:0/1193685555 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fc0159040 msgr2=0x7f3fc00cf620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.521+0000 7f3fbf59e700 1 --2- 172.21.15.153:0/1193685555 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fc0159040 0x7f3fc00cf620 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3fb00098e0 tx=0x7f3fb00091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.521+0000 7f3fbf59e700 1 -- 172.21.15.153:0/1193685555 shutdown_connections 2024-08-17T02:26:23.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.521+0000 7f3fbf59e700 1 --2- 172.21.15.153:0/1193685555 >> v2:172.21.15.174:3300/0 conn(0x7f3fc00d0010 0x7f3fc00d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.521+0000 7f3fbf59e700 1 --2- 172.21.15.153:0/1193685555 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fc0159040 0x7f3fc00cf620 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.521+0000 7f3fbf59e700 1 -- 172.21.15.153:0/1193685555 >> 172.21.15.153:0/1193685555 conn(0x7f3fc0068250 msgr2=0x7f3fc0068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:23.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.521+0000 7f3fbf59e700 1 -- 172.21.15.153:0/1193685555 shutdown_connections 2024-08-17T02:26:23.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.521+0000 7f3fbf59e700 1 -- 172.21.15.153:0/1193685555 wait complete. 2024-08-17T02:26:23.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.525+0000 7f3fbf59e700 1 Processor -- start 2024-08-17T02:26:23.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.525+0000 7f3fbf59e700 1 -- start start 2024-08-17T02:26:23.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.525+0000 7f3fbf59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fc00d0010 0x7f3fc014faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.525+0000 7f3fbf59e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fc0159040 0x7f3fc0151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.525+0000 7f3fbf59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fc015cea0 0x7f3fc0151e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.525+0000 7f3fbf59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc016a300 con 0x7f3fc00d0010 2024-08-17T02:26:23.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.525+0000 7f3fbf59e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc00ae510 con 0x7f3fc0159040 2024-08-17T02:26:23.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.525+0000 7f3fbf59e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc0152490 con 0x7f3fc015cea0 2024-08-17T02:26:23.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.525+0000 7f3fbe59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fc00d0010 0x7f3fc014faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.525+0000 7f3fbe59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fc00d0010 0x7f3fc014faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51438/0 (socket says 172.21.15.153:51438) 2024-08-17T02:26:23.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.525+0000 7f3fbe59c700 1 -- 172.21.15.153:0/2466362651 learned_addr learned my addr 172.21.15.153:0/2466362651 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:23.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.525+0000 7f3fb5d9b700 1 --2- 172.21.15.153:0/2466362651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fc0159040 0x7f3fc0151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.525+0000 7f3fbed9d700 1 --2- 172.21.15.153:0/2466362651 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fc015cea0 0x7f3fc0151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.525+0000 7f3fbe59c700 1 -- 172.21.15.153:0/2466362651 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fc015cea0 msgr2=0x7f3fc0151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.525+0000 7f3fbe59c700 1 --2- 172.21.15.153:0/2466362651 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fc015cea0 0x7f3fc0151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.525+0000 7f3fbe59c700 1 -- 172.21.15.153:0/2466362651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fc0159040 msgr2=0x7f3fc0151920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.525+0000 7f3fbe59c700 1 --2- 172.21.15.153:0/2466362651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fc0159040 0x7f3fc0151920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.525+0000 7f3fbe59c700 1 -- 172.21.15.153:0/2466362651 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa8009420 con 0x7f3fc00d0010 2024-08-17T02:26:23.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.525+0000 7f3fb5d9b700 1 --2- 172.21.15.153:0/2466362651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fc0159040 0x7f3fc0151920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:23.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.525+0000 7f3fbe59c700 1 --2- 172.21.15.153:0/2466362651 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fc00d0010 0x7f3fc014faf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0009ed0 tx=0x7f3fb0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:23.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.529+0000 7f3fb6ffd700 1 -- 172.21.15.153:0/2466362651 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0011900 con 0x7f3fc00d0010 2024-08-17T02:26:23.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.529+0000 7f3fb6ffd700 1 -- 172.21.15.153:0/2466362651 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb0011a60 con 0x7f3fc00d0010 2024-08-17T02:26:23.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.529+0000 7f3fbf59e700 1 -- 172.21.15.153:0/2466362651 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb0009420 con 0x7f3fc00d0010 2024-08-17T02:26:23.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.529+0000 7f3fb6ffd700 1 -- 172.21.15.153:0/2466362651 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb00276a0 con 0x7f3fc00d0010 2024-08-17T02:26:23.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.529+0000 7f3fbf59e700 1 -- 172.21.15.153:0/2466362651 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc0169cb0 con 0x7f3fc00d0010 2024-08-17T02:26:23.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.529+0000 7f3fbf59e700 1 -- 172.21.15.153:0/2466362651 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc00643a0 con 0x7f3fc00d0010 2024-08-17T02:26:23.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.529+0000 7f3fb6ffd700 1 -- 172.21.15.153:0/2466362651 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f3fb0027a90 con 0x7f3fc00d0010 2024-08-17T02:26:23.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.529+0000 7f3fb6ffd700 1 --2- 172.21.15.153:0/2466362651 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3fa0060860 0x7f3fa0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.529+0000 7f3fb6ffd700 1 -- 172.21.15.153:0/2466362651 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3fb007e9c0 con 0x7f3fc00d0010 2024-08-17T02:26:23.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.529+0000 7f3fb5d9b700 1 --2- 172.21.15.153:0/2466362651 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3fa0060860 0x7f3fa0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.529+0000 7f3fb5d9b700 1 --2- 172.21.15.153:0/2466362651 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3fa0060860 0x7f3fa0062d10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3fc00aea00 tx=0x7f3fa80091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:23.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.537+0000 7f3fb6ffd700 1 -- 172.21.15.153:0/2466362651 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f3fb004ee10 con 0x7f3fc00d0010 2024-08-17T02:26:23.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.697+0000 7f3fbf59e700 1 -- 172.21.15.153:0/2466362651 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3fc0157e30 con 0x7f3fc00d0010 2024-08-17T02:26:23.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.701+0000 7f3fb6ffd700 1 -- 172.21.15.153:0/2466362651 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f3fb002c090 con 0x7f3fc00d0010 2024-08-17T02:26:23.704 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:23.704 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":21,"fsid":"56d41c33-b929-456d-96be-2aac4ecd299d","created":"2024-08-17T02:25:47.756085+0000","modified":"2024-08-17T02:26:13.759246+0000","last_up_change":"2024-08-17T02:25:58.643690+0000","last_in_change":"2024-08-17T02:25:49.809186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:58.093273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:09.856520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:11.080706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0736f8e6-818e-42e6-a0dc-8aaf813315d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":24234},{"type":"v1","addr":"172.21.15.153:6817","nonce":24234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":24234},{"type":"v1","addr":"172.21.15.153:6819","nonce":24234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":24234},{"type":"v1","addr":"172.21.15.153:6823","nonce":24234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":24234},{"type":"v1","addr":"172.21.15.153:6821","nonce":24234}]},"public_addr":"172.21.15.153:6817/24234","cluster_addr":"172.21.15.153:6819/24234","heartbeat_back_addr":"172.21.15.153:6823/24234","heartbeat_front_addr":"172.21.15.153:6821/24234","state":["exists","up"]},{"osd":1,"uuid":"011762e9-6c2d-441a-aa56-68474639d72f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":24232},{"type":"v1","addr":"172.21.15.153:6801","nonce":24232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":24232},{"type":"v1","addr":"172.21.15.153:6803","nonce":24232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":24232},{"type":"v1","addr":"172.21.15.153:6809","nonce":24232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":24232},{"type":"v1","addr":"172.21.15.153:6806","nonce":24232}]},"public_addr":"172.21.15.153:6801/24232","cluster_addr":"172.21.15.153:6803/24232","heartbeat_back_addr":"172.21.15.153:6809/24232","heartbeat_front_addr":"172.21.15.153:6806/24232","state":["exists","up"]},{"osd":2,"uuid":"b562cd97-aa12-455e-b46a-e720a2ec9d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":24235},{"type":"v1","addr":"172.21.15.153:6808","nonce":24235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":24235},{"type":"v1","addr":"172.21.15.153:6811","nonce":24235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":24235},{"type":"v1","addr":"172.21.15.153:6815","nonce":24235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":24235},{"type":"v1","addr":"172.21.15.153:6813","nonce":24235}]},"public_addr":"172.21.15.153:6808/24235","cluster_addr":"172.21.15.153:6811/24235","heartbeat_back_addr":"172.21.15.153:6815/24235","heartbeat_front_addr":"172.21.15.153:6813/24235","state":["exists","up"]},{"osd":3,"uuid":"222da52f-90c2-4132-a5d2-6f6cf83d4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":24236},{"type":"v1","addr":"172.21.15.153:6825","nonce":24236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":24236},{"type":"v1","addr":"172.21.15.153:6827","nonce":24236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":24236},{"type":"v1","addr":"172.21.15.153:6831","nonce":24236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":24236},{"type":"v1","addr":"172.21.15.153:6829","nonce":24236}]},"public_addr":"172.21.15.153:6825/24236","cluster_addr":"172.21.15.153:6827/24236","heartbeat_back_addr":"172.21.15.153:6831/24236","heartbeat_front_addr":"172.21.15.153:6829/24236","state":["exists","up"]},{"osd":4,"uuid":"a38a04cd-032b-4977-a260-1ef3567d0c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24456},{"type":"v1","addr":"172.21.15.174:6809","nonce":24456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24456},{"type":"v1","addr":"172.21.15.174:6811","nonce":24456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24456},{"type":"v1","addr":"172.21.15.174:6815","nonce":24456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24456},{"type":"v1","addr":"172.21.15.174:6813","nonce":24456}]},"public_addr":"172.21.15.174:6809/24456","cluster_addr":"172.21.15.174:6811/24456","heartbeat_back_addr":"172.21.15.174:6815/24456","heartbeat_front_addr":"172.21.15.174:6813/24456","state":["exists","up"]},{"osd":5,"uuid":"c7778084-e751-48da-87a1-ab8bbe85aa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24457},{"type":"v1","addr":"172.21.15.174:6825","nonce":24457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24457},{"type":"v1","addr":"172.21.15.174:6827","nonce":24457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24457},{"type":"v1","addr":"172.21.15.174:6831","nonce":24457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24457},{"type":"v1","addr":"172.21.15.174:6829","nonce":24457}]},"public_addr":"172.21.15.174:6825/24457","cluster_addr":"172.21.15.174:6827/24457","heartbeat_back_addr":"172.21.15.174:6831/24457","heartbeat_front_addr":"172.21.15.174:6829/24457","state":["exists","up"]},{"osd":6,"uuid":"2d8e0715-254f-442c-9625-50721d0bc858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24477},{"type":"v1","addr":"172.21.15.174:6801","nonce":24477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24477},{"type":"v1","addr":"172.21.15.174:6803","nonce":24477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24477},{"type":"v1","addr":"172.21.15.174:6807","nonce":24477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24477},{"type":"v1","addr":"172.21.15.174:6805","nonce":24477}]},"public_addr":"172.21.15.174:6801/24477","cluster_addr":"172.21.15.174:6803/24477","heartbeat_back_addr":"172.21.15.174:6807/24477","heartbeat_front_addr":"172.21.15.174:6805/24477","state":["exists","up"]},{"osd":7,"uuid":"dffda25a-4601-4ddb-9a27-b0be1cadde27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24455},{"type":"v1","addr":"172.21.15.174:6817","nonce":24455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24455},{"type":"v1","addr":"172.21.15.174:6819","nonce":24455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24455},{"type":"v1","addr":"172.21.15.174:6823","nonce":24455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24455},{"type":"v1","addr":"172.21.15.174:6821","nonce":24455}]},"public_addr":"172.21.15.174:6817/24455","cluster_addr":"172.21.15.174:6819/24455","heartbeat_back_addr":"172.21.15.174:6823/24455","heartbeat_front_addr":"172.21.15.174:6821/24455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.990117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.033862+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.748087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.112877+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.070448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.360961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.110940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.226377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:23.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.701+0000 7f3fbf59e700 1 -- 172.21.15.153:0/2466362651 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3fa0060860 msgr2=0x7f3fa0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.701+0000 7f3fbf59e700 1 --2- 172.21.15.153:0/2466362651 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3fa0060860 0x7f3fa0062d10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3fc00aea00 tx=0x7f3fa80091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.701+0000 7f3fbf59e700 1 -- 172.21.15.153:0/2466362651 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fc00d0010 msgr2=0x7f3fc014faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.701+0000 7f3fbf59e700 1 --2- 172.21.15.153:0/2466362651 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fc00d0010 0x7f3fc014faf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0009ed0 tx=0x7f3fb0017000 comp rx=0 tx=0).stop 2024-08-17T02:26:23.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.705+0000 7f3fbf59e700 1 -- 172.21.15.153:0/2466362651 shutdown_connections 2024-08-17T02:26:23.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.705+0000 7f3fbf59e700 1 --2- 172.21.15.153:0/2466362651 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3fa0060860 0x7f3fa0062d10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.705+0000 7f3fbf59e700 1 --2- 172.21.15.153:0/2466362651 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fc015cea0 0x7f3fc0151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.705+0000 7f3fbf59e700 1 --2- 172.21.15.153:0/2466362651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fc0159040 0x7f3fc0151920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.705+0000 7f3fbf59e700 1 --2- 172.21.15.153:0/2466362651 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fc00d0010 0x7f3fc014faf0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.705+0000 7f3fbf59e700 1 -- 172.21.15.153:0/2466362651 >> 172.21.15.153:0/2466362651 conn(0x7f3fc0068250 msgr2=0x7f3fc0158050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:23.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.705+0000 7f3fbf59e700 1 -- 172.21.15.153:0/2466362651 shutdown_connections 2024-08-17T02:26:23.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.705+0000 7f3fbf59e700 1 -- 172.21.15.153:0/2466362651 wait complete. 2024-08-17T02:26:23.719 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:23.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.825+0000 7f2efc879700 1 Processor -- start 2024-08-17T02:26:23.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.825+0000 7f2efc879700 1 -- start start 2024-08-17T02:26:23.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.825+0000 7f2efc879700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2ef8154900 0x7f2ef80b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.825+0000 7f2efc879700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2ef80b12d0 0x7f2ef80cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.825+0000 7f2efc879700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2ef80cb390 0x7f2ef806df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.825+0000 7f2efc879700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef8068790 con 0x7f2ef8154900 2024-08-17T02:26:23.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.825+0000 7f2efc879700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef81583f0 con 0x7f2ef80b12d0 2024-08-17T02:26:23.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.825+0000 7f2efc879700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef80b1730 con 0x7f2ef80cb390 2024-08-17T02:26:23.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.825+0000 7f2ef77fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2ef8154900 0x7f2ef80b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.825+0000 7f2ef77fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2ef8154900 0x7f2ef80b0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51448/0 (socket says 172.21.15.153:51448) 2024-08-17T02:26:23.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.825+0000 7f2ef77fe700 1 -- 172.21.15.153:0/12841214 learned_addr learned my addr 172.21.15.153:0/12841214 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:23.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.825+0000 7f2ef77fe700 1 -- 172.21.15.153:0/12841214 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2ef80cb390 msgr2=0x7f2ef806df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:23.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.825+0000 7f2ef77fe700 1 --2- 172.21.15.153:0/12841214 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2ef80cb390 0x7f2ef806df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.825+0000 7f2ef77fe700 1 -- 172.21.15.153:0/12841214 >> v2:172.21.15.174:3300/0 conn(0x7f2ef80b12d0 msgr2=0x7f2ef80cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:23.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.825+0000 7f2ef77fe700 1 --2- 172.21.15.153:0/12841214 >> v2:172.21.15.174:3300/0 conn(0x7f2ef80b12d0 0x7f2ef80cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.825+0000 7f2ef77fe700 1 -- 172.21.15.153:0/12841214 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef80cbaa0 con 0x7f2ef8154900 2024-08-17T02:26:23.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.825+0000 7f2ef77fe700 1 --2- 172.21.15.153:0/12841214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ef8154900 0x7f2ef80b0d90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2ef806f390 tx=0x7f2ef0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d880fbf316399bcf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:23.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.825+0000 7f2ef67fc700 1 -- 172.21.15.153:0/12841214 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef000e070 con 0x7f2ef8154900 2024-08-17T02:26:23.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.825+0000 7f2ef67fc700 1 -- 172.21.15.153:0/12841214 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef000ba50 con 0x7f2ef8154900 2024-08-17T02:26:23.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.825+0000 7f2ef67fc700 1 -- 172.21.15.153:0/12841214 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef00092e0 con 0x7f2ef8154900 2024-08-17T02:26:23.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.825+0000 7f2efc879700 1 -- 172.21.15.153:0/12841214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ef8154900 msgr2=0x7f2ef80b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.825+0000 7f2efc879700 1 --2- 172.21.15.153:0/12841214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ef8154900 0x7f2ef80b0d90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2ef806f390 tx=0x7f2ef0009840 comp rx=0 tx=0).stop 2024-08-17T02:26:23.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.825+0000 7f2efc879700 1 -- 172.21.15.153:0/12841214 shutdown_connections 2024-08-17T02:26:23.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.825+0000 7f2efc879700 1 --2- 172.21.15.153:0/12841214 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2ef80cb390 0x7f2ef806df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.825+0000 7f2efc879700 1 --2- 172.21.15.153:0/12841214 >> v2:172.21.15.174:3300/0 conn(0x7f2ef80b12d0 0x7f2ef80cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.825+0000 7f2efc879700 1 --2- 172.21.15.153:0/12841214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ef8154900 0x7f2ef80b0d90 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.825+0000 7f2efc879700 1 -- 172.21.15.153:0/12841214 >> 172.21.15.153:0/12841214 conn(0x7f2ef80678d0 msgr2=0x7f2ef8067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:23.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.825+0000 7f2efc879700 1 -- 172.21.15.153:0/12841214 shutdown_connections 2024-08-17T02:26:23.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.825+0000 7f2efc879700 1 -- 172.21.15.153:0/12841214 wait complete. 2024-08-17T02:26:23.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.829+0000 7f2efc879700 1 Processor -- start 2024-08-17T02:26:23.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.829+0000 7f2efc879700 1 -- start start 2024-08-17T02:26:23.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.829+0000 7f2efc879700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ef80b12d0 0x7f2ef80c0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.829+0000 7f2efc879700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2ef80cb390 0x7f2ef80aa2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.829+0000 7f2efc879700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ef8154900 0x7f2ef806a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.829+0000 7f2efc879700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef80af490 con 0x7f2ef8154900 2024-08-17T02:26:23.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.829+0000 7f2efc879700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef80aa7f0 con 0x7f2ef80b12d0 2024-08-17T02:26:23.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.829+0000 7f2efc879700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef80aeb80 con 0x7f2ef80cb390 2024-08-17T02:26:23.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.829+0000 7f2ef7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ef8154900 0x7f2ef806a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.829+0000 7f2ef7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ef8154900 0x7f2ef806a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51458/0 (socket says 172.21.15.153:51458) 2024-08-17T02:26:23.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.829+0000 7f2ef7fff700 1 -- 172.21.15.153:0/136087888 learned_addr learned my addr 172.21.15.153:0/136087888 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:23.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.829+0000 7f2ef77fe700 1 --2- 172.21.15.153:0/136087888 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ef80b12d0 0x7f2ef80c0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.829+0000 7f2ef6ffd700 1 --2- 172.21.15.153:0/136087888 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2ef80cb390 0x7f2ef80aa2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.829+0000 7f2ef7fff700 1 -- 172.21.15.153:0/136087888 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2ef80cb390 msgr2=0x7f2ef80aa2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.829+0000 7f2ef7fff700 1 --2- 172.21.15.153:0/136087888 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2ef80cb390 0x7f2ef80aa2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.829+0000 7f2ef7fff700 1 -- 172.21.15.153:0/136087888 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ef80b12d0 msgr2=0x7f2ef80c0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.829+0000 7f2ef7fff700 1 --2- 172.21.15.153:0/136087888 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ef80b12d0 0x7f2ef80c0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.829+0000 7f2ef7fff700 1 -- 172.21.15.153:0/136087888 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef0009ae0 con 0x7f2ef8154900 2024-08-17T02:26:23.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.829+0000 7f2ef7fff700 1 --2- 172.21.15.153:0/136087888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ef8154900 0x7f2ef806a140 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800b5b0 tx=0x7f2ee80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:23.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.829+0000 7f2eef7fe700 1 -- 172.21.15.153:0/136087888 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee80059b0 con 0x7f2ef8154900 2024-08-17T02:26:23.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.829+0000 7f2eef7fe700 1 -- 172.21.15.153:0/136087888 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee8005b10 con 0x7f2ef8154900 2024-08-17T02:26:23.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.829+0000 7f2eef7fe700 1 -- 172.21.15.153:0/136087888 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8006030 con 0x7f2ef8154900 2024-08-17T02:26:23.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.829+0000 7f2efc879700 1 -- 172.21.15.153:0/136087888 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef80c1050 con 0x7f2ef8154900 2024-08-17T02:26:23.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.829+0000 7f2efc879700 1 -- 172.21.15.153:0/136087888 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef80af120 con 0x7f2ef8154900 2024-08-17T02:26:23.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.829+0000 7f2efc879700 1 -- 172.21.15.153:0/136087888 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ef80af640 con 0x7f2ef8154900 2024-08-17T02:26:23.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.833+0000 7f2eef7fe700 1 -- 172.21.15.153:0/136087888 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2ee8006460 con 0x7f2ef8154900 2024-08-17T02:26:23.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.833+0000 7f2eef7fe700 1 --2- 172.21.15.153:0/136087888 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2ed8060860 0x7f2ed8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.833+0000 7f2eef7fe700 1 -- 172.21.15.153:0/136087888 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2ee807c130 con 0x7f2ef8154900 2024-08-17T02:26:23.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.833+0000 7f2ef77fe700 1 --2- 172.21.15.153:0/136087888 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2ed8060860 0x7f2ed8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.833+0000 7f2ef77fe700 1 --2- 172.21.15.153:0/136087888 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2ed8060860 0x7f2ed8062d10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0009880 tx=0x7f2ef0018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:23.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:23.841+0000 7f2eef7fe700 1 -- 172.21.15.153:0/136087888 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f2ee804c4e0 con 0x7f2ef8154900 2024-08-17T02:26:24.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.033+0000 7f2efc879700 1 -- 172.21.15.153:0/136087888 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ef80643a0 con 0x7f2ef8154900 2024-08-17T02:26:24.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.033+0000 7f2eef7fe700 1 -- 172.21.15.153:0/136087888 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f2ee8055030 con 0x7f2ef8154900 2024-08-17T02:26:24.037 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:24.038 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/610991976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":610991976},{"type":"v1","addr":"172.21.15.153:6835","nonce":610991976}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/3521472122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3521472122},{"type":"v1","addr":"172.21.15.153:6837","nonce":3521472122}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1184225885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1184225885},{"type":"v1","addr":"172.21.15.174:6833","nonce":1184225885}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:12.082812+0000","modified":"2024-08-17T02:26:14.770527+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/477398839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":477398839},{"type":"v1","addr":"172.21.15.174:6835","nonce":477398839}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:26:24.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.037+0000 7f2efc879700 1 -- 172.21.15.153:0/136087888 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2ed8060860 msgr2=0x7f2ed8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.037+0000 7f2efc879700 1 --2- 172.21.15.153:0/136087888 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2ed8060860 0x7f2ed8062d10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0009880 tx=0x7f2ef0018000 comp rx=0 tx=0).stop 2024-08-17T02:26:24.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.037+0000 7f2efc879700 1 -- 172.21.15.153:0/136087888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ef8154900 msgr2=0x7f2ef806a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.037+0000 7f2efc879700 1 --2- 172.21.15.153:0/136087888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ef8154900 0x7f2ef806a140 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800b5b0 tx=0x7f2ee80091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.037+0000 7f2efc879700 1 -- 172.21.15.153:0/136087888 shutdown_connections 2024-08-17T02:26:24.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.037+0000 7f2efc879700 1 --2- 172.21.15.153:0/136087888 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2ed8060860 0x7f2ed8062d10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.037+0000 7f2efc879700 1 --2- 172.21.15.153:0/136087888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ef8154900 0x7f2ef806a140 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.037+0000 7f2efc879700 1 --2- 172.21.15.153:0/136087888 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2ef80cb390 0x7f2ef80aa2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.037+0000 7f2efc879700 1 --2- 172.21.15.153:0/136087888 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ef80b12d0 0x7f2ef80c0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.037+0000 7f2efc879700 1 -- 172.21.15.153:0/136087888 >> 172.21.15.153:0/136087888 conn(0x7f2ef80678d0 msgr2=0x7f2ef80aca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:24.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.037+0000 7f2efc879700 1 -- 172.21.15.153:0/136087888 shutdown_connections 2024-08-17T02:26:24.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.037+0000 7f2efc879700 1 -- 172.21.15.153:0/136087888 wait complete. 2024-08-17T02:26:24.042 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 6 2024-08-17T02:26:24.455 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:26:12.082812+0000', 'modified': '2024-08-17T02:26:14.770527+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4291}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4291': {'gid': 4291, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.174:6835/477398839', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6834', 'nonce': 477398839}, {'type': 'v1', 'addr': '172.21.15.174:6835', 'nonce': 477398839}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:26:24.455 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:26:24.455 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-08-17T02:26:24.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.573+0000 7f175759e700 1 Processor -- start 2024-08-17T02:26:24.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.573+0000 7f175759e700 1 -- start start 2024-08-17T02:26:24.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.573+0000 7f175759e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f175813f670 0x7f17580b1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.573+0000 7f175759e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f175813fa40 0x7f17580ade00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.573+0000 7f175759e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17580ae340 0x7f175806e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.573+0000 7f175759e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17580ae8c0 con 0x7f175813f670 2024-08-17T02:26:24.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.573+0000 7f175759e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17580b1820 con 0x7f175813fa40 2024-08-17T02:26:24.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.573+0000 7f175759e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17580ad710 con 0x7f17580ae340 2024-08-17T02:26:24.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.573+0000 7f175659c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f175813f670 0x7f17580b1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.573+0000 7f175659c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f175813f670 0x7f17580b1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51472/0 (socket says 172.21.15.153:51472) 2024-08-17T02:26:24.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.573+0000 7f175659c700 1 -- 172.21.15.153:0/3867002427 learned_addr learned my addr 172.21.15.153:0/3867002427 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:24.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.573+0000 7f1755d9b700 1 --2- 172.21.15.153:0/3867002427 >> v2:172.21.15.174:3300/0 conn(0x7f175813fa40 0x7f17580ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.573+0000 7f1756d9d700 1 --2- 172.21.15.153:0/3867002427 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17580ae340 0x7f175806e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.573+0000 7f175659c700 1 -- 172.21.15.153:0/3867002427 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17580ae340 msgr2=0x7f175806e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:24.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.573+0000 7f175659c700 1 --2- 172.21.15.153:0/3867002427 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17580ae340 0x7f175806e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.573+0000 7f175659c700 1 -- 172.21.15.153:0/3867002427 >> v2:172.21.15.174:3300/0 conn(0x7f175813fa40 msgr2=0x7f17580ade00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:24.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.573+0000 7f175659c700 1 --2- 172.21.15.153:0/3867002427 >> v2:172.21.15.174:3300/0 conn(0x7f175813fa40 0x7f17580ade00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.573+0000 7f175659c700 1 -- 172.21.15.153:0/3867002427 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17580b0ef0 con 0x7f175813f670 2024-08-17T02:26:24.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.573+0000 7f1756d9d700 1 --2- 172.21.15.153:0/3867002427 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17580ae340 0x7f175806e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:24.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.573+0000 7f175659c700 1 --2- 172.21.15.153:0/3867002427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f175813f670 0x7f17580b1cb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f17580c97b0 tx=0x7f1740009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c3e656b17f1bf63 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:24.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.573+0000 7f175559a700 1 -- 172.21.15.153:0/3867002427 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174000b820 con 0x7f175813f670 2024-08-17T02:26:24.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.573+0000 7f175559a700 1 -- 172.21.15.153:0/3867002427 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174000b980 con 0x7f175813f670 2024-08-17T02:26:24.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.573+0000 7f175559a700 1 -- 172.21.15.153:0/3867002427 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174000bd20 con 0x7f175813f670 2024-08-17T02:26:24.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.573+0000 7f175759e700 1 -- 172.21.15.153:0/3867002427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f175813f670 msgr2=0x7f17580b1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.573+0000 7f175759e700 1 --2- 172.21.15.153:0/3867002427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f175813f670 0x7f17580b1cb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f17580c97b0 tx=0x7f1740009250 comp rx=0 tx=0).stop 2024-08-17T02:26:24.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.573+0000 7f175759e700 1 -- 172.21.15.153:0/3867002427 shutdown_connections 2024-08-17T02:26:24.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.573+0000 7f175759e700 1 --2- 172.21.15.153:0/3867002427 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17580ae340 0x7f175806e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.573+0000 7f175759e700 1 --2- 172.21.15.153:0/3867002427 >> v2:172.21.15.174:3300/0 conn(0x7f175813fa40 0x7f17580ade00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.573+0000 7f175759e700 1 --2- 172.21.15.153:0/3867002427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f175813f670 0x7f17580b1cb0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.573+0000 7f175759e700 1 -- 172.21.15.153:0/3867002427 >> 172.21.15.153:0/3867002427 conn(0x7f17580ca2b0 msgr2=0x7f175806e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:24.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.577+0000 7f175759e700 1 -- 172.21.15.153:0/3867002427 shutdown_connections 2024-08-17T02:26:24.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.577+0000 7f175759e700 1 -- 172.21.15.153:0/3867002427 wait complete. 2024-08-17T02:26:24.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.577+0000 7f175759e700 1 Processor -- start 2024-08-17T02:26:24.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.577+0000 7f175759e700 1 -- start start 2024-08-17T02:26:24.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.577+0000 7f175759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17580ae340 0x7f1758158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.577+0000 7f175759e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f175813f670 0x7f175813a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.577+0000 7f175759e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f175813fa40 0x7f1758068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.577+0000 7f175759e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1758158d00 con 0x7f17580ae340 2024-08-17T02:26:24.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.577+0000 7f175759e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1758158fe0 con 0x7f175813fa40 2024-08-17T02:26:24.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.577+0000 7f175759e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17581592c0 con 0x7f175813f670 2024-08-17T02:26:24.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.577+0000 7f175659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17580ae340 0x7f1758158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.577+0000 7f175659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17580ae340 0x7f1758158460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51486/0 (socket says 172.21.15.153:51486) 2024-08-17T02:26:24.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.577+0000 7f1755d9b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f175813f670 0x7f175813a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.577+0000 7f1756d9d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f175813fa40 0x7f1758068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.577+0000 7f175659c700 1 -- 172.21.15.153:0/1631849577 learned_addr learned my addr 172.21.15.153:0/1631849577 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:24.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.581+0000 7f1756d9d700 1 -- 172.21.15.153:0/1631849577 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f175813f670 msgr2=0x7f175813a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.581+0000 7f1756d9d700 1 --2- 172.21.15.153:0/1631849577 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f175813f670 0x7f175813a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.581+0000 7f1756d9d700 1 -- 172.21.15.153:0/1631849577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17580ae340 msgr2=0x7f1758158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.581+0000 7f1756d9d700 1 --2- 172.21.15.153:0/1631849577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17580ae340 0x7f1758158460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.581+0000 7f1756d9d700 1 -- 172.21.15.153:0/1631849577 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17400094f0 con 0x7f175813fa40 2024-08-17T02:26:24.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.581+0000 7f1756d9d700 1 --2- 172.21.15.153:0/1631849577 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f175813fa40 0x7f1758068a40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f174800c850 tx=0x7f1748008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:24.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.581+0000 7f174e7fc700 1 -- 172.21.15.153:0/1631849577 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1748011600 con 0x7f175813fa40 2024-08-17T02:26:24.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.581+0000 7f174e7fc700 1 -- 172.21.15.153:0/1631849577 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1748011780 con 0x7f175813fa40 2024-08-17T02:26:24.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.581+0000 7f175759e700 1 -- 172.21.15.153:0/1631849577 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f175814ba60 con 0x7f175813fa40 2024-08-17T02:26:24.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.581+0000 7f174e7fc700 1 -- 172.21.15.153:0/1631849577 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1748011b40 con 0x7f175813fa40 2024-08-17T02:26:24.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.581+0000 7f175759e700 1 -- 172.21.15.153:0/1631849577 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17581589a0 con 0x7f175813fa40 2024-08-17T02:26:24.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.585+0000 7f175f16a740 1 Processor -- start 2024-08-17T02:26:24.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.585+0000 7f174e7fc700 1 -- 172.21.15.153:0/1631849577 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f17480223a0 con 0x7f175813fa40 2024-08-17T02:26:24.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.585+0000 7f175f16a740 1 -- start start 2024-08-17T02:26:24.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.585+0000 7f175f16a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1166ae0 0x139f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.585+0000 7f174e7fc700 1 --2- 172.21.15.153:0/1631849577 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1738060860 0x7f1738062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.585+0000 7f175f16a740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x1166710 0x139a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.585+0000 7f175f16a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x11b1790 0x139a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.585+0000 7f175f16a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1312ba0 con 0x1166ae0 2024-08-17T02:26:24.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.585+0000 7f175f16a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x130eb40 con 0x11b1790 2024-08-17T02:26:24.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.585+0000 7f175f16a740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x12d40a0 con 0x1166710 2024-08-17T02:26:24.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.585+0000 7f175659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1166ae0 0x139f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.585+0000 7f1755d9b700 1 --2- 172.21.15.153:0/1631849577 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1738060860 0x7f1738062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.585+0000 7f175659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1166ae0 0x139f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51492/0 (socket says 172.21.15.153:51492) 2024-08-17T02:26:24.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.585+0000 7f175659c700 1 -- 172.21.15.153:0/2821187340 learned_addr learned my addr 172.21.15.153:0/2821187340 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:24.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.585+0000 7f174e7fc700 1 -- 172.21.15.153:0/1631849577 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f174807cd20 con 0x7f175813fa40 2024-08-17T02:26:24.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.585+0000 7f1756d9d700 1 --2- 172.21.15.153:0/2821187340 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x11b1790 0x139a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.585+0000 7f1755d9b700 1 --2- 172.21.15.153:0/2821187340 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x1166710 0x139a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.585+0000 7f175659c700 1 -- 172.21.15.153:0/2821187340 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x1166710 msgr2=0x139a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:24.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.585+0000 7f175659c700 1 --2- 172.21.15.153:0/2821187340 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x1166710 0x139a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.585+0000 7f175659c700 1 -- 172.21.15.153:0/2821187340 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x11b1790 msgr2=0x139a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:24.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.585+0000 7f175659c700 1 --2- 172.21.15.153:0/2821187340 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x11b1790 0x139a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.585+0000 7f175659c700 1 -- 172.21.15.153:0/2821187340 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x11b29e0 con 0x1166ae0 2024-08-17T02:26:24.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.585+0000 7f1755d9b700 1 --2- 172.21.15.153:0/1631849577 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1738060860 0x7f1738062d10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1750009fd0 tx=0x7f17500097e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:24.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.585+0000 7f175659c700 1 --2- 172.21.15.153:0/2821187340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1166ae0 0x139f4b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f174000b3c0 tx=0x7f1740017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d573b152e732266e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:24.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.585+0000 7f17377fe700 1 -- 172.21.15.153:0/2821187340 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1740021070 con 0x1166ae0 2024-08-17T02:26:24.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.585+0000 7f17377fe700 1 -- 172.21.15.153:0/2821187340 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1740000c90 con 0x1166ae0 2024-08-17T02:26:24.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.585+0000 7f17377fe700 1 -- 172.21.15.153:0/2821187340 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174000baf0 con 0x1166ae0 2024-08-17T02:26:24.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.585+0000 7f175f16a740 1 -- 172.21.15.153:0/2821187340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1166ae0 msgr2=0x139f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.585+0000 7f175f16a740 1 --2- 172.21.15.153:0/2821187340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1166ae0 0x139f4b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f174000b3c0 tx=0x7f1740017000 comp rx=0 tx=0).stop 2024-08-17T02:26:24.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.585+0000 7f175f16a740 1 -- 172.21.15.153:0/2821187340 shutdown_connections 2024-08-17T02:26:24.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.585+0000 7f175f16a740 1 --2- 172.21.15.153:0/2821187340 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x11b1790 0x139a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.585+0000 7f175f16a740 1 --2- 172.21.15.153:0/2821187340 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x1166710 0x139a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.585+0000 7f175f16a740 1 --2- 172.21.15.153:0/2821187340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1166ae0 0x139f4b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.585+0000 7f175f16a740 1 -- 172.21.15.153:0/2821187340 >> 172.21.15.153:0/2821187340 conn(0x1166eb0 msgr2=0x13a00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:24.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.585+0000 7f175f16a740 1 -- 172.21.15.153:0/2821187340 shutdown_connections 2024-08-17T02:26:24.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.585+0000 7f175f16a740 1 -- 172.21.15.153:0/2821187340 wait complete. 2024-08-17T02:26:24.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.589+0000 7f175f16a740 1 -- start start 2024-08-17T02:26:24.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.589+0000 7f175f16a740 1 Processor -- start 2024-08-17T02:26:24.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.589+0000 7f175f16a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1166710 0x13ebe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.589+0000 7f175f16a740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x1166ae0 0x13ec3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.589+0000 7f175f16a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x11b1790 0x13a6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.589+0000 7f175f16a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x12d3d40 con 0x1166710 2024-08-17T02:26:24.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.589+0000 7f175f16a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x12ac970 con 0x11b1790 2024-08-17T02:26:24.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.589+0000 7f175f16a740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x12d7090 con 0x1166ae0 2024-08-17T02:26:24.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.589+0000 7f175f16a740 10 client.0 _ll_register_callbacks cb 0x12b0f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:26:24.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.589+0000 7f175659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1166710 0x13ebe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.589+0000 7f175659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1166710 0x13ebe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51500/0 (socket says 172.21.15.153:51500) 2024-08-17T02:26:24.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.589+0000 7f175659c700 1 -- 172.21.15.153:0/1029969280 learned_addr learned my addr 172.21.15.153:0/1029969280 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:24.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.589+0000 7f1756d9d700 1 --2- 172.21.15.153:0/1029969280 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x11b1790 0x13a6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.589+0000 7f1755d9b700 1 --2- 172.21.15.153:0/1029969280 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x1166ae0 0x13ec3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.589+0000 7f175659c700 1 -- 172.21.15.153:0/1029969280 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x1166ae0 msgr2=0x13ec3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:24.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.589+0000 7f175659c700 1 --2- 172.21.15.153:0/1029969280 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x1166ae0 0x13ec3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.589+0000 7f175659c700 1 -- 172.21.15.153:0/1029969280 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x11b1790 msgr2=0x13a6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:24.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.589+0000 7f175659c700 1 --2- 172.21.15.153:0/1029969280 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x11b1790 0x13a6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.589+0000 7f175659c700 1 -- 172.21.15.153:0/1029969280 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17580b0ef0 con 0x1166710 2024-08-17T02:26:24.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.589+0000 7f175659c700 1 --2- 172.21.15.153:0/1029969280 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1166710 0x13ebe90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1740009470 tx=0x7f174001e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be3439c8b4ad5f65 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:24.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.589+0000 7f1734ff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-17T02:26:24.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.589+0000 7f1734ff9700 1 -- 172.21.15.153:0/1029969280 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1740021040 con 0x1166710 2024-08-17T02:26:24.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.589+0000 7f1734ff9700 1 -- 172.21.15.153:0/1029969280 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f174000be60 con 0x1166710 2024-08-17T02:26:24.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.589+0000 7f175f16a740 1 -- 172.21.15.153:0/1029969280 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1174260 con 0x1166710 2024-08-17T02:26:24.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.589+0000 7f1734ff9700 1 -- 172.21.15.153:0/1029969280 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1740011a50 con 0x1166710 2024-08-17T02:26:24.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.589+0000 7f175f16a740 10 client.4683 fetch_fsmap learned FSMap version 6 2024-08-17T02:26:24.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.589+0000 7f175f16a740 1 -- 172.21.15.153:0/1029969280 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x12dc370 con 0x1166710 2024-08-17T02:26:24.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.593+0000 7f1734ff9700 1 -- 172.21.15.153:0/1029969280 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1174260 con 0x1166710 2024-08-17T02:26:24.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.593+0000 7f1734ff9700 1 -- 172.21.15.153:0/1029969280 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 6) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f174002e030 con 0x1166710 2024-08-17T02:26:24.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.593+0000 7f175f16a740 10 client.4683 fetch_fsmap finished waiting for FSMap version 6 2024-08-17T02:26:24.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.593+0000 7f175f16a740 10 client.4683 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-17T02:26:24.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.593+0000 7f175f16a740 20 client.4683 populate_metadata read hostname 'smithi153' 2024-08-17T02:26:24.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.593+0000 7f175f16a740 1 --2- 172.21.15.153:0/1029969280 >> [v2:172.21.15.174:6834/477398839,v1:172.21.15.174:6835/477398839] conn(0x13f5020 0x13f7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.593+0000 7f175f16a740 4 client.4683 mds_command: new command op to 4291 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:26:24.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.593+0000 7f175f16a740 1 -- 172.21.15.153:0/1029969280 --> [v2:172.21.15.174:6834/477398839,v1:172.21.15.174:6835/477398839] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x11be4e0 con 0x13f5020 2024-08-17T02:26:24.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.593+0000 7f1755d9b700 1 --2- 172.21.15.153:0/1029969280 >> [v2:172.21.15.174:6834/477398839,v1:172.21.15.174:6835/477398839] conn(0x13f5020 0x13f7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.593+0000 7f1734ff9700 10 client.4683 ms_handle_connect on v2:172.21.15.174:6834/477398839 2024-08-17T02:26:24.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.593+0000 7f1755d9b700 1 --2- 172.21.15.153:0/1029969280 >> [v2:172.21.15.174:6834/477398839,v1:172.21.15.174:6835/477398839] conn(0x13f5020 0x13f7400 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=210f16f4471c23bd server_cookie=16927b5b7b77d3c1 in_seq=0 out_seq=0 2024-08-17T02:26:24.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.593+0000 7f1734ff9700 1 -- 172.21.15.153:0/1029969280 <== mds.0 v2:172.21.15.174:6834/477398839 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x11be4e0 con 0x13f5020 2024-08-17T02:26:24.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.593+0000 7f1734ff9700 10 client.4683 handle_command_reply: tid=0 2024-08-17T02:26:24.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.593+0000 7f175f16a740 1 client.4683 shutdown 2024-08-17T02:26:24.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.593+0000 7f175f16a740 1 -- 172.21.15.153:0/1029969280 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1166710 msgr2=0x13ebe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.593+0000 7f175f16a740 1 --2- 172.21.15.153:0/1029969280 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1166710 0x13ebe90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1740009470 tx=0x7f174001e050 comp rx=0 tx=0).stop 2024-08-17T02:26:24.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.593+0000 7f175f16a740 1 -- 172.21.15.153:0/1029969280 shutdown_connections 2024-08-17T02:26:24.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.593+0000 7f175f16a740 1 --2- 172.21.15.153:0/1029969280 >> [v2:172.21.15.174:6834/477398839,v1:172.21.15.174:6835/477398839] conn(0x13f5020 0x13f7400 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.593+0000 7f175f16a740 1 --2- 172.21.15.153:0/1029969280 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x11b1790 0x13a6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.593+0000 7f175f16a740 1 --2- 172.21.15.153:0/1029969280 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x1166ae0 0x13ec3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.593+0000 7f175f16a740 1 --2- 172.21.15.153:0/1029969280 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1166710 0x13ebe90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.593+0000 7f1734ff9700 0 client.4683 ms_handle_reset on v2:172.21.15.174:6834/477398839 2024-08-17T02:26:24.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.593+0000 7f175f16a740 1 -- 172.21.15.153:0/1029969280 >> 172.21.15.153:0/1029969280 conn(0x1166eb0 msgr2=0x139dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:24.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.593+0000 7f175f16a740 1 -- 172.21.15.153:0/1029969280 shutdown_connections 2024-08-17T02:26:24.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.593+0000 7f175f16a740 1 -- 172.21.15.153:0/1029969280 wait complete. 2024-08-17T02:26:24.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.593+0000 7f175f16a740 20 client.4683 trim_cache size 0 max 16384 2024-08-17T02:26:24.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.613+0000 7f175f16a740 1 Processor -- start 2024-08-17T02:26:24.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.613+0000 7f175f16a740 1 -- start start 2024-08-17T02:26:24.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.617+0000 7f175f16a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x1166710 0x13a6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.617+0000 7f175f16a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1166ae0 0x13a6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.617+0000 7f175f16a740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x11b1790 0x13a5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.617+0000 7f175f16a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x12d89c0 con 0x1166ae0 2024-08-17T02:26:24.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.617+0000 7f175f16a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x12e6570 con 0x1166710 2024-08-17T02:26:24.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.617+0000 7f175f16a740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x130a650 con 0x11b1790 2024-08-17T02:26:24.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.617+0000 7f1755d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1166ae0 0x13a6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.617+0000 7f1755d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1166ae0 0x13a6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51514/0 (socket says 172.21.15.153:51514) 2024-08-17T02:26:24.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.617+0000 7f1755d9b700 1 -- 172.21.15.153:0/282940553 learned_addr learned my addr 172.21.15.153:0/282940553 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:24.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.617+0000 7f175659c700 1 --2- 172.21.15.153:0/282940553 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x1166710 0x13a6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.617+0000 7f1756d9d700 1 --2- 172.21.15.153:0/282940553 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x11b1790 0x13a5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.617+0000 7f1755d9b700 1 -- 172.21.15.153:0/282940553 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x11b1790 msgr2=0x13a5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:24.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.617+0000 7f1755d9b700 1 --2- 172.21.15.153:0/282940553 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x11b1790 0x13a5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.617+0000 7f1755d9b700 1 -- 172.21.15.153:0/282940553 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x1166710 msgr2=0x13a6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:24.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.617+0000 7f1755d9b700 1 --2- 172.21.15.153:0/282940553 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x1166710 0x13a6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.617+0000 7f1755d9b700 1 -- 172.21.15.153:0/282940553 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x12c2d80 con 0x1166ae0 2024-08-17T02:26:24.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.617+0000 7f1756d9d700 1 --2- 172.21.15.153:0/282940553 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x11b1790 0x13a5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:24.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.617+0000 7f1755d9b700 1 --2- 172.21.15.153:0/282940553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1166ae0 0x13a6d80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1750008010 tx=0x7f175001c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a51a39fc2564407 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:24.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.617+0000 7f1737fff700 1 -- 172.21.15.153:0/282940553 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175002c0b0 con 0x1166ae0 2024-08-17T02:26:24.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.617+0000 7f1737fff700 1 -- 172.21.15.153:0/282940553 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175002c210 con 0x1166ae0 2024-08-17T02:26:24.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.617+0000 7f1737fff700 1 -- 172.21.15.153:0/282940553 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1750017be0 con 0x1166ae0 2024-08-17T02:26:24.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.617+0000 7f175f16a740 1 -- 172.21.15.153:0/282940553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1166ae0 msgr2=0x13a6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.617+0000 7f175f16a740 1 --2- 172.21.15.153:0/282940553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1166ae0 0x13a6d80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1750008010 tx=0x7f175001c040 comp rx=0 tx=0).stop 2024-08-17T02:26:24.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.617+0000 7f175f16a740 1 -- 172.21.15.153:0/282940553 shutdown_connections 2024-08-17T02:26:24.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.617+0000 7f175f16a740 1 --2- 172.21.15.153:0/282940553 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x11b1790 0x13a5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.617+0000 7f175f16a740 1 --2- 172.21.15.153:0/282940553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1166ae0 0x13a6d80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.617+0000 7f175f16a740 1 --2- 172.21.15.153:0/282940553 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x1166710 0x13a6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.617+0000 7f175f16a740 1 -- 172.21.15.153:0/282940553 >> 172.21.15.153:0/282940553 conn(0x1166eb0 msgr2=0x13c68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:24.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.617+0000 7f175f16a740 1 -- 172.21.15.153:0/282940553 shutdown_connections 2024-08-17T02:26:24.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.617+0000 7f175f16a740 1 -- 172.21.15.153:0/282940553 wait complete. 2024-08-17T02:26:24.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.617+0000 7f175f16a740 1 -- start start 2024-08-17T02:26:24.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.617+0000 7f175f16a740 1 Processor -- start 2024-08-17T02:26:24.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.621+0000 7f175f16a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x1166710 0x13a6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.621+0000 7f175f16a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1166ae0 0x13f83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.621+0000 7f175f16a740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x11b1790 0x13f8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.621+0000 7f175f16a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x11e3650 con 0x1166ae0 2024-08-17T02:26:24.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.621+0000 7f175f16a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x11df7c0 con 0x1166710 2024-08-17T02:26:24.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.621+0000 7f175f16a740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x1314da0 con 0x11b1790 2024-08-17T02:26:24.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.621+0000 7f175f16a740 10 client.0 _ll_register_callbacks cb 0x11329d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:26:24.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.621+0000 7f1755d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1166ae0 0x13f83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.621+0000 7f1755d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1166ae0 0x13f83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51518/0 (socket says 172.21.15.153:51518) 2024-08-17T02:26:24.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.621+0000 7f1755d9b700 1 -- 172.21.15.153:0/2529679784 learned_addr learned my addr 172.21.15.153:0/2529679784 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:24.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.621+0000 7f175659c700 1 --2- 172.21.15.153:0/2529679784 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x1166710 0x13a6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.621+0000 7f1756d9d700 1 --2- 172.21.15.153:0/2529679784 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x11b1790 0x13f8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.621+0000 7f1755d9b700 1 -- 172.21.15.153:0/2529679784 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x11b1790 msgr2=0x13f8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:24.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.621+0000 7f1755d9b700 1 --2- 172.21.15.153:0/2529679784 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x11b1790 0x13f8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.621+0000 7f1755d9b700 1 -- 172.21.15.153:0/2529679784 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x1166710 msgr2=0x13a6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:24.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.621+0000 7f1755d9b700 1 --2- 172.21.15.153:0/2529679784 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x1166710 0x13a6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.621+0000 7f1755d9b700 1 -- 172.21.15.153:0/2529679784 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f175002c870 con 0x1166ae0 2024-08-17T02:26:24.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.621+0000 7f1755d9b700 1 --2- 172.21.15.153:0/2529679784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1166ae0 0x13f83d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1758068770 tx=0x7f175002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d3be9619bbefbf8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:24.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.621+0000 7f1734ff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-17T02:26:24.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.621+0000 7f1734ff9700 1 -- 172.21.15.153:0/2529679784 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1750017dc0 con 0x1166ae0 2024-08-17T02:26:24.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.621+0000 7f1734ff9700 1 -- 172.21.15.153:0/2529679784 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1750029430 con 0x1166ae0 2024-08-17T02:26:24.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.621+0000 7f175f16a740 1 -- 172.21.15.153:0/2529679784 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1740000c90 con 0x1166ae0 2024-08-17T02:26:24.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.621+0000 7f1734ff9700 1 -- 172.21.15.153:0/2529679784 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1750029800 con 0x1166ae0 2024-08-17T02:26:24.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.621+0000 7f175f16a740 10 client.4689 fetch_fsmap learned FSMap version 6 2024-08-17T02:26:24.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.621+0000 7f175f16a740 1 -- 172.21.15.153:0/2529679784 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x12b7130 con 0x1166ae0 2024-08-17T02:26:24.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.621+0000 7f1734ff9700 1 -- 172.21.15.153:0/2529679784 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1740000c90 con 0x1166ae0 2024-08-17T02:26:24.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.621+0000 7f1734ff9700 1 -- 172.21.15.153:0/2529679784 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 6) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1750029960 con 0x1166ae0 2024-08-17T02:26:24.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.621+0000 7f175f16a740 10 client.4689 fetch_fsmap finished waiting for FSMap version 6 2024-08-17T02:26:24.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.621+0000 7f175f16a740 10 client.4689 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-17T02:26:24.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.621+0000 7f175f16a740 20 client.4689 populate_metadata read hostname 'smithi153' 2024-08-17T02:26:24.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.621+0000 7f175f16a740 1 --2- 172.21.15.153:0/2529679784 >> [v2:172.21.15.174:6834/477398839,v1:172.21.15.174:6835/477398839] conn(0x13f8e50 0x1443510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.621+0000 7f175f16a740 4 client.4689 mds_command: new command op to 4291 tid=0[{"prefix": "status"}] 2024-08-17T02:26:24.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.621+0000 7f175f16a740 1 -- 172.21.15.153:0/2529679784 --> [v2:172.21.15.174:6834/477398839,v1:172.21.15.174:6835/477398839] -- command(tid 0: {"prefix": "status"}) v1 -- 0x11e3260 con 0x13f8e50 2024-08-17T02:26:24.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.621+0000 7f175659c700 1 --2- 172.21.15.153:0/2529679784 >> [v2:172.21.15.174:6834/477398839,v1:172.21.15.174:6835/477398839] conn(0x13f8e50 0x1443510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.625+0000 7f1734ff9700 10 client.4689 ms_handle_connect on v2:172.21.15.174:6834/477398839 2024-08-17T02:26:24.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.625+0000 7f175659c700 1 --2- 172.21.15.153:0/2529679784 >> [v2:172.21.15.174:6834/477398839,v1:172.21.15.174:6835/477398839] conn(0x13f8e50 0x1443510 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b1337d92924dbfc server_cookie=4cdea16624f32eee in_seq=0 out_seq=0 2024-08-17T02:26:24.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.625+0000 7f1734ff9700 1 -- 172.21.15.153:0/2529679784 <== mds.0 v2:172.21.15.174:6834/477398839 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x11e3260 con 0x13f8e50 2024-08-17T02:26:24.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.625+0000 7f1734ff9700 10 client.4689 handle_command_reply: tid=0 2024-08-17T02:26:24.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.625+0000 7f175f16a740 1 client.4689 shutdown 2024-08-17T02:26:24.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.625+0000 7f175f16a740 1 -- 172.21.15.153:0/2529679784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1166ae0 msgr2=0x13f83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.625+0000 7f175f16a740 1 --2- 172.21.15.153:0/2529679784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1166ae0 0x13f83d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1758068770 tx=0x7f175002e000 comp rx=0 tx=0).stop 2024-08-17T02:26:24.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.625+0000 7f175f16a740 1 -- 172.21.15.153:0/2529679784 shutdown_connections 2024-08-17T02:26:24.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.625+0000 7f175f16a740 1 --2- 172.21.15.153:0/2529679784 >> [v2:172.21.15.174:6834/477398839,v1:172.21.15.174:6835/477398839] conn(0x13f8e50 0x1443510 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.625+0000 7f175f16a740 1 --2- 172.21.15.153:0/2529679784 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x11b1790 0x13f8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.625+0000 7f175f16a740 1 --2- 172.21.15.153:0/2529679784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1166ae0 0x13f83d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.625+0000 7f175f16a740 1 --2- 172.21.15.153:0/2529679784 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x1166710 0x13a6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.625+0000 7f1734ff9700 0 client.4689 ms_handle_reset on v2:172.21.15.174:6834/477398839 2024-08-17T02:26:24.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.625+0000 7f175f16a740 1 -- 172.21.15.153:0/2529679784 >> 172.21.15.153:0/2529679784 conn(0x1166eb0 msgr2=0x139dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:24.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.625+0000 7f175f16a740 1 -- 172.21.15.153:0/2529679784 shutdown_connections 2024-08-17T02:26:24.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.625+0000 7f175f16a740 1 -- 172.21.15.153:0/2529679784 wait complete. 2024-08-17T02:26:24.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.625+0000 7f175f16a740 20 client.4689 trim_cache size 0 max 16384 2024-08-17T02:26:24.633 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-08-17T02:26:24.633 INFO:teuthology.orchestra.run.smithi153.stdout: "cluster_fsid": "56d41c33-b929-456d-96be-2aac4ecd299d", 2024-08-17T02:26:24.633 INFO:teuthology.orchestra.run.smithi153.stdout: "whoami": 0, 2024-08-17T02:26:24.633 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 4291, 2024-08-17T02:26:24.633 INFO:teuthology.orchestra.run.smithi153.stdout: "want_state": "up:active", 2024-08-17T02:26:24.633 INFO:teuthology.orchestra.run.smithi153.stdout: "state": "up:active", 2024-08-17T02:26:24.633 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs", 2024-08-17T02:26:24.633 INFO:teuthology.orchestra.run.smithi153.stdout: "rank_uptime": 11.865624733000001, 2024-08-17T02:26:24.634 INFO:teuthology.orchestra.run.smithi153.stdout: "mdsmap_epoch": 6, 2024-08-17T02:26:24.634 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch": 21, 2024-08-17T02:26:24.634 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch_barrier": 21, 2024-08-17T02:26:24.634 INFO:teuthology.orchestra.run.smithi153.stdout: "uptime": 19.251027986 2024-08-17T02:26:24.634 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-08-17T02:26:24.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.625+0000 7f175759e700 1 -- 172.21.15.153:0/1631849577 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1738060860 msgr2=0x7f1738062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.625+0000 7f175759e700 1 --2- 172.21.15.153:0/1631849577 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1738060860 0x7f1738062d10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1750009fd0 tx=0x7f17500097e0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.625+0000 7f175759e700 1 -- 172.21.15.153:0/1631849577 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f175813fa40 msgr2=0x7f1758068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.625+0000 7f175759e700 1 --2- 172.21.15.153:0/1631849577 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f175813fa40 0x7f1758068a40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f174800c850 tx=0x7f1748008040 comp rx=0 tx=0).stop 2024-08-17T02:26:24.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.625+0000 7f175759e700 1 -- 172.21.15.153:0/1631849577 shutdown_connections 2024-08-17T02:26:24.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.625+0000 7f175759e700 1 --2- 172.21.15.153:0/1631849577 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1738060860 0x7f1738062d10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.625+0000 7f175759e700 1 --2- 172.21.15.153:0/1631849577 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f175813fa40 0x7f1758068a40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.625+0000 7f175759e700 1 --2- 172.21.15.153:0/1631849577 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f175813f670 0x7f175813a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.625+0000 7f175759e700 1 --2- 172.21.15.153:0/1631849577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17580ae340 0x7f1758158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.625+0000 7f175759e700 1 -- 172.21.15.153:0/1631849577 >> 172.21.15.153:0/1631849577 conn(0x7f17580ca2b0 msgr2=0x7f17580cc100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:24.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.625+0000 7f175759e700 1 -- 172.21.15.153:0/1631849577 shutdown_connections 2024-08-17T02:26:24.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.625+0000 7f175759e700 1 -- 172.21.15.153:0/1631849577 wait complete. 2024-08-17T02:26:24.643 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-08-17T02:26:24.669 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-08-17T02:26:24.670 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-08-17T02:26:24.670 INFO:tasks.ceph_fuse:client.0 config is {} 2024-08-17T02:26:24.670 INFO:tasks.ceph_fuse:client.2 config is {} 2024-08-17T02:26:24.670 INFO:tasks.ceph_fuse:client.1 config is {} 2024-08-17T02:26:24.670 INFO:tasks.ceph_fuse:client.3 config is {} 2024-08-17T02:26:24.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:24.671 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2024-08-17T02:26:24.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:24.679 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link delete ceph-brx 2024-08-17T02:26:24.739 INFO:teuthology.orchestra.run.smithi174.stderr:Cannot find device "ceph-brx" 2024-08-17T02:26:24.740 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:26:24.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:24.741 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-08-17T02:26:24.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:24.749 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link delete ceph-brx 2024-08-17T02:26:24.767 INFO:teuthology.orchestra.run.smithi153.stderr:Cannot find device "ceph-brx" 2024-08-17T02:26:24.768 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:26:24.769 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-08-17T02:26:24.769 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:26:24.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.881+0000 7f0456a96700 1 Processor -- start 2024-08-17T02:26:24.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.881+0000 7f0456a96700 1 -- start start 2024-08-17T02:26:24.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.885+0000 7f0456a96700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f04500b0350 0x7f04500ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.885+0000 7f0456a96700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04500af2b0 con 0x7f045006df10 2024-08-17T02:26:24.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.885+0000 7f0456a96700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04500af590 con 0x7f0450155d20 2024-08-17T02:26:24.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.885+0000 7f0456a96700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04500b07a0 con 0x7f04500b0350 2024-08-17T02:26:24.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.885+0000 7f0456295700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f045006df10 0x7f045006e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:54646/0 (socket says 172.21.15.153:54646) 2024-08-17T02:26:24.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.885+0000 7f0456295700 1 -- 172.21.15.153:0/271953877 learned_addr learned my addr 172.21.15.153:0/271953877 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:24.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.885+0000 7f0455293700 1 --2- 172.21.15.153:0/271953877 >> v2:172.21.15.174:3300/0 conn(0x7f04500b0350 0x7f04500ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.885+0000 7f0454a92700 1 -- 172.21.15.153:0/271953877 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2781886861 0 0) 0x7f04500af2b0 con 0x7f045006df10 2024-08-17T02:26:24.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.885+0000 7f0454a92700 1 -- 172.21.15.153:0/271953877 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f043c003570 con 0x7f045006df10 2024-08-17T02:26:24.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.885+0000 7f0454a92700 1 -- 172.21.15.153:0/271953877 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1485236937 0 0) 0x7f043c003570 con 0x7f045006df10 2024-08-17T02:26:24.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.885+0000 7f0454a92700 1 -- 172.21.15.153:0/271953877 >> v2:172.21.15.174:3300/0 conn(0x7f04500b0350 msgr2=0x7f04500ad7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:24.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.885+0000 7f0454a92700 1 --2- 172.21.15.153:0/271953877 >> v2:172.21.15.174:3300/0 conn(0x7f04500b0350 0x7f04500ad7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.885+0000 7f0454a92700 1 -- 172.21.15.153:0/271953877 >> v1:172.21.15.174:6789/0 conn(0x7f0450155d20 legacy=0x7f04500aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.885+0000 7f0454a92700 1 -- 172.21.15.153:0/271953877 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04500af870 con 0x7f045006df10 2024-08-17T02:26:24.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.885+0000 7f0454a92700 1 -- 172.21.15.153:0/271953877 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3701463666 0 0) 0x7f04480017f0 con 0x7f045006df10 2024-08-17T02:26:24.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.885+0000 7f0454a92700 1 -- 172.21.15.153:0/271953877 >> v1:172.21.15.153:6789/0 conn(0x7f045006df10 legacy=0x7f045006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.885+0000 7f0454a92700 1 --2- 172.21.15.153:0/271953877 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f043c003a60 0x7f043c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.885+0000 7f0454a92700 1 --2- 172.21.15.153:0/271953877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f043c004810 0x7f043c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.885+0000 7f0454a92700 1 --2- 172.21.15.153:0/271953877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f043c0051c0 0x7f043c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.885+0000 7f0454a92700 1 -- 172.21.15.153:0/271953877 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c00c0a0 con 0x7f043c0051c0 2024-08-17T02:26:24.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.885+0000 7f0454a92700 1 -- 172.21.15.153:0/271953877 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c00c210 con 0x7f043c004810 2024-08-17T02:26:24.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.885+0000 7f0454a92700 1 -- 172.21.15.153:0/271953877 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f043c00c3d0 con 0x7f043c003a60 2024-08-17T02:26:24.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.885+0000 7f0456295700 1 --2- 172.21.15.153:0/271953877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f043c0051c0 0x7f043c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.885+0000 7f0455a94700 1 --2- 172.21.15.153:0/271953877 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f043c003a60 0x7f043c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.885+0000 7f0455293700 1 --2- 172.21.15.153:0/271953877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f043c004810 0x7f043c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.885+0000 7f0456295700 1 -- 172.21.15.153:0/271953877 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f043c003a60 msgr2=0x7f043c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:24.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.885+0000 7f0456295700 1 --2- 172.21.15.153:0/271953877 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f043c003a60 0x7f043c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.885+0000 7f0456295700 1 -- 172.21.15.153:0/271953877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f043c004810 msgr2=0x7f043c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:24.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.885+0000 7f0456295700 1 --2- 172.21.15.153:0/271953877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f043c004810 0x7f043c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.885+0000 7f0456295700 1 -- 172.21.15.153:0/271953877 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f043c003570 con 0x7f043c0051c0 2024-08-17T02:26:24.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.885+0000 7f0456295700 1 -- 172.21.15.153:0/271953877 reap_dead start 2024-08-17T02:26:24.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.885+0000 7f0456295700 1 --2- 172.21.15.153:0/271953877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f043c0051c0 0x7f043c00ba60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f044800a3e0 tx=0x7f04480021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dabc8b9335f043ff server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:24.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.885+0000 7f0454a92700 1 -- 172.21.15.153:0/271953877 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04480104a0 con 0x7f043c0051c0 2024-08-17T02:26:24.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.885+0000 7f0454a92700 1 -- 172.21.15.153:0/271953877 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0448010600 con 0x7f043c0051c0 2024-08-17T02:26:24.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.885+0000 7f0454a92700 1 -- 172.21.15.153:0/271953877 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04480109a0 con 0x7f043c0051c0 2024-08-17T02:26:24.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.885+0000 7f0456a96700 1 -- 172.21.15.153:0/271953877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f043c0051c0 msgr2=0x7f043c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.885+0000 7f0456a96700 1 --2- 172.21.15.153:0/271953877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f043c0051c0 0x7f043c00ba60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f044800a3e0 tx=0x7f04480021d0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.889+0000 7f0456a96700 1 -- 172.21.15.153:0/271953877 shutdown_connections 2024-08-17T02:26:24.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.889+0000 7f0456a96700 1 --2- 172.21.15.153:0/271953877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f043c0051c0 0x7f043c00ba60 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.889+0000 7f0456a96700 1 -- 172.21.15.153:0/271953877 >> 172.21.15.153:0/271953877 conn(0x7f04500678d0 msgr2=0x7f0450067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:24.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.889+0000 7f0456a96700 1 -- 172.21.15.153:0/271953877 shutdown_connections 2024-08-17T02:26:24.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.889+0000 7f0456a96700 1 -- 172.21.15.153:0/271953877 wait complete. 2024-08-17T02:26:24.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.889+0000 7f0456a96700 1 Processor -- start 2024-08-17T02:26:24.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.889+0000 7f0456a96700 1 -- start start 2024-08-17T02:26:24.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.889+0000 7f0456a96700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f043c0051c0 0x7f0450169fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.889+0000 7f0456a96700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0450150c30 0x7f04501510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.889+0000 7f0456a96700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04501570c0 0x7f0450157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.889+0000 7f0456a96700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04501515e0 con 0x7f043c0051c0 2024-08-17T02:26:24.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.889+0000 7f0456a96700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04500a57c0 con 0x7f04501570c0 2024-08-17T02:26:24.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.889+0000 7f0456a96700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0450157a70 con 0x7f0450150c30 2024-08-17T02:26:24.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.889+0000 7f0455a94700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f043c0051c0 0x7f0450169fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.889+0000 7f0455a94700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f043c0051c0 0x7f0450169fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51536/0 (socket says 172.21.15.153:51536) 2024-08-17T02:26:24.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.889+0000 7f0455a94700 1 -- 172.21.15.153:0/2784685465 learned_addr learned my addr 172.21.15.153:0/2784685465 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:24.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.889+0000 7f0455293700 1 --2- 172.21.15.153:0/2784685465 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0450150c30 0x7f04501510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.889+0000 7f0456295700 1 --2- 172.21.15.153:0/2784685465 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04501570c0 0x7f0450157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.889+0000 7f0455a94700 1 -- 172.21.15.153:0/2784685465 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0450150c30 msgr2=0x7f04501510a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.889+0000 7f0455a94700 1 --2- 172.21.15.153:0/2784685465 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0450150c30 0x7f04501510a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.889+0000 7f0455a94700 1 -- 172.21.15.153:0/2784685465 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04501570c0 msgr2=0x7f0450157530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.889+0000 7f0455a94700 1 --2- 172.21.15.153:0/2784685465 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04501570c0 0x7f0450157530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.889+0000 7f0455a94700 1 -- 172.21.15.153:0/2784685465 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f045016a4e0 con 0x7f043c0051c0 2024-08-17T02:26:24.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.889+0000 7f0455a94700 1 --2- 172.21.15.153:0/2784685465 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f043c0051c0 0x7f0450169fa0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f044c002950 tx=0x7f044c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:24.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.893+0000 7f0445ffb700 1 -- 172.21.15.153:0/2784685465 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c006820 con 0x7f043c0051c0 2024-08-17T02:26:24.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.893+0000 7f0445ffb700 1 -- 172.21.15.153:0/2784685465 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044c006980 con 0x7f043c0051c0 2024-08-17T02:26:24.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.893+0000 7f0456a96700 1 -- 172.21.15.153:0/2784685465 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04500a69c0 con 0x7f043c0051c0 2024-08-17T02:26:24.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.893+0000 7f0445ffb700 1 -- 172.21.15.153:0/2784685465 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c006d40 con 0x7f043c0051c0 2024-08-17T02:26:24.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.893+0000 7f0456a96700 1 -- 172.21.15.153:0/2784685465 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04500a6f80 con 0x7f043c0051c0 2024-08-17T02:26:24.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.893+0000 7f0456a96700 1 -- 172.21.15.153:0/2784685465 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04500643a0 con 0x7f043c0051c0 2024-08-17T02:26:24.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.893+0000 7f0445ffb700 1 -- 172.21.15.153:0/2784685465 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f044c007240 con 0x7f043c0051c0 2024-08-17T02:26:24.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.893+0000 7f0445ffb700 1 --2- 172.21.15.153:0/2784685465 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f0434060890 0x7f0434062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.893+0000 7f0445ffb700 1 -- 172.21.15.153:0/2784685465 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f044c07cc70 con 0x7f043c0051c0 2024-08-17T02:26:24.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.893+0000 7f0455293700 1 --2- 172.21.15.153:0/2784685465 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f0434060890 0x7f0434062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.897+0000 7f0455293700 1 --2- 172.21.15.153:0/2784685465 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f0434060890 0x7f0434062d40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0450151880 tx=0x7f04400091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:24.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:24.901+0000 7f0445ffb700 1 -- 172.21.15.153:0/2784685465 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f044c04d0c0 con 0x7f043c0051c0 2024-08-17T02:26:25.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:25.101+0000 7f0456a96700 1 -- 172.21.15.153:0/2784685465 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f045006f5f0 con 0x7f043c0051c0 2024-08-17T02:26:25.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:25.101+0000 7f0445ffb700 1 -- 172.21.15.153:0/2784685465 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f044c0506e0 con 0x7f043c0051c0 2024-08-17T02:26:25.103 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:26:25.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:25.101+0000 7f0456a96700 1 -- 172.21.15.153:0/2784685465 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f0434060890 msgr2=0x7f0434062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:25.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:25.101+0000 7f0456a96700 1 --2- 172.21.15.153:0/2784685465 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f0434060890 0x7f0434062d40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0450151880 tx=0x7f04400091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:25.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:25.101+0000 7f0456a96700 1 -- 172.21.15.153:0/2784685465 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f043c0051c0 msgr2=0x7f0450169fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:25.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:25.101+0000 7f0456a96700 1 --2- 172.21.15.153:0/2784685465 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f043c0051c0 0x7f0450169fa0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f044c002950 tx=0x7f044c007d30 comp rx=0 tx=0).stop 2024-08-17T02:26:25.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:25.101+0000 7f0456a96700 1 -- 172.21.15.153:0/2784685465 shutdown_connections 2024-08-17T02:26:25.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:25.101+0000 7f0456a96700 1 --2- 172.21.15.153:0/2784685465 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f0434060890 0x7f0434062d40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:25.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:25.101+0000 7f0456a96700 1 --2- 172.21.15.153:0/2784685465 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04501570c0 0x7f0450157530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:25.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:25.101+0000 7f0456a96700 1 --2- 172.21.15.153:0/2784685465 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0450150c30 0x7f04501510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:25.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:25.101+0000 7f0456a96700 1 --2- 172.21.15.153:0/2784685465 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f043c0051c0 0x7f0450169fa0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:25.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:25.101+0000 7f0456a96700 1 -- 172.21.15.153:0/2784685465 >> 172.21.15.153:0/2784685465 conn(0x7f04500678d0 msgr2=0x7f045006a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:25.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:25.101+0000 7f0456a96700 1 -- 172.21.15.153:0/2784685465 shutdown_connections 2024-08-17T02:26:25.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:25.101+0000 7f0456a96700 1 -- 172.21.15.153:0/2784685465 wait complete. 2024-08-17T02:26:25.118 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:26:25.118 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:26:25.118 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2024-08-17T02:26:25.118 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:26:25.118 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:25.118 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:26:25.118 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:26:25.118 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:26:25.118 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:26:25.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:25.119 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2024-08-17T02:26:25.126 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:25.126 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:25.126 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:25.126 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:25.127 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:25.127 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:25.127 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:25.127 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:25.127 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:25.127 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:25.127 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:25.127 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:25.127 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:26:25.127 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:25.127 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-08-17T02:26:25.127 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42556sec preferred_lft 42556sec 2024-08-17T02:26:25.127 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link 2024-08-17T02:26:25.128 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:25.128 INFO:teuthology.orchestra.run.smithi153.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-17T02:26:25.128 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 02:42:ca:5f:b2:93 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:25.128 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-17T02:26:25.128 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:25.128 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:26:25.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:25.128 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2024-08-17T02:26:25.129 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-08-17T02:26:25.129 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:26:25.129 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip addr flush dev ceph-brx 2024-08-17T02:26:25.129 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set ceph-brx up 2024-08-17T02:26:25.129 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:26:25.129 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-08-17T02:26:25.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:25.167 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:26:25.225 INFO:teuthology.orchestra.run.smithi153.stdout:1 2024-08-17T02:26:25.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:25.226 DEBUG:teuthology.orchestra.run.smithi153:> route 2024-08-17T02:26:25.257 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2024-08-17T02:26:25.257 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:26:25.257 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-08-17T02:26:25.257 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:26:25.257 INFO:teuthology.orchestra.run.smithi153.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-17T02:26:25.257 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-08-17T02:26:25.257 INFO:teuthology.orchestra.run.smithi153.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-17T02:26:25.257 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:26:25.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:25.258 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2024-08-17T02:26:25.258 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-08-17T02:26:25.258 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:26:25.258 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:26:25.258 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:26:25.258 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-08-17T02:26:25.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:25.299 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-08-17T02:26:25.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:25.349 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list-id 2024-08-17T02:26:25.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:25.357 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2024-08-17T02:26:25.357 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-08-17T02:26:25.357 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:26:25.357 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-17T02:26:25.357 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-08-17T02:26:25.427 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-17T02:26:25.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:25.427 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2024-08-17T02:26:25.428 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-08-17T02:26:25.428 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-17T02:26:25.428 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:26:25.428 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-17T02:26:25.428 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-17T02:26:25.428 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-17T02:26:25.428 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-08-17T02:26:25.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:25.513 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2024-08-17T02:26:25.513 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-08-17T02:26:25.513 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2024-08-17T02:26:25.513 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:26:25.513 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-08-17T02:26:25.543 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-08-17T02:26:25.543 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:25.543 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:25.548 INFO:teuthology.orchestra.run.smithi153.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:26:25.548 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:25.548 DEBUG:teuthology.orchestra.run.smithi153:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:25.553 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-08-17T02:26:25.565 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:25.566 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:25.626 INFO:teuthology.orchestra.run.smithi153.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:25.626 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:25.627 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:25.627 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-08-17T02:26:25.634 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-17T02:26:25.634 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-08-17T02:26:25.637 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-08-17T02:26:25.652 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:25.652 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:25.709 INFO:teuthology.orchestra.run.smithi153.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:25.710 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:25.710 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:25.710 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-08-17T02:26:25.719 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi153.stderr:2024-08-17T02:26:25.717+0000 7f140298b380 -1 init, newargv = 0x55b244026ac0 newargc=15 2024-08-17T02:26:25.719 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi153.stderr:ceph-fuse[30776]: starting ceph client 2024-08-17T02:26:25.728 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi153.stderr:ceph-fuse[30776]: starting fuse 2024-08-17T02:26:26.816 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-08-17T02:26:26.834 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:26.834 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:26.896 INFO:teuthology.orchestra.run.smithi153.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:26.897 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:26.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:26.898 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-08-17T02:26:26.905 INFO:teuthology.orchestra.run.smithi153.stdout:52 2024-08-17T02:26:26.905 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-08-17T02:26:26.905 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-17T02:26:26.905 DEBUG:teuthology.orchestra.run.smithi153:> import glob 2024-08-17T02:26:26.905 DEBUG:teuthology.orchestra.run.smithi153:> import re 2024-08-17T02:26:26.906 DEBUG:teuthology.orchestra.run.smithi153:> import os 2024-08-17T02:26:26.906 DEBUG:teuthology.orchestra.run.smithi153:> import subprocess 2024-08-17T02:26:26.906 DEBUG:teuthology.orchestra.run.smithi153:> 2024-08-17T02:26:26.906 DEBUG:teuthology.orchestra.run.smithi153:> def _find_admin_socket(client_name): 2024-08-17T02:26:26.906 DEBUG:teuthology.orchestra.run.smithi153:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-08-17T02:26:26.906 DEBUG:teuthology.orchestra.run.smithi153:> files = glob.glob(asok_path) 2024-08-17T02:26:26.906 DEBUG:teuthology.orchestra.run.smithi153:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-08-17T02:26:26.906 DEBUG:teuthology.orchestra.run.smithi153:> 2024-08-17T02:26:26.906 DEBUG:teuthology.orchestra.run.smithi153:> # Given a non-glob path, it better be there 2024-08-17T02:26:26.906 DEBUG:teuthology.orchestra.run.smithi153:> if "*" not in asok_path: 2024-08-17T02:26:26.906 DEBUG:teuthology.orchestra.run.smithi153:> assert(len(files) == 1) 2024-08-17T02:26:26.906 DEBUG:teuthology.orchestra.run.smithi153:> return files[0] 2024-08-17T02:26:26.906 DEBUG:teuthology.orchestra.run.smithi153:> 2024-08-17T02:26:26.906 DEBUG:teuthology.orchestra.run.smithi153:> for f in files: 2024-08-17T02:26:26.907 DEBUG:teuthology.orchestra.run.smithi153:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-17T02:26:26.907 DEBUG:teuthology.orchestra.run.smithi153:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-17T02:26:26.907 DEBUG:teuthology.orchestra.run.smithi153:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-17T02:26:26.907 DEBUG:teuthology.orchestra.run.smithi153:> contents = proc_f.read() 2024-08-17T02:26:26.907 DEBUG:teuthology.orchestra.run.smithi153:> if mountpoint in contents: 2024-08-17T02:26:26.907 DEBUG:teuthology.orchestra.run.smithi153:> return f 2024-08-17T02:26:26.907 DEBUG:teuthology.orchestra.run.smithi153:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-17T02:26:26.907 DEBUG:teuthology.orchestra.run.smithi153:> 2024-08-17T02:26:26.907 DEBUG:teuthology.orchestra.run.smithi153:> print(_find_admin_socket("client.0")) 2024-08-17T02:26:26.907 DEBUG:teuthology.orchestra.run.smithi153:> ' 2024-08-17T02:26:26.981 INFO:teuthology.orchestra.run.smithi153.stdout:/var/run/ceph/ceph-client.0.30776.asok 2024-08-17T02:26:27.172 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.30776.asok 2024-08-17T02:26:27.172 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:27.173 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.30776.asok status 2024-08-17T02:26:27.308 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-08-17T02:26:27.308 INFO:teuthology.orchestra.run.smithi153.stdout: "metadata": { 2024-08-17T02:26:27.308 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_sha1": "2577e8139c6b8786f9d6d6ea21b8da9244b9260e", 2024-08-17T02:26:27.308 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_version": "ceph version 17.2.7-1375-g2577e813 (2577e8139c6b8786f9d6d6ea21b8da9244b9260e) quincy (stable)", 2024-08-17T02:26:27.308 INFO:teuthology.orchestra.run.smithi153.stdout: "entity_id": "0", 2024-08-17T02:26:27.308 INFO:teuthology.orchestra.run.smithi153.stdout: "hostname": "smithi153", 2024-08-17T02:26:27.308 INFO:teuthology.orchestra.run.smithi153.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-08-17T02:26:27.309 INFO:teuthology.orchestra.run.smithi153.stdout: "pid": "30776", 2024-08-17T02:26:27.309 INFO:teuthology.orchestra.run.smithi153.stdout: "root": "/" 2024-08-17T02:26:27.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-17T02:26:27.309 INFO:teuthology.orchestra.run.smithi153.stdout: "dentry_count": 0, 2024-08-17T02:26:27.309 INFO:teuthology.orchestra.run.smithi153.stdout: "dentry_pinned_count": 0, 2024-08-17T02:26:27.309 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 4511, 2024-08-17T02:26:27.309 INFO:teuthology.orchestra.run.smithi153.stdout: "inst": { 2024-08-17T02:26:27.309 INFO:teuthology.orchestra.run.smithi153.stdout: "name": { 2024-08-17T02:26:27.309 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "client", 2024-08-17T02:26:27.309 INFO:teuthology.orchestra.run.smithi153.stdout: "num": 4511 2024-08-17T02:26:27.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-17T02:26:27.309 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": { 2024-08-17T02:26:27.309 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "v1", 2024-08-17T02:26:27.309 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": "172.21.15.153:0", 2024-08-17T02:26:27.310 INFO:teuthology.orchestra.run.smithi153.stdout: "nonce": 2226059092 2024-08-17T02:26:27.310 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-17T02:26:27.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-17T02:26:27.310 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": { 2024-08-17T02:26:27.310 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "v1", 2024-08-17T02:26:27.310 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": "172.21.15.153:0", 2024-08-17T02:26:27.310 INFO:teuthology.orchestra.run.smithi153.stdout: "nonce": 2226059092 2024-08-17T02:26:27.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-17T02:26:27.310 INFO:teuthology.orchestra.run.smithi153.stdout: "inst_str": "client.4511 172.21.15.153:0/2226059092", 2024-08-17T02:26:27.310 INFO:teuthology.orchestra.run.smithi153.stdout: "addr_str": "172.21.15.153:0/2226059092", 2024-08-17T02:26:27.310 INFO:teuthology.orchestra.run.smithi153.stdout: "inode_count": 1, 2024-08-17T02:26:27.310 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_epoch": 6, 2024-08-17T02:26:27.310 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_epoch": 21, 2024-08-17T02:26:27.311 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_epoch_barrier": 0, 2024-08-17T02:26:27.311 INFO:teuthology.orchestra.run.smithi153.stdout: "blocklisted": false, 2024-08-17T02:26:27.311 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs" 2024-08-17T02:26:27.311 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-08-17T02:26:27.317 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:26:27.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.425+0000 7f9c6a475700 1 Processor -- start 2024-08-17T02:26:27.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.425+0000 7f9c6a475700 1 -- start start 2024-08-17T02:26:27.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.425+0000 7f9c6a475700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9c640af030 0x7f9c640a9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.425+0000 7f9c6a475700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c641598a0 0x7f9c640b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.425+0000 7f9c6a475700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c640b00d0 con 0x7f9c640a8f50 2024-08-17T02:26:27.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.425+0000 7f9c6a475700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c640b11b0 con 0x7f9c640af030 2024-08-17T02:26:27.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.425+0000 7f9c6a475700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c64159d40 con 0x7f9c641598a0 2024-08-17T02:26:27.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.425+0000 7f9c637fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9c640af030 0x7f9c640a9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.425+0000 7f9c637fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9c640af030 0x7f9c640a9320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51540/0 (socket says 172.21.15.153:51540) 2024-08-17T02:26:27.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.425+0000 7f9c637fe700 1 -- 172.21.15.153:0/3401268962 learned_addr learned my addr 172.21.15.153:0/3401268962 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:27.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.425+0000 7f9c68a12700 1 --2- 172.21.15.153:0/3401268962 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c641598a0 0x7f9c640b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.425+0000 7f9c637fe700 1 -- 172.21.15.153:0/3401268962 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c641598a0 msgr2=0x7f9c640b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:27.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.425+0000 7f9c637fe700 1 --2- 172.21.15.153:0/3401268962 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c641598a0 0x7f9c640b0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.425+0000 7f9c637fe700 1 -- 172.21.15.153:0/3401268962 >> v1:172.21.15.174:6789/0 conn(0x7f9c640a8f50 legacy=0x7f9c640b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:27.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.425+0000 7f9c637fe700 1 -- 172.21.15.153:0/3401268962 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c640af4c0 con 0x7f9c640af030 2024-08-17T02:26:27.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.425+0000 7f9c637fe700 1 --2- 172.21.15.153:0/3401268962 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c640af030 0x7f9c640a9320 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9c540099b0 tx=0x7f9c54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21a3db21127fe058 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:27.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.425+0000 7f9c62ffd700 1 -- 172.21.15.153:0/3401268962 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5400b860 con 0x7f9c640af030 2024-08-17T02:26:27.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.425+0000 7f9c62ffd700 1 -- 172.21.15.153:0/3401268962 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5400b9c0 con 0x7f9c640af030 2024-08-17T02:26:27.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.425+0000 7f9c62ffd700 1 -- 172.21.15.153:0/3401268962 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5400bd60 con 0x7f9c640af030 2024-08-17T02:26:27.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.425+0000 7f9c6a475700 1 -- 172.21.15.153:0/3401268962 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c640af030 msgr2=0x7f9c640a9320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.425+0000 7f9c6a475700 1 --2- 172.21.15.153:0/3401268962 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c640af030 0x7f9c640a9320 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9c540099b0 tx=0x7f9c54009250 comp rx=0 tx=0).stop 2024-08-17T02:26:27.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.425+0000 7f9c6a475700 1 -- 172.21.15.153:0/3401268962 shutdown_connections 2024-08-17T02:26:27.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.425+0000 7f9c6a475700 1 --2- 172.21.15.153:0/3401268962 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c641598a0 0x7f9c640b0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.425+0000 7f9c6a475700 1 --2- 172.21.15.153:0/3401268962 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c640af030 0x7f9c640a9320 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.425+0000 7f9c6a475700 1 -- 172.21.15.153:0/3401268962 >> 172.21.15.153:0/3401268962 conn(0x7f9c64066e00 msgr2=0x7f9c64067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:27.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.425+0000 7f9c6a475700 1 -- 172.21.15.153:0/3401268962 shutdown_connections 2024-08-17T02:26:27.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.425+0000 7f9c6a475700 1 -- 172.21.15.153:0/3401268962 wait complete. 2024-08-17T02:26:27.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.429+0000 7f9c6a475700 1 Processor -- start 2024-08-17T02:26:27.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.429+0000 7f9c6a475700 1 -- start start 2024-08-17T02:26:27.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.429+0000 7f9c6a475700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c640a8f50 0x7f9c64134540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.429+0000 7f9c6a475700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c640af030 0x7f9c64098ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.429+0000 7f9c6a475700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c641598a0 0x7f9c64099020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.429+0000 7f9c6a475700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c64098150 con 0x7f9c640a8f50 2024-08-17T02:26:27.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.429+0000 7f9c6a475700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c64142c40 con 0x7f9c640af030 2024-08-17T02:26:27.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.429+0000 7f9c6a475700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c640acf00 con 0x7f9c641598a0 2024-08-17T02:26:27.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.429+0000 7f9c63fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c640a8f50 0x7f9c64134540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.429+0000 7f9c63fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c640a8f50 0x7f9c64134540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51548/0 (socket says 172.21.15.153:51548) 2024-08-17T02:26:27.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.429+0000 7f9c63fff700 1 -- 172.21.15.153:0/3896160421 learned_addr learned my addr 172.21.15.153:0/3896160421 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:27.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.429+0000 7f9c68a12700 1 --2- 172.21.15.153:0/3896160421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c641598a0 0x7f9c64099020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.429+0000 7f9c637fe700 1 --2- 172.21.15.153:0/3896160421 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c640af030 0x7f9c64098ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.429+0000 7f9c63fff700 1 -- 172.21.15.153:0/3896160421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c641598a0 msgr2=0x7f9c64099020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.429+0000 7f9c63fff700 1 --2- 172.21.15.153:0/3896160421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c641598a0 0x7f9c64099020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.429+0000 7f9c63fff700 1 -- 172.21.15.153:0/3896160421 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c640af030 msgr2=0x7f9c64098ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.429+0000 7f9c63fff700 1 --2- 172.21.15.153:0/3896160421 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c640af030 0x7f9c64098ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.429+0000 7f9c63fff700 1 -- 172.21.15.153:0/3896160421 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c540094f0 con 0x7f9c640a8f50 2024-08-17T02:26:27.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.429+0000 7f9c63fff700 1 --2- 172.21.15.153:0/3896160421 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c640a8f50 0x7f9c64134540 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9c5800c790 tx=0x7f9c58007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:27.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.433+0000 7f9c4bfff700 1 -- 172.21.15.153:0/3896160421 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c58011590 con 0x7f9c640a8f50 2024-08-17T02:26:27.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.433+0000 7f9c4bfff700 1 -- 172.21.15.153:0/3896160421 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c58011710 con 0x7f9c640a8f50 2024-08-17T02:26:27.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.433+0000 7f9c6a475700 1 -- 172.21.15.153:0/3896160421 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c64142960 con 0x7f9c640a8f50 2024-08-17T02:26:27.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.433+0000 7f9c4bfff700 1 -- 172.21.15.153:0/3896160421 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c58011ad0 con 0x7f9c640a8f50 2024-08-17T02:26:27.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.433+0000 7f9c6a475700 1 -- 172.21.15.153:0/3896160421 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c640ac8b0 con 0x7f9c640a8f50 2024-08-17T02:26:27.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.433+0000 7f9c6a475700 1 -- 172.21.15.153:0/3896160421 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c640645c0 con 0x7f9c640a8f50 2024-08-17T02:26:27.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.433+0000 7f9c4bfff700 1 -- 172.21.15.153:0/3896160421 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9c5801b3b0 con 0x7f9c640a8f50 2024-08-17T02:26:27.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.433+0000 7f9c4bfff700 1 --2- 172.21.15.153:0/3896160421 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9c50060860 0x7f9c50062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.437+0000 7f9c637fe700 1 --2- 172.21.15.153:0/3896160421 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9c50060860 0x7f9c50062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.437+0000 7f9c4bfff700 1 -- 172.21.15.153:0/3896160421 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9c5807bf40 con 0x7f9c640a8f50 2024-08-17T02:26:27.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.437+0000 7f9c637fe700 1 --2- 172.21.15.153:0/3896160421 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9c50060860 0x7f9c50062d10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9c540099b0 tx=0x7f9c54017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:27.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.441+0000 7f9c4bfff700 1 -- 172.21.15.153:0/3896160421 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f9c5804c390 con 0x7f9c640a8f50 2024-08-17T02:26:27.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.641+0000 7f9c6a475700 1 -- 172.21.15.153:0/3896160421 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9c6406f360 con 0x7f9c640a8f50 2024-08-17T02:26:27.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.641+0000 7f9c4bfff700 1 -- 172.21.15.153:0/3896160421 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9c58017020 con 0x7f9c640a8f50 2024-08-17T02:26:27.644 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:26:27.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.641+0000 7f9c6a475700 1 -- 172.21.15.153:0/3896160421 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9c50060860 msgr2=0x7f9c50062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.641+0000 7f9c6a475700 1 --2- 172.21.15.153:0/3896160421 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9c50060860 0x7f9c50062d10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9c540099b0 tx=0x7f9c54017000 comp rx=0 tx=0).stop 2024-08-17T02:26:27.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.641+0000 7f9c6a475700 1 -- 172.21.15.153:0/3896160421 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c640a8f50 msgr2=0x7f9c64134540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.641+0000 7f9c6a475700 1 --2- 172.21.15.153:0/3896160421 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c640a8f50 0x7f9c64134540 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9c5800c790 tx=0x7f9c58007f40 comp rx=0 tx=0).stop 2024-08-17T02:26:27.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.641+0000 7f9c6a475700 1 -- 172.21.15.153:0/3896160421 shutdown_connections 2024-08-17T02:26:27.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.641+0000 7f9c6a475700 1 --2- 172.21.15.153:0/3896160421 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9c50060860 0x7f9c50062d10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.641+0000 7f9c6a475700 1 --2- 172.21.15.153:0/3896160421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c641598a0 0x7f9c64099020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.641+0000 7f9c6a475700 1 --2- 172.21.15.153:0/3896160421 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c640af030 0x7f9c64098ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.641+0000 7f9c6a475700 1 --2- 172.21.15.153:0/3896160421 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c640a8f50 0x7f9c64134540 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.641+0000 7f9c6a475700 1 -- 172.21.15.153:0/3896160421 >> 172.21.15.153:0/3896160421 conn(0x7f9c64066e00 msgr2=0x7f9c640671d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:27.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.641+0000 7f9c6a475700 1 -- 172.21.15.153:0/3896160421 shutdown_connections 2024-08-17T02:26:27.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:27.645+0000 7f9c6a475700 1 -- 172.21.15.153:0/3896160421 wait complete. 2024-08-17T02:26:27.658 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:26:27.658 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:26:27.658 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2024-08-17T02:26:27.658 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-08-17T02:26:27.658 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-08-17T02:26:27.658 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:26:27.658 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:26:27.658 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:26:27.658 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:26:27.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:27.659 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2024-08-17T02:26:27.667 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:27.667 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:27.667 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:27.667 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:27.667 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:27.667 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:27.667 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:27.667 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:27.667 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:27.667 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:27.667 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:27.668 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:27.668 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:26:27.668 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:27.668 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-08-17T02:26:27.668 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42553sec preferred_lft 42553sec 2024-08-17T02:26:27.668 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link 2024-08-17T02:26:27.668 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:27.668 INFO:teuthology.orchestra.run.smithi153.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-17T02:26:27.668 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 02:42:ca:5f:b2:93 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:27.668 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-17T02:26:27.668 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:27.668 INFO:teuthology.orchestra.run.smithi153.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:26:27.668 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether a2:cf:88:b6:06:39 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:27.668 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:26:27.669 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:27.669 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::1c95:d9ff:fe34:e022/64 scope link 2024-08-17T02:26:27.669 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:27.669 INFO:teuthology.orchestra.run.smithi153.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:26:27.669 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether a2:cf:88:b6:06:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:26:27.669 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::a0cf:88ff:feb6:639/64 scope link 2024-08-17T02:26:27.669 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:27.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:27.669 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:26:27.724 INFO:teuthology.orchestra.run.smithi153.stdout:1 2024-08-17T02:26:27.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:27.727 DEBUG:teuthology.orchestra.run.smithi153:> route 2024-08-17T02:26:27.735 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2024-08-17T02:26:27.735 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:26:27.735 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-08-17T02:26:27.735 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:26:27.735 INFO:teuthology.orchestra.run.smithi153.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-17T02:26:27.736 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-08-17T02:26:27.736 INFO:teuthology.orchestra.run.smithi153.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-17T02:26:27.736 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:26:27.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:27.736 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2024-08-17T02:26:27.736 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-08-17T02:26:27.736 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:26:27.736 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:26:27.736 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:26:27.736 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-08-17T02:26:27.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:27.772 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-08-17T02:26:27.779 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:26:27.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:27.779 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list-id 2024-08-17T02:26:27.828 INFO:teuthology.orchestra.run.smithi153.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-08-17T02:26:27.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:27.829 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2024-08-17T02:26:27.830 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-08-17T02:26:27.830 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:26:27.830 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-08-17T02:26:27.830 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-08-17T02:26:27.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:27.859 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:26:27.871 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:27.871 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:27.871 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:27.871 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:27.872 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:27.872 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:27.872 INFO:teuthology.orchestra.run.smithi153.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:26:27.872 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether be:67:fe:16:0c:b5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:26:27.872 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:26:27.872 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:27.872 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::bc67:feff:fe16:cb5/64 scope link 2024-08-17T02:26:27.872 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:27.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:27.873 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:26:27.885 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:27.885 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:27.885 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:27.885 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:27.885 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:27.885 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:27.885 INFO:teuthology.orchestra.run.smithi153.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:26:27.885 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether be:67:fe:16:0c:b5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:26:27.885 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:26:27.886 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:27.886 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::bc67:feff:fe16:cb5/64 scope link 2024-08-17T02:26:27.886 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:27.887 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-08-17T02:26:27.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:27.887 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2024-08-17T02:26:27.887 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-08-17T02:26:27.887 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-08-17T02:26:27.887 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:26:27.887 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-08-17T02:26:27.887 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-08-17T02:26:27.888 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-08-17T02:26:27.888 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-08-17T02:26:27.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:27.986 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2024-08-17T02:26:27.986 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-08-17T02:26:27.986 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.1 up 2024-08-17T02:26:27.986 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:26:27.986 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-08-17T02:26:28.013 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-08-17T02:26:28.013 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:28.013 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-08-17T02:26:28.019 INFO:teuthology.orchestra.run.smithi153.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:26:28.019 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:28.019 DEBUG:teuthology.orchestra.run.smithi153:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:26:28.068 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-08-17T02:26:28.082 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:28.082 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:28.097 INFO:teuthology.orchestra.run.smithi153.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:28.098 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:28.099 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:28.099 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-08-17T02:26:28.149 INFO:teuthology.orchestra.run.smithi153.stdout:52 2024-08-17T02:26:28.149 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [52] 2024-08-17T02:26:28.149 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-08-17T02:26:28.151 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-08-17T02:26:28.167 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:28.167 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:28.179 INFO:teuthology.orchestra.run.smithi153.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:28.180 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:28.181 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:28.181 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-08-17T02:26:28.232 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi153.stderr:2024-08-17T02:26:28.229+0000 7f48e6ffb380 -1 init, newargv = 0x55eb7efcf5e0 newargc=15 2024-08-17T02:26:28.233 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi153.stderr:ceph-fuse[30919]: starting ceph client 2024-08-17T02:26:28.233 INFO:teuthology.orchestra.run.smithi153.stdout:52 2024-08-17T02:26:28.242 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi153.stderr:ceph-fuse[30919]: starting fuse 2024-08-17T02:26:29.280 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:29.282 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:29.335 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-08-17T02:26:29.353 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:29.353 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:29.409 INFO:teuthology.orchestra.run.smithi153.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:29.410 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:29.410 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:29.410 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-08-17T02:26:29.415 INFO:teuthology.orchestra.run.smithi153.stdout:52 2024-08-17T02:26:29.415 INFO:teuthology.orchestra.run.smithi153.stdout:53 2024-08-17T02:26:29.415 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52, 53] 2024-08-17T02:26:29.416 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-17T02:26:29.416 DEBUG:teuthology.orchestra.run.smithi153:> import glob 2024-08-17T02:26:29.416 DEBUG:teuthology.orchestra.run.smithi153:> import re 2024-08-17T02:26:29.416 DEBUG:teuthology.orchestra.run.smithi153:> import os 2024-08-17T02:26:29.416 DEBUG:teuthology.orchestra.run.smithi153:> import subprocess 2024-08-17T02:26:29.416 DEBUG:teuthology.orchestra.run.smithi153:> 2024-08-17T02:26:29.416 DEBUG:teuthology.orchestra.run.smithi153:> def _find_admin_socket(client_name): 2024-08-17T02:26:29.416 DEBUG:teuthology.orchestra.run.smithi153:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-08-17T02:26:29.416 DEBUG:teuthology.orchestra.run.smithi153:> files = glob.glob(asok_path) 2024-08-17T02:26:29.416 DEBUG:teuthology.orchestra.run.smithi153:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-08-17T02:26:29.416 DEBUG:teuthology.orchestra.run.smithi153:> 2024-08-17T02:26:29.416 DEBUG:teuthology.orchestra.run.smithi153:> # Given a non-glob path, it better be there 2024-08-17T02:26:29.417 DEBUG:teuthology.orchestra.run.smithi153:> if "*" not in asok_path: 2024-08-17T02:26:29.417 DEBUG:teuthology.orchestra.run.smithi153:> assert(len(files) == 1) 2024-08-17T02:26:29.417 DEBUG:teuthology.orchestra.run.smithi153:> return files[0] 2024-08-17T02:26:29.417 DEBUG:teuthology.orchestra.run.smithi153:> 2024-08-17T02:26:29.417 DEBUG:teuthology.orchestra.run.smithi153:> for f in files: 2024-08-17T02:26:29.417 DEBUG:teuthology.orchestra.run.smithi153:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-17T02:26:29.417 DEBUG:teuthology.orchestra.run.smithi153:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-17T02:26:29.417 DEBUG:teuthology.orchestra.run.smithi153:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-17T02:26:29.417 DEBUG:teuthology.orchestra.run.smithi153:> contents = proc_f.read() 2024-08-17T02:26:29.417 DEBUG:teuthology.orchestra.run.smithi153:> if mountpoint in contents: 2024-08-17T02:26:29.417 DEBUG:teuthology.orchestra.run.smithi153:> return f 2024-08-17T02:26:29.417 DEBUG:teuthology.orchestra.run.smithi153:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-17T02:26:29.417 DEBUG:teuthology.orchestra.run.smithi153:> 2024-08-17T02:26:29.417 DEBUG:teuthology.orchestra.run.smithi153:> print(_find_admin_socket("client.2")) 2024-08-17T02:26:29.417 DEBUG:teuthology.orchestra.run.smithi153:> ' 2024-08-17T02:26:29.497 INFO:teuthology.orchestra.run.smithi153.stdout:/var/run/ceph/ceph-client.2.30919.asok 2024-08-17T02:26:29.682 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.30919.asok 2024-08-17T02:26:29.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:29.683 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.30919.asok status 2024-08-17T02:26:29.822 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-08-17T02:26:29.823 INFO:teuthology.orchestra.run.smithi153.stdout: "metadata": { 2024-08-17T02:26:29.823 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_sha1": "2577e8139c6b8786f9d6d6ea21b8da9244b9260e", 2024-08-17T02:26:29.823 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_version": "ceph version 17.2.7-1375-g2577e813 (2577e8139c6b8786f9d6d6ea21b8da9244b9260e) quincy (stable)", 2024-08-17T02:26:29.823 INFO:teuthology.orchestra.run.smithi153.stdout: "entity_id": "2", 2024-08-17T02:26:29.823 INFO:teuthology.orchestra.run.smithi153.stdout: "hostname": "smithi153", 2024-08-17T02:26:29.823 INFO:teuthology.orchestra.run.smithi153.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-08-17T02:26:29.823 INFO:teuthology.orchestra.run.smithi153.stdout: "pid": "30919", 2024-08-17T02:26:29.823 INFO:teuthology.orchestra.run.smithi153.stdout: "root": "/" 2024-08-17T02:26:29.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-17T02:26:29.823 INFO:teuthology.orchestra.run.smithi153.stdout: "dentry_count": 0, 2024-08-17T02:26:29.823 INFO:teuthology.orchestra.run.smithi153.stdout: "dentry_pinned_count": 0, 2024-08-17T02:26:29.824 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 4713, 2024-08-17T02:26:29.824 INFO:teuthology.orchestra.run.smithi153.stdout: "inst": { 2024-08-17T02:26:29.824 INFO:teuthology.orchestra.run.smithi153.stdout: "name": { 2024-08-17T02:26:29.824 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "client", 2024-08-17T02:26:29.824 INFO:teuthology.orchestra.run.smithi153.stdout: "num": 4713 2024-08-17T02:26:29.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-17T02:26:29.824 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": { 2024-08-17T02:26:29.824 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "v1", 2024-08-17T02:26:29.824 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": "192.168.0.2:0", 2024-08-17T02:26:29.824 INFO:teuthology.orchestra.run.smithi153.stdout: "nonce": 2387926498 2024-08-17T02:26:29.824 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-17T02:26:29.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-17T02:26:29.824 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": { 2024-08-17T02:26:29.825 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "v1", 2024-08-17T02:26:29.825 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": "192.168.0.2:0", 2024-08-17T02:26:29.825 INFO:teuthology.orchestra.run.smithi153.stdout: "nonce": 2387926498 2024-08-17T02:26:29.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-17T02:26:29.825 INFO:teuthology.orchestra.run.smithi153.stdout: "inst_str": "client.4713 192.168.0.2:0/2387926498", 2024-08-17T02:26:29.825 INFO:teuthology.orchestra.run.smithi153.stdout: "addr_str": "192.168.0.2:0/2387926498", 2024-08-17T02:26:29.825 INFO:teuthology.orchestra.run.smithi153.stdout: "inode_count": 1, 2024-08-17T02:26:29.825 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_epoch": 6, 2024-08-17T02:26:29.825 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_epoch": 21, 2024-08-17T02:26:29.825 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_epoch_barrier": 0, 2024-08-17T02:26:29.826 INFO:teuthology.orchestra.run.smithi153.stdout: "blocklisted": false, 2024-08-17T02:26:29.826 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs" 2024-08-17T02:26:29.826 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-08-17T02:26:29.832 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:26:29.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.933+0000 7f050e68b700 1 Processor -- start 2024-08-17T02:26:29.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.933+0000 7f050e68b700 1 -- start start 2024-08-17T02:26:29.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.933+0000 7f050e68b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0508156ec0 0x7f05080ad810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.933+0000 7f050e68b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f05080b1c20 0x7f05080add50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.933+0000 7f050e68b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f050815a920 con 0x7f0508156af0 2024-08-17T02:26:29.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.933+0000 7f050e68b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05080b27a0 con 0x7f05080b1c20 2024-08-17T02:26:29.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.933+0000 7f050e68b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05080b0260 con 0x7f0508156ec0 2024-08-17T02:26:29.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.933+0000 7f050de8a700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f05080b1c20 0x7f05080add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.933+0000 7f050de8a700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f05080b1c20 0x7f05080add50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51562/0 (socket says 172.21.15.153:51562) 2024-08-17T02:26:29.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.933+0000 7f050de8a700 1 -- 172.21.15.153:0/1238867253 learned_addr learned my addr 172.21.15.153:0/1238867253 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:29.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.933+0000 7f050ce88700 1 --2- 172.21.15.153:0/1238867253 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0508156ec0 0x7f05080ad810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.933+0000 7f050de8a700 1 -- 172.21.15.153:0/1238867253 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0508156ec0 msgr2=0x7f05080ad810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:29.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.933+0000 7f050de8a700 1 --2- 172.21.15.153:0/1238867253 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0508156ec0 0x7f05080ad810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.933+0000 7f050de8a700 1 -- 172.21.15.153:0/1238867253 >> v1:172.21.15.174:6789/0 conn(0x7f0508156af0 legacy=0x7f050815a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:29.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.933+0000 7f050de8a700 1 -- 172.21.15.153:0/1238867253 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05080b21e0 con 0x7f05080b1c20 2024-08-17T02:26:29.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.933+0000 7f050de8a700 1 --2- 172.21.15.153:0/1238867253 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05080b1c20 0x7f05080add50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0500009f20 tx=0x7f0500009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef6015b35d15a15 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:29.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.933+0000 7f04fffff700 1 -- 172.21.15.153:0/1238867253 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050000e070 con 0x7f05080b1c20 2024-08-17T02:26:29.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.933+0000 7f04fffff700 1 -- 172.21.15.153:0/1238867253 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f050000ba40 con 0x7f05080b1c20 2024-08-17T02:26:29.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.933+0000 7f04fffff700 1 -- 172.21.15.153:0/1238867253 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05000092e0 con 0x7f05080b1c20 2024-08-17T02:26:29.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.937+0000 7f050e68b700 1 -- 172.21.15.153:0/1238867253 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05080b1c20 msgr2=0x7f05080add50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.937+0000 7f050e68b700 1 --2- 172.21.15.153:0/1238867253 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05080b1c20 0x7f05080add50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0500009f20 tx=0x7f0500009840 comp rx=0 tx=0).stop 2024-08-17T02:26:29.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.937+0000 7f050e68b700 1 -- 172.21.15.153:0/1238867253 shutdown_connections 2024-08-17T02:26:29.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.937+0000 7f050e68b700 1 --2- 172.21.15.153:0/1238867253 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05080b1c20 0x7f05080add50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.937+0000 7f050e68b700 1 --2- 172.21.15.153:0/1238867253 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0508156ec0 0x7f05080ad810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.937+0000 7f050e68b700 1 -- 172.21.15.153:0/1238867253 >> 172.21.15.153:0/1238867253 conn(0x7f05080ccdb0 msgr2=0x7f05080cd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:29.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.937+0000 7f050e68b700 1 -- 172.21.15.153:0/1238867253 shutdown_connections 2024-08-17T02:26:29.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.937+0000 7f050e68b700 1 -- 172.21.15.153:0/1238867253 wait complete. 2024-08-17T02:26:29.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.937+0000 7f050e68b700 1 Processor -- start 2024-08-17T02:26:29.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.937+0000 7f050e68b700 1 -- start start 2024-08-17T02:26:29.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.941+0000 7f050e68b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05080b1c20 0x7f0508151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.941+0000 7f050e68b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0508156af0 0x7f05080cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.941+0000 7f050e68b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0508156ec0 0x7f05080cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.941+0000 7f050e68b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05081692e0 con 0x7f0508156af0 2024-08-17T02:26:29.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.941+0000 7f050e68b700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0508151f40 con 0x7f0508156ec0 2024-08-17T02:26:29.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.941+0000 7f050e68b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0508152220 con 0x7f05080b1c20 2024-08-17T02:26:29.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.941+0000 7f050ce88700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0508156af0 0x7f05080cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.941+0000 7f050ce88700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0508156af0 0x7f05080cbb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51564/0 (socket says 172.21.15.153:51564) 2024-08-17T02:26:29.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.941+0000 7f050ce88700 1 -- 172.21.15.153:0/2800077144 learned_addr learned my addr 172.21.15.153:0/2800077144 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:29.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.941+0000 7f050d689700 1 --2- 172.21.15.153:0/2800077144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05080b1c20 0x7f0508151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.941+0000 7f050de8a700 1 --2- 172.21.15.153:0/2800077144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0508156ec0 0x7f05080cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.941+0000 7f050ce88700 1 -- 172.21.15.153:0/2800077144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05080b1c20 msgr2=0x7f0508151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.941+0000 7f050ce88700 1 --2- 172.21.15.153:0/2800077144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05080b1c20 0x7f0508151840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.941+0000 7f050ce88700 1 -- 172.21.15.153:0/2800077144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0508156ec0 msgr2=0x7f05080cc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.941+0000 7f050ce88700 1 --2- 172.21.15.153:0/2800077144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0508156ec0 0x7f05080cc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.941+0000 7f050ce88700 1 -- 172.21.15.153:0/2800077144 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0500009ae0 con 0x7f0508156af0 2024-08-17T02:26:29.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.941+0000 7f050ce88700 1 --2- 172.21.15.153:0/2800077144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0508156af0 0x7f05080cbb20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f04f800d7e0 tx=0x7f04f8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:29.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.941+0000 7f04fd7fa700 1 -- 172.21.15.153:0/2800077144 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f80125f0 con 0x7f0508156af0 2024-08-17T02:26:29.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.941+0000 7f04fd7fa700 1 -- 172.21.15.153:0/2800077144 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f8012750 con 0x7f0508156af0 2024-08-17T02:26:29.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.941+0000 7f050e68b700 1 -- 172.21.15.153:0/2800077144 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0508152500 con 0x7f0508156af0 2024-08-17T02:26:29.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.941+0000 7f04fd7fa700 1 -- 172.21.15.153:0/2800077144 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f8012b10 con 0x7f0508156af0 2024-08-17T02:26:29.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.941+0000 7f050e68b700 1 -- 172.21.15.153:0/2800077144 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05080cc920 con 0x7f0508156af0 2024-08-17T02:26:29.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.945+0000 7f050e68b700 1 -- 172.21.15.153:0/2800077144 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0508169490 con 0x7f0508156af0 2024-08-17T02:26:29.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.945+0000 7f04fd7fa700 1 -- 172.21.15.153:0/2800077144 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f04f8013480 con 0x7f0508156af0 2024-08-17T02:26:29.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.945+0000 7f04fd7fa700 1 --2- 172.21.15.153:0/2800077144 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f04ec060860 0x7f04ec062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.945+0000 7f04fd7fa700 1 -- 172.21.15.153:0/2800077144 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f04f807cef0 con 0x7f0508156af0 2024-08-17T02:26:29.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.945+0000 7f050d689700 1 --2- 172.21.15.153:0/2800077144 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f04ec060860 0x7f04ec062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.945+0000 7f050d689700 1 --2- 172.21.15.153:0/2800077144 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f04ec060860 0x7f04ec062d10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0504003a30 tx=0x7f0504007ea0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:29.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:29.949+0000 7f04fd7fa700 1 -- 172.21.15.153:0/2800077144 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f0508169490 con 0x7f0508156af0 2024-08-17T02:26:30.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:30.153+0000 7f050e68b700 1 -- 172.21.15.153:0/2800077144 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f05080ccb40 con 0x7f0508156af0 2024-08-17T02:26:30.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:30.153+0000 7f04fd7fa700 1 -- 172.21.15.153:0/2800077144 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f04f8050dd0 con 0x7f0508156af0 2024-08-17T02:26:30.156 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:26:30.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:30.157+0000 7f050e68b700 1 -- 172.21.15.153:0/2800077144 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f04ec060860 msgr2=0x7f04ec062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:30.157+0000 7f050e68b700 1 --2- 172.21.15.153:0/2800077144 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f04ec060860 0x7f04ec062d10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0504003a30 tx=0x7f0504007ea0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:30.157+0000 7f050e68b700 1 -- 172.21.15.153:0/2800077144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0508156af0 msgr2=0x7f05080cbb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:30.157+0000 7f050e68b700 1 --2- 172.21.15.153:0/2800077144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0508156af0 0x7f05080cbb20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f04f800d7e0 tx=0x7f04f8008040 comp rx=0 tx=0).stop 2024-08-17T02:26:30.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:30.157+0000 7f050e68b700 1 -- 172.21.15.153:0/2800077144 shutdown_connections 2024-08-17T02:26:30.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:30.157+0000 7f050e68b700 1 --2- 172.21.15.153:0/2800077144 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f04ec060860 0x7f04ec062d10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:30.157+0000 7f050e68b700 1 --2- 172.21.15.153:0/2800077144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0508156ec0 0x7f05080cc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:30.157+0000 7f050e68b700 1 --2- 172.21.15.153:0/2800077144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0508156af0 0x7f05080cbb20 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:30.157+0000 7f050e68b700 1 --2- 172.21.15.153:0/2800077144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05080b1c20 0x7f0508151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:30.157+0000 7f050e68b700 1 -- 172.21.15.153:0/2800077144 >> 172.21.15.153:0/2800077144 conn(0x7f05080ccdb0 msgr2=0x7f05080cd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:30.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:30.157+0000 7f050e68b700 1 -- 172.21.15.153:0/2800077144 shutdown_connections 2024-08-17T02:26:30.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:30.157+0000 7f050e68b700 1 -- 172.21.15.153:0/2800077144 wait complete. 2024-08-17T02:26:30.171 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:26:30.171 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:26:30.171 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi174.front.sepia.ceph.com 2024-08-17T02:26:30.171 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:26:30.171 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:30.171 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:26:30.171 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:26:30.171 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:26:30.171 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:26:30.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:30.172 DEBUG:teuthology.orchestra.run.smithi174:> ip addr 2024-08-17T02:26:30.180 INFO:teuthology.orchestra.run.smithi174.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:30.180 INFO:teuthology.orchestra.run.smithi174.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:30.180 INFO:teuthology.orchestra.run.smithi174.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:30.180 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:30.180 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:30.180 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:30.180 INFO:teuthology.orchestra.run.smithi174.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:30.180 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e0 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:30.180 INFO:teuthology.orchestra.run.smithi174.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:30.180 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e1 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:30.180 INFO:teuthology.orchestra.run.smithi174.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:30.180 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1a brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:30.180 INFO:teuthology.orchestra.run.smithi174.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:26:30.181 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1b brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:30.181 INFO:teuthology.orchestra.run.smithi174.stdout: inet 172.21.15.174/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-08-17T02:26:30.181 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft 42543sec preferred_lft 42543sec 2024-08-17T02:26:30.181 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::ec4:7aff:fe88:771b/64 scope link 2024-08-17T02:26:30.181 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:30.181 INFO:teuthology.orchestra.run.smithi174.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-17T02:26:30.181 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 02:42:a3:71:98:af brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:30.181 INFO:teuthology.orchestra.run.smithi174.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-17T02:26:30.181 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:30.181 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:26:30.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:30.182 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec bash -c ' 2024-08-17T02:26:30.182 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2024-08-17T02:26:30.182 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:26:30.182 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip addr flush dev ceph-brx 2024-08-17T02:26:30.182 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set ceph-brx up 2024-08-17T02:26:30.182 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:26:30.182 DEBUG:teuthology.orchestra.run.smithi174:> ') 2024-08-17T02:26:30.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:30.265 DEBUG:teuthology.orchestra.run.smithi174:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:26:30.274 INFO:teuthology.orchestra.run.smithi174.stdout:1 2024-08-17T02:26:30.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:30.275 DEBUG:teuthology.orchestra.run.smithi174:> route 2024-08-17T02:26:30.306 INFO:teuthology.orchestra.run.smithi174.stdout:Kernel IP routing table 2024-08-17T02:26:30.306 INFO:teuthology.orchestra.run.smithi174.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:26:30.306 INFO:teuthology.orchestra.run.smithi174.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-08-17T02:26:30.306 INFO:teuthology.orchestra.run.smithi174.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:26:30.306 INFO:teuthology.orchestra.run.smithi174.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-17T02:26:30.306 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-08-17T02:26:30.306 INFO:teuthology.orchestra.run.smithi174.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-17T02:26:30.307 INFO:teuthology.orchestra.run.smithi174.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:26:30.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:30.307 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec bash -c ' 2024-08-17T02:26:30.307 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2024-08-17T02:26:30.307 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:26:30.307 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:26:30.307 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:26:30.307 DEBUG:teuthology.orchestra.run.smithi174:> ') 2024-08-17T02:26:30.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:30.384 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2024-08-17T02:26:30.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:30.390 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list-id 2024-08-17T02:26:30.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:30.397 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec bash -c ' 2024-08-17T02:26:30.398 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2024-08-17T02:26:30.398 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:26:30.398 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-08-17T02:26:30.398 DEBUG:teuthology.orchestra.run.smithi174:> ') 2024-08-17T02:26:30.472 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-08-17T02:26:30.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:30.472 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec bash -c ' 2024-08-17T02:26:30.472 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2024-08-17T02:26:30.472 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-08-17T02:26:30.472 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:26:30.472 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-08-17T02:26:30.472 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-08-17T02:26:30.473 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-08-17T02:26:30.473 DEBUG:teuthology.orchestra.run.smithi174:> ') 2024-08-17T02:26:30.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:30.544 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec bash -c ' 2024-08-17T02:26:30.544 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2024-08-17T02:26:30.545 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set brx.0 up 2024-08-17T02:26:30.545 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:26:30.545 DEBUG:teuthology.orchestra.run.smithi174:> ') 2024-08-17T02:26:30.574 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-08-17T02:26:30.574 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:30.575 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:30.623 INFO:teuthology.orchestra.run.smithi174.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:26:30.623 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:30.624 DEBUG:teuthology.orchestra.run.smithi174:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:30.630 DEBUG:teuthology.orchestra.run.smithi174:> sudo modprobe fuse 2024-08-17T02:26:30.646 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:30.646 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:30.702 INFO:teuthology.orchestra.run.smithi174.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:30.703 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:30.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:30.705 DEBUG:teuthology.orchestra.run.smithi174:> ls /sys/fs/fuse/connections 2024-08-17T02:26:30.711 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-17T02:26:30.711 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-08-17T02:26:30.713 DEBUG:teuthology.orchestra.run.smithi174:> sudo modprobe fuse 2024-08-17T02:26:30.731 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:30.731 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:30.740 INFO:teuthology.orchestra.run.smithi174.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:30.741 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:30.742 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:30.742 DEBUG:teuthology.orchestra.run.smithi174:> ls /sys/fs/fuse/connections 2024-08-17T02:26:30.799 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi174.stderr:2024-08-17T02:26:30.794+0000 7f2b58080380 -1 init, newargv = 0x55ed09f1c960 newargc=15 2024-08-17T02:26:30.799 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi174.stderr:ceph-fuse[30118]: starting ceph client 2024-08-17T02:26:30.808 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi174.stderr:ceph-fuse[30118]: starting fuse 2024-08-17T02:26:31.848 DEBUG:teuthology.orchestra.run.smithi174:> sudo modprobe fuse 2024-08-17T02:26:31.867 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:31.867 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:31.923 INFO:teuthology.orchestra.run.smithi174.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:31.924 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:31.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:31.924 DEBUG:teuthology.orchestra.run.smithi174:> ls /sys/fs/fuse/connections 2024-08-17T02:26:31.930 INFO:teuthology.orchestra.run.smithi174.stdout:52 2024-08-17T02:26:31.930 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-08-17T02:26:31.931 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-17T02:26:31.931 DEBUG:teuthology.orchestra.run.smithi174:> import glob 2024-08-17T02:26:31.931 DEBUG:teuthology.orchestra.run.smithi174:> import re 2024-08-17T02:26:31.931 DEBUG:teuthology.orchestra.run.smithi174:> import os 2024-08-17T02:26:31.931 DEBUG:teuthology.orchestra.run.smithi174:> import subprocess 2024-08-17T02:26:31.931 DEBUG:teuthology.orchestra.run.smithi174:> 2024-08-17T02:26:31.931 DEBUG:teuthology.orchestra.run.smithi174:> def _find_admin_socket(client_name): 2024-08-17T02:26:31.931 DEBUG:teuthology.orchestra.run.smithi174:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-08-17T02:26:31.931 DEBUG:teuthology.orchestra.run.smithi174:> files = glob.glob(asok_path) 2024-08-17T02:26:31.931 DEBUG:teuthology.orchestra.run.smithi174:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-08-17T02:26:31.932 DEBUG:teuthology.orchestra.run.smithi174:> 2024-08-17T02:26:31.932 DEBUG:teuthology.orchestra.run.smithi174:> # Given a non-glob path, it better be there 2024-08-17T02:26:31.932 DEBUG:teuthology.orchestra.run.smithi174:> if "*" not in asok_path: 2024-08-17T02:26:31.932 DEBUG:teuthology.orchestra.run.smithi174:> assert(len(files) == 1) 2024-08-17T02:26:31.932 DEBUG:teuthology.orchestra.run.smithi174:> return files[0] 2024-08-17T02:26:31.932 DEBUG:teuthology.orchestra.run.smithi174:> 2024-08-17T02:26:31.932 DEBUG:teuthology.orchestra.run.smithi174:> for f in files: 2024-08-17T02:26:31.932 DEBUG:teuthology.orchestra.run.smithi174:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-17T02:26:31.932 DEBUG:teuthology.orchestra.run.smithi174:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-17T02:26:31.932 DEBUG:teuthology.orchestra.run.smithi174:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-17T02:26:31.932 DEBUG:teuthology.orchestra.run.smithi174:> contents = proc_f.read() 2024-08-17T02:26:31.932 DEBUG:teuthology.orchestra.run.smithi174:> if mountpoint in contents: 2024-08-17T02:26:31.932 DEBUG:teuthology.orchestra.run.smithi174:> return f 2024-08-17T02:26:31.933 DEBUG:teuthology.orchestra.run.smithi174:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-17T02:26:31.933 DEBUG:teuthology.orchestra.run.smithi174:> 2024-08-17T02:26:31.933 DEBUG:teuthology.orchestra.run.smithi174:> print(_find_admin_socket("client.1")) 2024-08-17T02:26:31.933 DEBUG:teuthology.orchestra.run.smithi174:> ' 2024-08-17T02:26:32.015 INFO:teuthology.orchestra.run.smithi174.stdout:/var/run/ceph/ceph-client.1.30118.asok 2024-08-17T02:26:32.199 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.30118.asok 2024-08-17T02:26:32.200 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:32.200 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.30118.asok status 2024-08-17T02:26:32.336 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-08-17T02:26:32.336 INFO:teuthology.orchestra.run.smithi174.stdout: "metadata": { 2024-08-17T02:26:32.336 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_sha1": "2577e8139c6b8786f9d6d6ea21b8da9244b9260e", 2024-08-17T02:26:32.336 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_version": "ceph version 17.2.7-1375-g2577e813 (2577e8139c6b8786f9d6d6ea21b8da9244b9260e) quincy (stable)", 2024-08-17T02:26:32.336 INFO:teuthology.orchestra.run.smithi174.stdout: "entity_id": "1", 2024-08-17T02:26:32.336 INFO:teuthology.orchestra.run.smithi174.stdout: "hostname": "smithi174", 2024-08-17T02:26:32.337 INFO:teuthology.orchestra.run.smithi174.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-08-17T02:26:32.337 INFO:teuthology.orchestra.run.smithi174.stdout: "pid": "30118", 2024-08-17T02:26:32.337 INFO:teuthology.orchestra.run.smithi174.stdout: "root": "/" 2024-08-17T02:26:32.337 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-08-17T02:26:32.337 INFO:teuthology.orchestra.run.smithi174.stdout: "dentry_count": 0, 2024-08-17T02:26:32.337 INFO:teuthology.orchestra.run.smithi174.stdout: "dentry_pinned_count": 0, 2024-08-17T02:26:32.337 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 4654, 2024-08-17T02:26:32.337 INFO:teuthology.orchestra.run.smithi174.stdout: "inst": { 2024-08-17T02:26:32.337 INFO:teuthology.orchestra.run.smithi174.stdout: "name": { 2024-08-17T02:26:32.337 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "client", 2024-08-17T02:26:32.337 INFO:teuthology.orchestra.run.smithi174.stdout: "num": 4654 2024-08-17T02:26:32.337 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-08-17T02:26:32.337 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": { 2024-08-17T02:26:32.338 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "v1", 2024-08-17T02:26:32.338 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:26:32.338 INFO:teuthology.orchestra.run.smithi174.stdout: "nonce": 4147029617 2024-08-17T02:26:32.338 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-08-17T02:26:32.338 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-08-17T02:26:32.338 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": { 2024-08-17T02:26:32.338 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "v1", 2024-08-17T02:26:32.338 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:26:32.338 INFO:teuthology.orchestra.run.smithi174.stdout: "nonce": 4147029617 2024-08-17T02:26:32.338 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-08-17T02:26:32.338 INFO:teuthology.orchestra.run.smithi174.stdout: "inst_str": "client.4654 192.168.0.1:0/4147029617", 2024-08-17T02:26:32.338 INFO:teuthology.orchestra.run.smithi174.stdout: "addr_str": "192.168.0.1:0/4147029617", 2024-08-17T02:26:32.339 INFO:teuthology.orchestra.run.smithi174.stdout: "inode_count": 1, 2024-08-17T02:26:32.339 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_epoch": 6, 2024-08-17T02:26:32.339 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_epoch": 21, 2024-08-17T02:26:32.339 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_epoch_barrier": 0, 2024-08-17T02:26:32.339 INFO:teuthology.orchestra.run.smithi174.stdout: "blocklisted": false, 2024-08-17T02:26:32.339 INFO:teuthology.orchestra.run.smithi174.stdout: "fs_name": "cephfs" 2024-08-17T02:26:32.339 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-08-17T02:26:32.346 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:26:32.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.457+0000 7f7feacba700 1 Processor -- start 2024-08-17T02:26:32.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.457+0000 7f7feacba700 1 -- start start 2024-08-17T02:26:32.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.457+0000 7f7feacba700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7fe40687a0 0x7f7fe406d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.457+0000 7f7feacba700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe415ce60 con 0x7f7fe406d830 2024-08-17T02:26:32.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.457+0000 7f7feacba700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe40ae710 con 0x7f7fe4153a50 2024-08-17T02:26:32.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.457+0000 7f7feacba700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe406dc70 con 0x7f7fe40687a0 2024-08-17T02:26:32.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.457+0000 7f7fe9257700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f7fe406d830 0x7f7fe40afe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:60030/0 (socket says 172.21.15.153:60030) 2024-08-17T02:26:32.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.457+0000 7f7fe9257700 1 -- 172.21.15.153:0/3510587602 learned_addr learned my addr 172.21.15.153:0/3510587602 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:32.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.457+0000 7f7fe3fff700 1 --2- 172.21.15.153:0/3510587602 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7fe40687a0 0x7f7fe406d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.457+0000 7f7fe3fff700 1 -- 172.21.15.153:0/3510587602 >> v1:172.21.15.174:6789/0 conn(0x7f7fe4153a50 legacy=0x7f7fe40ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.457+0000 7f7fe37fe700 1 -- 172.21.15.153:0/3510587602 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3036000592 0 0) 0x7f7fe415ce60 con 0x7f7fe406d830 2024-08-17T02:26:32.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.457+0000 7f7fe3fff700 1 -- 172.21.15.153:0/3510587602 >> v1:172.21.15.153:6789/0 conn(0x7f7fe406d830 legacy=0x7f7fe40afe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.457+0000 7f7fe3fff700 1 -- 172.21.15.153:0/3510587602 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe4068bd0 con 0x7f7fe40687a0 2024-08-17T02:26:32.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.461+0000 7f7fe3fff700 1 --2- 172.21.15.153:0/3510587602 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7fe40687a0 0x7f7fe406d2f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0009890 tx=0x7f7fd00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e7ab07517c38362 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:32.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.461+0000 7f7fe37fe700 1 -- 172.21.15.153:0/3510587602 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0011630 con 0x7f7fe40687a0 2024-08-17T02:26:32.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.461+0000 7f7fe37fe700 1 -- 172.21.15.153:0/3510587602 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd0011790 con 0x7f7fe40687a0 2024-08-17T02:26:32.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.461+0000 7f7fe37fe700 1 -- 172.21.15.153:0/3510587602 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0011b50 con 0x7f7fe40687a0 2024-08-17T02:26:32.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.461+0000 7f7feacba700 1 -- 172.21.15.153:0/3510587602 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7fe40687a0 msgr2=0x7f7fe406d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.461+0000 7f7feacba700 1 --2- 172.21.15.153:0/3510587602 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7fe40687a0 0x7f7fe406d2f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0009890 tx=0x7f7fd00091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.461+0000 7f7feacba700 1 -- 172.21.15.153:0/3510587602 shutdown_connections 2024-08-17T02:26:32.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.461+0000 7f7feacba700 1 --2- 172.21.15.153:0/3510587602 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7fe40687a0 0x7f7fe406d2f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.461+0000 7f7feacba700 1 -- 172.21.15.153:0/3510587602 >> 172.21.15.153:0/3510587602 conn(0x7f7fe40ceb30 msgr2=0x7f7fe406cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:32.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.461+0000 7f7feacba700 1 -- 172.21.15.153:0/3510587602 shutdown_connections 2024-08-17T02:26:32.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.461+0000 7f7feacba700 1 -- 172.21.15.153:0/3510587602 wait complete. 2024-08-17T02:26:32.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.465+0000 7f7feacba700 1 Processor -- start 2024-08-17T02:26:32.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.465+0000 7f7feacba700 1 -- start start 2024-08-17T02:26:32.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.465+0000 7f7feacba700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7fe40687a0 0x7f7fe4149c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.465+0000 7f7feacba700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7fe406d830 0x7f7fe4151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.465+0000 7f7feacba700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fe4153a50 0x7f7fe414eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.465+0000 7f7feacba700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe414a1b0 con 0x7f7fe4153a50 2024-08-17T02:26:32.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.465+0000 7f7feacba700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe416ee40 con 0x7f7fe406d830 2024-08-17T02:26:32.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.465+0000 7f7feacba700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe4151f70 con 0x7f7fe40687a0 2024-08-17T02:26:32.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.465+0000 7f7fe9257700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fe4153a50 0x7f7fe414eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.465+0000 7f7fe9257700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fe4153a50 0x7f7fe414eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59424/0 (socket says 172.21.15.153:59424) 2024-08-17T02:26:32.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.465+0000 7f7fe9257700 1 -- 172.21.15.153:0/1222921381 learned_addr learned my addr 172.21.15.153:0/1222921381 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:32.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.465+0000 7f7fe8a56700 1 --2- 172.21.15.153:0/1222921381 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7fe40687a0 0x7f7fe4149c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.465+0000 7f7fe3fff700 1 --2- 172.21.15.153:0/1222921381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7fe406d830 0x7f7fe4151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.465+0000 7f7fe9257700 1 -- 172.21.15.153:0/1222921381 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7fe40687a0 msgr2=0x7f7fe4149c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.465+0000 7f7fe9257700 1 --2- 172.21.15.153:0/1222921381 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7fe40687a0 0x7f7fe4149c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.465+0000 7f7fe9257700 1 -- 172.21.15.153:0/1222921381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7fe406d830 msgr2=0x7f7fe4151a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.465+0000 7f7fe9257700 1 --2- 172.21.15.153:0/1222921381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7fe406d830 0x7f7fe4151a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.465+0000 7f7fe9257700 1 -- 172.21.15.153:0/1222921381 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd0009420 con 0x7f7fe4153a50 2024-08-17T02:26:32.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.465+0000 7f7fe9257700 1 --2- 172.21.15.153:0/1222921381 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fe4153a50 0x7f7fe414eab0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc00cc90 tx=0x7f7fdc001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:32.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.465+0000 7f7fe0ff9700 1 -- 172.21.15.153:0/1222921381 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc00a8b0 con 0x7f7fe4153a50 2024-08-17T02:26:32.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.465+0000 7f7fe0ff9700 1 -- 172.21.15.153:0/1222921381 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fdc00aa10 con 0x7f7fe4153a50 2024-08-17T02:26:32.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.465+0000 7f7feacba700 1 -- 172.21.15.153:0/1222921381 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe416e230 con 0x7f7fe4153a50 2024-08-17T02:26:32.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.465+0000 7f7fe0ff9700 1 -- 172.21.15.153:0/1222921381 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc00add0 con 0x7f7fe4153a50 2024-08-17T02:26:32.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.465+0000 7f7feacba700 1 -- 172.21.15.153:0/1222921381 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe416e7f0 con 0x7f7fe4153a50 2024-08-17T02:26:32.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.469+0000 7f7feacba700 1 -- 172.21.15.153:0/1222921381 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe40645c0 con 0x7f7fe4153a50 2024-08-17T02:26:32.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.469+0000 7f7fe0ff9700 1 -- 172.21.15.153:0/1222921381 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7fdc007300 con 0x7f7fe4153a50 2024-08-17T02:26:32.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.469+0000 7f7fe0ff9700 1 --2- 172.21.15.153:0/1222921381 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7fc8060890 0x7f7fc8062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.469+0000 7f7fe0ff9700 1 -- 172.21.15.153:0/1222921381 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7fdc07cf40 con 0x7f7fe4153a50 2024-08-17T02:26:32.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.469+0000 7f7fe8a56700 1 --2- 172.21.15.153:0/1222921381 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7fc8060890 0x7f7fc8062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.473+0000 7f7fe8a56700 1 --2- 172.21.15.153:0/1222921381 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7fc8060890 0x7f7fc8062d40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8003b00 tx=0x7f7fd8007e20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:32.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.481+0000 7f7fe0ff9700 1 -- 172.21.15.153:0/1222921381 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f7fdc04d370 con 0x7f7fe4153a50 2024-08-17T02:26:32.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.685+0000 7f7feacba700 1 -- 172.21.15.153:0/1222921381 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7fe40b3060 con 0x7f7fe4153a50 2024-08-17T02:26:32.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.685+0000 7f7fe0ff9700 1 -- 172.21.15.153:0/1222921381 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7fdc050990 con 0x7f7fe4153a50 2024-08-17T02:26:32.690 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:26:32.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.689+0000 7f7feacba700 1 -- 172.21.15.153:0/1222921381 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7fc8060890 msgr2=0x7f7fc8062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.689+0000 7f7feacba700 1 --2- 172.21.15.153:0/1222921381 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7fc8060890 0x7f7fc8062d40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8003b00 tx=0x7f7fd8007e20 comp rx=0 tx=0).stop 2024-08-17T02:26:32.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.689+0000 7f7feacba700 1 -- 172.21.15.153:0/1222921381 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fe4153a50 msgr2=0x7f7fe414eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.689+0000 7f7feacba700 1 --2- 172.21.15.153:0/1222921381 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fe4153a50 0x7f7fe414eab0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc00cc90 tx=0x7f7fdc001a80 comp rx=0 tx=0).stop 2024-08-17T02:26:32.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.689+0000 7f7feacba700 1 -- 172.21.15.153:0/1222921381 shutdown_connections 2024-08-17T02:26:32.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.689+0000 7f7feacba700 1 --2- 172.21.15.153:0/1222921381 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7fc8060890 0x7f7fc8062d40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.689+0000 7f7feacba700 1 --2- 172.21.15.153:0/1222921381 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fe4153a50 0x7f7fe414eab0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.689+0000 7f7feacba700 1 --2- 172.21.15.153:0/1222921381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7fe406d830 0x7f7fe4151a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.689+0000 7f7feacba700 1 --2- 172.21.15.153:0/1222921381 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7fe40687a0 0x7f7fe4149c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.689+0000 7f7feacba700 1 -- 172.21.15.153:0/1222921381 >> 172.21.15.153:0/1222921381 conn(0x7f7fe40ceb30 msgr2=0x7f7fe406bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:32.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.689+0000 7f7feacba700 1 -- 172.21.15.153:0/1222921381 shutdown_connections 2024-08-17T02:26:32.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:32.689+0000 7f7feacba700 1 -- 172.21.15.153:0/1222921381 wait complete. 2024-08-17T02:26:32.707 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:26:32.707 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:26:32.707 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi174.front.sepia.ceph.com 2024-08-17T02:26:32.707 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-08-17T02:26:32.707 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-08-17T02:26:32.707 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:26:32.707 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:26:32.707 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:26:32.707 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:26:32.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:32.708 DEBUG:teuthology.orchestra.run.smithi174:> ip addr 2024-08-17T02:26:32.716 INFO:teuthology.orchestra.run.smithi174.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:32.716 INFO:teuthology.orchestra.run.smithi174.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:32.716 INFO:teuthology.orchestra.run.smithi174.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:32.716 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:32.716 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:32.716 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:32.716 INFO:teuthology.orchestra.run.smithi174.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:32.717 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e0 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:32.717 INFO:teuthology.orchestra.run.smithi174.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:32.717 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e1 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:32.717 INFO:teuthology.orchestra.run.smithi174.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:32.717 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1a brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:32.717 INFO:teuthology.orchestra.run.smithi174.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:26:32.717 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1b brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:32.717 INFO:teuthology.orchestra.run.smithi174.stdout: inet 172.21.15.174/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-08-17T02:26:32.717 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft 42540sec preferred_lft 42540sec 2024-08-17T02:26:32.717 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::ec4:7aff:fe88:771b/64 scope link 2024-08-17T02:26:32.717 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:32.717 INFO:teuthology.orchestra.run.smithi174.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-17T02:26:32.718 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 02:42:a3:71:98:af brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:32.718 INFO:teuthology.orchestra.run.smithi174.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-17T02:26:32.718 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:32.718 INFO:teuthology.orchestra.run.smithi174.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:26:32.718 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 42:83:79:c9:cd:e3 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:32.718 INFO:teuthology.orchestra.run.smithi174.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:26:32.718 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:32.718 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::981d:53ff:fee6:6727/64 scope link 2024-08-17T02:26:32.718 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:32.718 INFO:teuthology.orchestra.run.smithi174.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:26:32.718 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 42:83:79:c9:cd:e3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:26:32.718 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::4083:79ff:fec9:cde3/64 scope link 2024-08-17T02:26:32.719 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:32.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:32.719 DEBUG:teuthology.orchestra.run.smithi174:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:26:32.735 INFO:teuthology.orchestra.run.smithi174.stdout:1 2024-08-17T02:26:32.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:32.736 DEBUG:teuthology.orchestra.run.smithi174:> route 2024-08-17T02:26:32.789 INFO:teuthology.orchestra.run.smithi174.stdout:Kernel IP routing table 2024-08-17T02:26:32.789 INFO:teuthology.orchestra.run.smithi174.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:26:32.789 INFO:teuthology.orchestra.run.smithi174.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-08-17T02:26:32.789 INFO:teuthology.orchestra.run.smithi174.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:26:32.789 INFO:teuthology.orchestra.run.smithi174.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-17T02:26:32.789 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-08-17T02:26:32.789 INFO:teuthology.orchestra.run.smithi174.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-17T02:26:32.789 INFO:teuthology.orchestra.run.smithi174.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:26:32.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:32.789 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec bash -c ' 2024-08-17T02:26:32.790 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2024-08-17T02:26:32.790 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:26:32.790 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:26:32.790 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:26:32.790 DEBUG:teuthology.orchestra.run.smithi174:> ') 2024-08-17T02:26:32.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:32.828 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2024-08-17T02:26:32.879 INFO:teuthology.orchestra.run.smithi174.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:26:32.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:32.880 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list-id 2024-08-17T02:26:32.887 INFO:teuthology.orchestra.run.smithi174.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-08-17T02:26:32.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:32.887 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec bash -c ' 2024-08-17T02:26:32.887 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2024-08-17T02:26:32.887 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:26:32.887 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-08-17T02:26:32.888 DEBUG:teuthology.orchestra.run.smithi174:> ') 2024-08-17T02:26:32.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:32.917 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:26:32.977 INFO:teuthology.orchestra.run.smithi174.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:32.978 INFO:teuthology.orchestra.run.smithi174.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:32.978 INFO:teuthology.orchestra.run.smithi174.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:32.978 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:32.978 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:32.978 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:32.978 INFO:teuthology.orchestra.run.smithi174.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:26:32.978 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether b2:de:09:24:03:03 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:26:32.978 INFO:teuthology.orchestra.run.smithi174.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:26:32.978 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:32.978 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::b0de:9ff:fe24:303/64 scope link 2024-08-17T02:26:32.978 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:32.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:32.979 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:26:32.992 INFO:teuthology.orchestra.run.smithi174.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:32.992 INFO:teuthology.orchestra.run.smithi174.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:32.992 INFO:teuthology.orchestra.run.smithi174.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:32.992 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:32.992 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:32.992 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:32.992 INFO:teuthology.orchestra.run.smithi174.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:26:32.992 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether b2:de:09:24:03:03 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:26:32.993 INFO:teuthology.orchestra.run.smithi174.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:26:32.993 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:32.993 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::b0de:9ff:fe24:303/64 scope link 2024-08-17T02:26:32.993 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:32.994 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-08-17T02:26:32.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:32.994 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec bash -c ' 2024-08-17T02:26:32.994 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2024-08-17T02:26:32.994 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-08-17T02:26:32.994 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:26:32.994 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-08-17T02:26:32.994 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-08-17T02:26:32.995 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-08-17T02:26:32.995 DEBUG:teuthology.orchestra.run.smithi174:> ') 2024-08-17T02:26:33.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:33.051 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec bash -c ' 2024-08-17T02:26:33.051 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2024-08-17T02:26:33.051 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set brx.1 up 2024-08-17T02:26:33.051 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:26:33.051 DEBUG:teuthology.orchestra.run.smithi174:> ') 2024-08-17T02:26:33.077 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-08-17T02:26:33.077 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:33.077 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-08-17T02:26:33.085 INFO:teuthology.orchestra.run.smithi174.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:26:33.085 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:33.085 DEBUG:teuthology.orchestra.run.smithi174:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:26:33.090 DEBUG:teuthology.orchestra.run.smithi174:> sudo modprobe fuse 2024-08-17T02:26:33.149 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:33.150 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:33.162 INFO:teuthology.orchestra.run.smithi174.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:33.163 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:33.164 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:33.164 DEBUG:teuthology.orchestra.run.smithi174:> ls /sys/fs/fuse/connections 2024-08-17T02:26:33.170 INFO:teuthology.orchestra.run.smithi174.stdout:52 2024-08-17T02:26:33.171 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [52] 2024-08-17T02:26:33.171 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-08-17T02:26:33.173 DEBUG:teuthology.orchestra.run.smithi174:> sudo modprobe fuse 2024-08-17T02:26:33.187 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:33.188 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:33.198 INFO:teuthology.orchestra.run.smithi174.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:33.199 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:33.200 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:33.200 DEBUG:teuthology.orchestra.run.smithi174:> ls /sys/fs/fuse/connections 2024-08-17T02:26:33.247 INFO:teuthology.orchestra.run.smithi174.stdout:52 2024-08-17T02:26:33.251 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi174.stderr:2024-08-17T02:26:33.246+0000 7f36231b4380 -1 init, newargv = 0x55b6caade920 newargc=15 2024-08-17T02:26:33.251 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi174.stderr:ceph-fuse[30231]: starting ceph client 2024-08-17T02:26:33.258 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi174.stderr:ceph-fuse[30231]: starting fuse 2024-08-17T02:26:34.349 DEBUG:teuthology.orchestra.run.smithi174:> sudo modprobe fuse 2024-08-17T02:26:34.367 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:34.367 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:34.378 INFO:teuthology.orchestra.run.smithi174.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:34.379 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:34.379 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:34.379 DEBUG:teuthology.orchestra.run.smithi174:> ls /sys/fs/fuse/connections 2024-08-17T02:26:34.385 INFO:teuthology.orchestra.run.smithi174.stdout:52 2024-08-17T02:26:34.385 INFO:teuthology.orchestra.run.smithi174.stdout:53 2024-08-17T02:26:34.385 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52, 53] 2024-08-17T02:26:34.385 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-17T02:26:34.385 DEBUG:teuthology.orchestra.run.smithi174:> import glob 2024-08-17T02:26:34.385 DEBUG:teuthology.orchestra.run.smithi174:> import re 2024-08-17T02:26:34.385 DEBUG:teuthology.orchestra.run.smithi174:> import os 2024-08-17T02:26:34.386 DEBUG:teuthology.orchestra.run.smithi174:> import subprocess 2024-08-17T02:26:34.386 DEBUG:teuthology.orchestra.run.smithi174:> 2024-08-17T02:26:34.386 DEBUG:teuthology.orchestra.run.smithi174:> def _find_admin_socket(client_name): 2024-08-17T02:26:34.386 DEBUG:teuthology.orchestra.run.smithi174:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-08-17T02:26:34.386 DEBUG:teuthology.orchestra.run.smithi174:> files = glob.glob(asok_path) 2024-08-17T02:26:34.386 DEBUG:teuthology.orchestra.run.smithi174:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-08-17T02:26:34.386 DEBUG:teuthology.orchestra.run.smithi174:> 2024-08-17T02:26:34.386 DEBUG:teuthology.orchestra.run.smithi174:> # Given a non-glob path, it better be there 2024-08-17T02:26:34.386 DEBUG:teuthology.orchestra.run.smithi174:> if "*" not in asok_path: 2024-08-17T02:26:34.386 DEBUG:teuthology.orchestra.run.smithi174:> assert(len(files) == 1) 2024-08-17T02:26:34.386 DEBUG:teuthology.orchestra.run.smithi174:> return files[0] 2024-08-17T02:26:34.386 DEBUG:teuthology.orchestra.run.smithi174:> 2024-08-17T02:26:34.386 DEBUG:teuthology.orchestra.run.smithi174:> for f in files: 2024-08-17T02:26:34.386 DEBUG:teuthology.orchestra.run.smithi174:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-17T02:26:34.386 DEBUG:teuthology.orchestra.run.smithi174:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-17T02:26:34.387 DEBUG:teuthology.orchestra.run.smithi174:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-17T02:26:34.387 DEBUG:teuthology.orchestra.run.smithi174:> contents = proc_f.read() 2024-08-17T02:26:34.387 DEBUG:teuthology.orchestra.run.smithi174:> if mountpoint in contents: 2024-08-17T02:26:34.387 DEBUG:teuthology.orchestra.run.smithi174:> return f 2024-08-17T02:26:34.387 DEBUG:teuthology.orchestra.run.smithi174:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-17T02:26:34.387 DEBUG:teuthology.orchestra.run.smithi174:> 2024-08-17T02:26:34.387 DEBUG:teuthology.orchestra.run.smithi174:> print(_find_admin_socket("client.3")) 2024-08-17T02:26:34.387 DEBUG:teuthology.orchestra.run.smithi174:> ' 2024-08-17T02:26:34.511 INFO:teuthology.orchestra.run.smithi174.stdout:/var/run/ceph/ceph-client.3.30231.asok 2024-08-17T02:26:34.697 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.30231.asok 2024-08-17T02:26:34.697 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:34.698 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.30231.asok status 2024-08-17T02:26:34.793 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-08-17T02:26:34.793 INFO:teuthology.orchestra.run.smithi174.stdout: "metadata": { 2024-08-17T02:26:34.793 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_sha1": "2577e8139c6b8786f9d6d6ea21b8da9244b9260e", 2024-08-17T02:26:34.794 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_version": "ceph version 17.2.7-1375-g2577e813 (2577e8139c6b8786f9d6d6ea21b8da9244b9260e) quincy (stable)", 2024-08-17T02:26:34.794 INFO:teuthology.orchestra.run.smithi174.stdout: "entity_id": "3", 2024-08-17T02:26:34.794 INFO:teuthology.orchestra.run.smithi174.stdout: "hostname": "smithi174", 2024-08-17T02:26:34.794 INFO:teuthology.orchestra.run.smithi174.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-08-17T02:26:34.794 INFO:teuthology.orchestra.run.smithi174.stdout: "pid": "30231", 2024-08-17T02:26:34.794 INFO:teuthology.orchestra.run.smithi174.stdout: "root": "/" 2024-08-17T02:26:34.794 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-08-17T02:26:34.794 INFO:teuthology.orchestra.run.smithi174.stdout: "dentry_count": 0, 2024-08-17T02:26:34.794 INFO:teuthology.orchestra.run.smithi174.stdout: "dentry_pinned_count": 0, 2024-08-17T02:26:34.794 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 4666, 2024-08-17T02:26:34.794 INFO:teuthology.orchestra.run.smithi174.stdout: "inst": { 2024-08-17T02:26:34.794 INFO:teuthology.orchestra.run.smithi174.stdout: "name": { 2024-08-17T02:26:34.794 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "client", 2024-08-17T02:26:34.795 INFO:teuthology.orchestra.run.smithi174.stdout: "num": 4666 2024-08-17T02:26:34.795 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-08-17T02:26:34.795 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": { 2024-08-17T02:26:34.795 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "v1", 2024-08-17T02:26:34.795 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": "192.168.0.2:0", 2024-08-17T02:26:34.795 INFO:teuthology.orchestra.run.smithi174.stdout: "nonce": 2911024952 2024-08-17T02:26:34.795 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-08-17T02:26:34.795 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-08-17T02:26:34.795 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": { 2024-08-17T02:26:34.795 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "v1", 2024-08-17T02:26:34.795 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": "192.168.0.2:0", 2024-08-17T02:26:34.795 INFO:teuthology.orchestra.run.smithi174.stdout: "nonce": 2911024952 2024-08-17T02:26:34.796 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-08-17T02:26:34.796 INFO:teuthology.orchestra.run.smithi174.stdout: "inst_str": "client.4666 192.168.0.2:0/2911024952", 2024-08-17T02:26:34.796 INFO:teuthology.orchestra.run.smithi174.stdout: "addr_str": "192.168.0.2:0/2911024952", 2024-08-17T02:26:34.796 INFO:teuthology.orchestra.run.smithi174.stdout: "inode_count": 1, 2024-08-17T02:26:34.796 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_epoch": 6, 2024-08-17T02:26:34.796 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_epoch": 21, 2024-08-17T02:26:34.796 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_epoch_barrier": 0, 2024-08-17T02:26:34.796 INFO:teuthology.orchestra.run.smithi174.stdout: "blocklisted": false, 2024-08-17T02:26:34.796 INFO:teuthology.orchestra.run.smithi174.stdout: "fs_name": "cephfs" 2024-08-17T02:26:34.796 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-08-17T02:26:34.802 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:34.803 DEBUG:teuthology.orchestra.run.smithi153:> stat --file-system '--printf=%T 2024-08-17T02:26:34.803 DEBUG:teuthology.orchestra.run.smithi153:> ' -- /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:34.812 INFO:teuthology.orchestra.run.smithi153.stdout:fuseblk 2024-08-17T02:26:34.812 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:34.812 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:34.812 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:34.873 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:34.874 DEBUG:teuthology.orchestra.run.smithi153:> stat --file-system '--printf=%T 2024-08-17T02:26:34.874 DEBUG:teuthology.orchestra.run.smithi153:> ' -- /home/ubuntu/cephtest/mnt.2 2024-08-17T02:26:34.882 INFO:teuthology.orchestra.run.smithi153.stdout:fuseblk 2024-08-17T02:26:34.882 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-08-17T02:26:34.882 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:34.882 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:26:34.903 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:34.903 DEBUG:teuthology.orchestra.run.smithi174:> stat --file-system '--printf=%T 2024-08-17T02:26:34.903 DEBUG:teuthology.orchestra.run.smithi174:> ' -- /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:34.911 INFO:teuthology.orchestra.run.smithi174.stdout:fuseblk 2024-08-17T02:26:34.911 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:34.911 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:34.911 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:34.969 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:34.969 DEBUG:teuthology.orchestra.run.smithi174:> stat --file-system '--printf=%T 2024-08-17T02:26:34.969 DEBUG:teuthology.orchestra.run.smithi174:> ' -- /home/ubuntu/cephtest/mnt.3 2024-08-17T02:26:34.977 INFO:teuthology.orchestra.run.smithi174.stdout:fuseblk 2024-08-17T02:26:34.977 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-08-17T02:26:34.977 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:34.977 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:26:34.989 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-08-17T02:26:35.016 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:35.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.133+0000 7f65b9857700 1 Processor -- start 2024-08-17T02:26:35.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.133+0000 7f65b9857700 1 -- start start 2024-08-17T02:26:35.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.137+0000 7f65b9857700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f65b41553e0 0x7f65b40af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.137+0000 7f65b9857700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65b40686a0 0x7f65b4068b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.137+0000 7f65b9857700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65b4155c00 con 0x7f65b41557b0 2024-08-17T02:26:35.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.137+0000 7f65b9857700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65b4069040 con 0x7f65b41553e0 2024-08-17T02:26:35.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.137+0000 7f65b9857700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b4155e30 con 0x7f65b40686a0 2024-08-17T02:26:35.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.137+0000 7f65b8855700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f65b41553e0 0x7f65b40af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.137+0000 7f65b9056700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65b40686a0 0x7f65b4068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.137+0000 7f65b8855700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f65b41553e0 0x7f65b40af4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.153:50368/0 (socket says 172.21.15.153:50368) 2024-08-17T02:26:35.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.137+0000 7f65b8855700 1 -- 172.21.15.153:0/3315744068 learned_addr learned my addr 172.21.15.153:0/3315744068 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:35.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.137+0000 7f65abfff700 1 --1- 172.21.15.153:0/3315744068 >> v1:172.21.15.174:6789/0 conn(0x7f65b41557b0 0x7f65b40b1d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.153:53410/0 (socket says 172.21.15.153:53410) 2024-08-17T02:26:35.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.137+0000 7f65b8855700 1 -- 172.21.15.153:0/3315744068 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65b40686a0 msgr2=0x7f65b4068b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:35.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.137+0000 7f65b8855700 1 --2- 172.21.15.153:0/3315744068 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65b40686a0 0x7f65b4068b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.137+0000 7f65b8855700 1 -- 172.21.15.153:0/3315744068 >> v1:172.21.15.174:6789/0 conn(0x7f65b41557b0 legacy=0x7f65b40b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.137+0000 7f65b8855700 1 -- 172.21.15.153:0/3315744068 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b4156110 con 0x7f65b41553e0 2024-08-17T02:26:35.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.137+0000 7f65b8855700 1 --2- 172.21.15.153:0/3315744068 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f65b41553e0 0x7f65b40af4d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f65b00099b0 tx=0x7f65b0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8dc99d72a7db7794 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.137+0000 7f65ab7fe700 1 -- 172.21.15.153:0/3315744068 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b0009ea0 con 0x7f65b41553e0 2024-08-17T02:26:35.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.137+0000 7f65ab7fe700 1 -- 172.21.15.153:0/3315744068 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b000b860 con 0x7f65b41553e0 2024-08-17T02:26:35.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.137+0000 7f65ab7fe700 1 -- 172.21.15.153:0/3315744068 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b000bc00 con 0x7f65b41553e0 2024-08-17T02:26:35.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.137+0000 7f65b9857700 1 -- 172.21.15.153:0/3315744068 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f65b41553e0 msgr2=0x7f65b40af4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.137+0000 7f65b9857700 1 --2- 172.21.15.153:0/3315744068 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f65b41553e0 0x7f65b40af4d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f65b00099b0 tx=0x7f65b0009250 comp rx=0 tx=0).stop 2024-08-17T02:26:35.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.137+0000 7f65b9857700 1 -- 172.21.15.153:0/3315744068 shutdown_connections 2024-08-17T02:26:35.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.137+0000 7f65b9857700 1 --2- 172.21.15.153:0/3315744068 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65b40686a0 0x7f65b4068b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.137+0000 7f65b9857700 1 --2- 172.21.15.153:0/3315744068 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f65b41553e0 0x7f65b40af4d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.137+0000 7f65b9857700 1 -- 172.21.15.153:0/3315744068 >> 172.21.15.153:0/3315744068 conn(0x7f65b406d800 msgr2=0x7f65b406dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:35.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.141+0000 7f65b9857700 1 -- 172.21.15.153:0/3315744068 shutdown_connections 2024-08-17T02:26:35.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.141+0000 7f65b9857700 1 -- 172.21.15.153:0/3315744068 wait complete. 2024-08-17T02:26:35.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.141+0000 7f65b9857700 1 Processor -- start 2024-08-17T02:26:35.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.141+0000 7f65b9857700 1 -- start start 2024-08-17T02:26:35.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.145+0000 7f65b9857700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65b40686a0 0x7f65b4167b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.145+0000 7f65b9857700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65b41553e0 0x7f65b40aa450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.145+0000 7f65b9857700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f65b41557b0 0x7f65b40aa990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.145+0000 7f65b9857700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b40ab300 con 0x7f65b40686a0 2024-08-17T02:26:35.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.145+0000 7f65b9857700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b4152b40 con 0x7f65b41557b0 2024-08-17T02:26:35.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.145+0000 7f65b9857700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b4169010 con 0x7f65b41553e0 2024-08-17T02:26:35.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.145+0000 7f65b8855700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65b40686a0 0x7f65b4167b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.145+0000 7f65b8855700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65b40686a0 0x7f65b4167b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59440/0 (socket says 172.21.15.153:59440) 2024-08-17T02:26:35.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.145+0000 7f65b8855700 1 -- 172.21.15.153:0/3233576984 learned_addr learned my addr 172.21.15.153:0/3233576984 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:35.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.145+0000 7f65b9056700 1 --2- 172.21.15.153:0/3233576984 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f65b41557b0 0x7f65b40aa990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.145+0000 7f65abfff700 1 --2- 172.21.15.153:0/3233576984 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65b41553e0 0x7f65b40aa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.145+0000 7f65b8855700 1 -- 172.21.15.153:0/3233576984 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65b41553e0 msgr2=0x7f65b40aa450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.145+0000 7f65b8855700 1 --2- 172.21.15.153:0/3233576984 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65b41553e0 0x7f65b40aa450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.145+0000 7f65b8855700 1 -- 172.21.15.153:0/3233576984 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f65b41557b0 msgr2=0x7f65b40aa990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.145+0000 7f65b8855700 1 --2- 172.21.15.153:0/3233576984 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f65b41557b0 0x7f65b40aa990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.145+0000 7f65b8855700 1 -- 172.21.15.153:0/3233576984 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b00094f0 con 0x7f65b40686a0 2024-08-17T02:26:35.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.145+0000 7f65b8855700 1 --2- 172.21.15.153:0/3233576984 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65b40686a0 0x7f65b4167b60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f65b000b3c0 tx=0x7f65b0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.145+0000 7f65a8ff9700 1 -- 172.21.15.153:0/3233576984 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b000bbe0 con 0x7f65b40686a0 2024-08-17T02:26:35.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.145+0000 7f65a8ff9700 1 -- 172.21.15.153:0/3233576984 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b0000c90 con 0x7f65b40686a0 2024-08-17T02:26:35.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.145+0000 7f65b9857700 1 -- 172.21.15.153:0/3233576984 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65b40ab020 con 0x7f65b40686a0 2024-08-17T02:26:35.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.145+0000 7f65a8ff9700 1 -- 172.21.15.153:0/3233576984 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b0011650 con 0x7f65b40686a0 2024-08-17T02:26:35.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.145+0000 7f65b9857700 1 -- 172.21.15.153:0/3233576984 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65b41527d0 con 0x7f65b40686a0 2024-08-17T02:26:35.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.149+0000 7f65b9857700 1 -- 172.21.15.153:0/3233576984 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65b4152350 con 0x7f65b40686a0 2024-08-17T02:26:35.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.149+0000 7f65a8ff9700 1 -- 172.21.15.153:0/3233576984 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f65b0011a80 con 0x7f65b40686a0 2024-08-17T02:26:35.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.149+0000 7f65a8ff9700 1 --2- 172.21.15.153:0/3233576984 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f65a0060860 0x7f65a0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.149+0000 7f65a8ff9700 1 -- 172.21.15.153:0/3233576984 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f65b007e3f0 con 0x7f65b40686a0 2024-08-17T02:26:35.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.149+0000 7f65abfff700 1 --2- 172.21.15.153:0/3233576984 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f65a0060860 0x7f65a0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.149+0000 7f65abfff700 1 --2- 172.21.15.153:0/3233576984 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f65a0060860 0x7f65a0062d10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f65b4068e60 tx=0x7f65a4007eb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.157+0000 7f65a8ff9700 1 -- 172.21.15.153:0/3233576984 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f65b4152350 con 0x7f65b40686a0 2024-08-17T02:26:35.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.321+0000 7f65b9857700 1 -- 172.21.15.153:0/3233576984 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65b4152350 con 0x7f65b40686a0 2024-08-17T02:26:35.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.325+0000 7f65a8ff9700 1 -- 172.21.15.153:0/3233576984 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f65b4152350 con 0x7f65b40686a0 2024-08-17T02:26:35.327 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:35.327 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":21,"fsid":"56d41c33-b929-456d-96be-2aac4ecd299d","created":"2024-08-17T02:25:47.756085+0000","modified":"2024-08-17T02:26:13.759246+0000","last_up_change":"2024-08-17T02:25:58.643690+0000","last_in_change":"2024-08-17T02:25:49.809186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:58.093273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:09.856520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:11.080706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0736f8e6-818e-42e6-a0dc-8aaf813315d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":24234},{"type":"v1","addr":"172.21.15.153:6817","nonce":24234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":24234},{"type":"v1","addr":"172.21.15.153:6819","nonce":24234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":24234},{"type":"v1","addr":"172.21.15.153:6823","nonce":24234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":24234},{"type":"v1","addr":"172.21.15.153:6821","nonce":24234}]},"public_addr":"172.21.15.153:6817/24234","cluster_addr":"172.21.15.153:6819/24234","heartbeat_back_addr":"172.21.15.153:6823/24234","heartbeat_front_addr":"172.21.15.153:6821/24234","state":["exists","up"]},{"osd":1,"uuid":"011762e9-6c2d-441a-aa56-68474639d72f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":24232},{"type":"v1","addr":"172.21.15.153:6801","nonce":24232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":24232},{"type":"v1","addr":"172.21.15.153:6803","nonce":24232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":24232},{"type":"v1","addr":"172.21.15.153:6809","nonce":24232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":24232},{"type":"v1","addr":"172.21.15.153:6806","nonce":24232}]},"public_addr":"172.21.15.153:6801/24232","cluster_addr":"172.21.15.153:6803/24232","heartbeat_back_addr":"172.21.15.153:6809/24232","heartbeat_front_addr":"172.21.15.153:6806/24232","state":["exists","up"]},{"osd":2,"uuid":"b562cd97-aa12-455e-b46a-e720a2ec9d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":24235},{"type":"v1","addr":"172.21.15.153:6808","nonce":24235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":24235},{"type":"v1","addr":"172.21.15.153:6811","nonce":24235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":24235},{"type":"v1","addr":"172.21.15.153:6815","nonce":24235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":24235},{"type":"v1","addr":"172.21.15.153:6813","nonce":24235}]},"public_addr":"172.21.15.153:6808/24235","cluster_addr":"172.21.15.153:6811/24235","heartbeat_back_addr":"172.21.15.153:6815/24235","heartbeat_front_addr":"172.21.15.153:6813/24235","state":["exists","up"]},{"osd":3,"uuid":"222da52f-90c2-4132-a5d2-6f6cf83d4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":24236},{"type":"v1","addr":"172.21.15.153:6825","nonce":24236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":24236},{"type":"v1","addr":"172.21.15.153:6827","nonce":24236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":24236},{"type":"v1","addr":"172.21.15.153:6831","nonce":24236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":24236},{"type":"v1","addr":"172.21.15.153:6829","nonce":24236}]},"public_addr":"172.21.15.153:6825/24236","cluster_addr":"172.21.15.153:6827/24236","heartbeat_back_addr":"172.21.15.153:6831/24236","heartbeat_front_addr":"172.21.15.153:6829/24236","state":["exists","up"]},{"osd":4,"uuid":"a38a04cd-032b-4977-a260-1ef3567d0c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24456},{"type":"v1","addr":"172.21.15.174:6809","nonce":24456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24456},{"type":"v1","addr":"172.21.15.174:6811","nonce":24456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24456},{"type":"v1","addr":"172.21.15.174:6815","nonce":24456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24456},{"type":"v1","addr":"172.21.15.174:6813","nonce":24456}]},"public_addr":"172.21.15.174:6809/24456","cluster_addr":"172.21.15.174:6811/24456","heartbeat_back_addr":"172.21.15.174:6815/24456","heartbeat_front_addr":"172.21.15.174:6813/24456","state":["exists","up"]},{"osd":5,"uuid":"c7778084-e751-48da-87a1-ab8bbe85aa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24457},{"type":"v1","addr":"172.21.15.174:6825","nonce":24457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24457},{"type":"v1","addr":"172.21.15.174:6827","nonce":24457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24457},{"type":"v1","addr":"172.21.15.174:6831","nonce":24457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24457},{"type":"v1","addr":"172.21.15.174:6829","nonce":24457}]},"public_addr":"172.21.15.174:6825/24457","cluster_addr":"172.21.15.174:6827/24457","heartbeat_back_addr":"172.21.15.174:6831/24457","heartbeat_front_addr":"172.21.15.174:6829/24457","state":["exists","up"]},{"osd":6,"uuid":"2d8e0715-254f-442c-9625-50721d0bc858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24477},{"type":"v1","addr":"172.21.15.174:6801","nonce":24477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24477},{"type":"v1","addr":"172.21.15.174:6803","nonce":24477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24477},{"type":"v1","addr":"172.21.15.174:6807","nonce":24477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24477},{"type":"v1","addr":"172.21.15.174:6805","nonce":24477}]},"public_addr":"172.21.15.174:6801/24477","cluster_addr":"172.21.15.174:6803/24477","heartbeat_back_addr":"172.21.15.174:6807/24477","heartbeat_front_addr":"172.21.15.174:6805/24477","state":["exists","up"]},{"osd":7,"uuid":"dffda25a-4601-4ddb-9a27-b0be1cadde27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24455},{"type":"v1","addr":"172.21.15.174:6817","nonce":24455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24455},{"type":"v1","addr":"172.21.15.174:6819","nonce":24455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24455},{"type":"v1","addr":"172.21.15.174:6823","nonce":24455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24455},{"type":"v1","addr":"172.21.15.174:6821","nonce":24455}]},"public_addr":"172.21.15.174:6817/24455","cluster_addr":"172.21.15.174:6819/24455","heartbeat_back_addr":"172.21.15.174:6823/24455","heartbeat_front_addr":"172.21.15.174:6821/24455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.990117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.033862+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.748087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.112877+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.070448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.360961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.110940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.226377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:35.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.325+0000 7f65b9857700 1 -- 172.21.15.153:0/3233576984 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f65a0060860 msgr2=0x7f65a0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.325+0000 7f65b9857700 1 --2- 172.21.15.153:0/3233576984 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f65a0060860 0x7f65a0062d10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f65b4068e60 tx=0x7f65a4007eb0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.325+0000 7f65b9857700 1 -- 172.21.15.153:0/3233576984 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65b40686a0 msgr2=0x7f65b4167b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.325+0000 7f65b9857700 1 --2- 172.21.15.153:0/3233576984 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65b40686a0 0x7f65b4167b60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f65b000b3c0 tx=0x7f65b0017000 comp rx=0 tx=0).stop 2024-08-17T02:26:35.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.325+0000 7f65b9857700 1 -- 172.21.15.153:0/3233576984 shutdown_connections 2024-08-17T02:26:35.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.325+0000 7f65b9857700 1 --2- 172.21.15.153:0/3233576984 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f65a0060860 0x7f65a0062d10 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.325+0000 7f65b9857700 1 --2- 172.21.15.153:0/3233576984 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f65b41557b0 0x7f65b40aa990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.325+0000 7f65b9857700 1 --2- 172.21.15.153:0/3233576984 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65b41553e0 0x7f65b40aa450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.325+0000 7f65b9857700 1 --2- 172.21.15.153:0/3233576984 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65b40686a0 0x7f65b4167b60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.325+0000 7f65b9857700 1 -- 172.21.15.153:0/3233576984 >> 172.21.15.153:0/3233576984 conn(0x7f65b406d800 msgr2=0x7f65b4067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:35.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.325+0000 7f65b9857700 1 -- 172.21.15.153:0/3233576984 shutdown_connections 2024-08-17T02:26:35.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.325+0000 7f65b9857700 1 -- 172.21.15.153:0/3233576984 wait complete. 2024-08-17T02:26:35.347 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:58.093273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:26:09.856520+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:26:11.080706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:26:35.347 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:35.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.449+0000 7fc1ab59e700 1 Processor -- start 2024-08-17T02:26:35.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.449+0000 7fc1ab59e700 1 -- start start 2024-08-17T02:26:35.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.449+0000 7fc1ab59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1ac156ed0 0x7fc1ac0afed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.449+0000 7fc1ab59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc1ac0b0de0 0x7fc1ac0b2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.449+0000 7fc1ab59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1ac0afa40 con 0x7fc1ac0ae950 2024-08-17T02:26:35.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.449+0000 7fc1ab59e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1ac0aee30 con 0x7fc1ac0b0de0 2024-08-17T02:26:35.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.449+0000 7fc1ab59e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac0af110 con 0x7fc1ac156ed0 2024-08-17T02:26:35.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.449+0000 7fc1a9d9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc1ac0b0de0 0x7fc1ac0b2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.449+0000 7fc1aad9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc1ac0ae950 0x7fc1ac0cba00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:60034/0 (socket says 172.21.15.153:60034) 2024-08-17T02:26:35.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.449+0000 7fc1aad9d700 1 -- 172.21.15.153:0/3503202893 learned_addr learned my addr 172.21.15.153:0/3503202893 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:35.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.449+0000 7fc1aa59c700 1 --2- 172.21.15.153:0/3503202893 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1ac156ed0 0x7fc1ac0afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.449+0000 7fc1a9d9b700 1 -- 172.21.15.153:0/3503202893 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1ac156ed0 msgr2=0x7fc1ac0afed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:35.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.449+0000 7fc1a9d9b700 1 --2- 172.21.15.153:0/3503202893 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1ac156ed0 0x7fc1ac0afed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.449+0000 7fc1a9d9b700 1 -- 172.21.15.153:0/3503202893 >> v1:172.21.15.153:6789/0 conn(0x7fc1ac0ae950 legacy=0x7fc1ac0cba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.449+0000 7fc1a959a700 1 -- 172.21.15.153:0/3503202893 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1527097259 0 0) 0x7fc1ac0afa40 con 0x7fc1ac0ae950 2024-08-17T02:26:35.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.449+0000 7fc1a9d9b700 1 -- 172.21.15.153:0/3503202893 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ac0af3f0 con 0x7fc1ac0b0de0 2024-08-17T02:26:35.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.449+0000 7fc1a9d9b700 1 --2- 172.21.15.153:0/3503202893 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1ac0b0de0 0x7fc1ac0b2ed0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4009e60 tx=0x7fc1a4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f0ec45e88c3cf29 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.449+0000 7fc1a959a700 1 -- 172.21.15.153:0/3503202893 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a400e070 con 0x7fc1ac0b0de0 2024-08-17T02:26:35.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.449+0000 7fc1a959a700 1 -- 172.21.15.153:0/3503202893 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a400bb60 con 0x7fc1ac0b0de0 2024-08-17T02:26:35.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.449+0000 7fc1a959a700 1 -- 172.21.15.153:0/3503202893 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a4012430 con 0x7fc1ac0b0de0 2024-08-17T02:26:35.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.449+0000 7fc1ab59e700 1 -- 172.21.15.153:0/3503202893 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1ac0b0de0 msgr2=0x7fc1ac0b2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.449+0000 7fc1ab59e700 1 --2- 172.21.15.153:0/3503202893 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1ac0b0de0 0x7fc1ac0b2ed0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4009e60 tx=0x7fc1a4009780 comp rx=0 tx=0).stop 2024-08-17T02:26:35.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.453+0000 7fc1ab59e700 1 -- 172.21.15.153:0/3503202893 shutdown_connections 2024-08-17T02:26:35.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.453+0000 7fc1ab59e700 1 --2- 172.21.15.153:0/3503202893 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1ac0b0de0 0x7fc1ac0b2ed0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.453+0000 7fc1ab59e700 1 --2- 172.21.15.153:0/3503202893 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1ac156ed0 0x7fc1ac0afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.453+0000 7fc1ab59e700 1 -- 172.21.15.153:0/3503202893 >> 172.21.15.153:0/3503202893 conn(0x7fc1ac0ce990 msgr2=0x7fc1ac06c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:35.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.453+0000 7fc1ab59e700 1 -- 172.21.15.153:0/3503202893 shutdown_connections 2024-08-17T02:26:35.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.453+0000 7fc1ab59e700 1 -- 172.21.15.153:0/3503202893 wait complete. 2024-08-17T02:26:35.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.453+0000 7fc1ab59e700 1 Processor -- start 2024-08-17T02:26:35.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.453+0000 7fc1ab59e700 1 -- start start 2024-08-17T02:26:35.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.453+0000 7fc1ab59e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1ac0ae950 0x7fc1ac1449e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.453+0000 7fc1ab59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1ac156ed0 0x7fc1ac0c2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.453+0000 7fc1ab59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1ac167140 0x7fc1ac0c31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.453+0000 7fc1ab59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac1586b0 con 0x7fc1ac167140 2024-08-17T02:26:35.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.453+0000 7fc1ab59e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac157ae0 con 0x7fc1ac0ae950 2024-08-17T02:26:35.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.453+0000 7fc1ab59e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac157d80 con 0x7fc1ac156ed0 2024-08-17T02:26:35.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.453+0000 7fc1aad9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1ac167140 0x7fc1ac0c31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.453+0000 7fc1aa59c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1ac0ae950 0x7fc1ac1449e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.453+0000 7fc1aad9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1ac167140 0x7fc1ac0c31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59454/0 (socket says 172.21.15.153:59454) 2024-08-17T02:26:35.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.453+0000 7fc1aad9d700 1 -- 172.21.15.153:0/3583201848 learned_addr learned my addr 172.21.15.153:0/3583201848 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:35.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.453+0000 7fc1a9d9b700 1 --2- 172.21.15.153:0/3583201848 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1ac156ed0 0x7fc1ac0c2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.457+0000 7fc1aa59c700 1 -- 172.21.15.153:0/3583201848 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1ac156ed0 msgr2=0x7fc1ac0c2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.457+0000 7fc1aa59c700 1 --2- 172.21.15.153:0/3583201848 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1ac156ed0 0x7fc1ac0c2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.457+0000 7fc1aa59c700 1 -- 172.21.15.153:0/3583201848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1ac167140 msgr2=0x7fc1ac0c31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.457+0000 7fc1aa59c700 1 --2- 172.21.15.153:0/3583201848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1ac167140 0x7fc1ac0c31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.457+0000 7fc1aa59c700 1 -- 172.21.15.153:0/3583201848 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a4009a20 con 0x7fc1ac0ae950 2024-08-17T02:26:35.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.457+0000 7fc1aad9d700 1 --2- 172.21.15.153:0/3583201848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1ac167140 0x7fc1ac0c31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:35.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.457+0000 7fc1aa59c700 1 --2- 172.21.15.153:0/3583201848 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1ac0ae950 0x7fc1ac1449e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc19400e9d0 tx=0x7fc1940091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.457+0000 7fc1a27fc700 1 -- 172.21.15.153:0/3583201848 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc194013680 con 0x7fc1ac0ae950 2024-08-17T02:26:35.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.457+0000 7fc1a27fc700 1 -- 172.21.15.153:0/3583201848 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc194013800 con 0x7fc1ac0ae950 2024-08-17T02:26:35.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.457+0000 7fc1a27fc700 1 -- 172.21.15.153:0/3583201848 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc194013bc0 con 0x7fc1ac0ae950 2024-08-17T02:26:35.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.457+0000 7fc1ab59e700 1 -- 172.21.15.153:0/3583201848 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1ac158060 con 0x7fc1ac0ae950 2024-08-17T02:26:35.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.457+0000 7fc1ab59e700 1 -- 172.21.15.153:0/3583201848 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1ac144f20 con 0x7fc1ac0ae950 2024-08-17T02:26:35.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.457+0000 7fc1ab59e700 1 -- 172.21.15.153:0/3583201848 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1ac064330 con 0x7fc1ac0ae950 2024-08-17T02:26:35.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.457+0000 7fc1a27fc700 1 -- 172.21.15.153:0/3583201848 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc19400c490 con 0x7fc1ac0ae950 2024-08-17T02:26:35.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.457+0000 7fc1a27fc700 1 --2- 172.21.15.153:0/3583201848 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fc18c060890 0x7fc18c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.461+0000 7fc1a27fc700 1 -- 172.21.15.153:0/3583201848 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc19407d250 con 0x7fc1ac0ae950 2024-08-17T02:26:35.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.461+0000 7fc1a9d9b700 1 --2- 172.21.15.153:0/3583201848 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fc18c060890 0x7fc18c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.461+0000 7fc1a9d9b700 1 --2- 172.21.15.153:0/3583201848 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fc18c060890 0x7fc18c062d40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc1a40097c0 tx=0x7fc1a4019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.469+0000 7fc1a27fc700 1 -- 172.21.15.153:0/3583201848 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc19404d720 con 0x7fc1ac0ae950 2024-08-17T02:26:35.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.633+0000 7fc1ab59e700 1 -- 172.21.15.153:0/3583201848 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc1ac155e40 con 0x7fc1ac0ae950 2024-08-17T02:26:35.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.633+0000 7fc1a27fc700 1 -- 172.21.15.153:0/3583201848 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc194050d40 con 0x7fc1ac0ae950 2024-08-17T02:26:35.638 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2024-08-17T02:26:35.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.637+0000 7fc1ab59e700 1 -- 172.21.15.153:0/3583201848 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fc18c060890 msgr2=0x7fc18c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.637+0000 7fc1ab59e700 1 --2- 172.21.15.153:0/3583201848 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fc18c060890 0x7fc18c062d40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc1a40097c0 tx=0x7fc1a4019000 comp rx=0 tx=0).stop 2024-08-17T02:26:35.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.637+0000 7fc1ab59e700 1 -- 172.21.15.153:0/3583201848 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1ac0ae950 msgr2=0x7fc1ac1449e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.637+0000 7fc1ab59e700 1 --2- 172.21.15.153:0/3583201848 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1ac0ae950 0x7fc1ac1449e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc19400e9d0 tx=0x7fc1940091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.637+0000 7fc1ab59e700 1 -- 172.21.15.153:0/3583201848 shutdown_connections 2024-08-17T02:26:35.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.637+0000 7fc1ab59e700 1 --2- 172.21.15.153:0/3583201848 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fc18c060890 0x7fc18c062d40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.637+0000 7fc1ab59e700 1 --2- 172.21.15.153:0/3583201848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1ac167140 0x7fc1ac0c31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.637+0000 7fc1ab59e700 1 --2- 172.21.15.153:0/3583201848 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1ac156ed0 0x7fc1ac0c2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.637+0000 7fc1ab59e700 1 --2- 172.21.15.153:0/3583201848 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1ac0ae950 0x7fc1ac1449e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.637+0000 7fc1ab59e700 1 -- 172.21.15.153:0/3583201848 >> 172.21.15.153:0/3583201848 conn(0x7fc1ac0ce990 msgr2=0x7fc1ac0cb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:35.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.641+0000 7fc1ab59e700 1 -- 172.21.15.153:0/3583201848 shutdown_connections 2024-08-17T02:26:35.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.641+0000 7fc1ab59e700 1 -- 172.21.15.153:0/3583201848 wait complete. 2024-08-17T02:26:35.657 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:26:35.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.777+0000 7f639399a700 1 Processor -- start 2024-08-17T02:26:35.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.777+0000 7f639399a700 1 -- start start 2024-08-17T02:26:35.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.777+0000 7f639399a700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f638c0a9040 0x7f638c0a9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.777+0000 7f639399a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f638c06d5b0 0x7f638c06da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.777+0000 7f639399a700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f638c06ee60 con 0x7f638c142430 2024-08-17T02:26:35.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.777+0000 7f639399a700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f638c06e2e0 con 0x7f638c0a9040 2024-08-17T02:26:35.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.777+0000 7f639399a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f638c06e5c0 con 0x7f638c06d5b0 2024-08-17T02:26:35.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.777+0000 7f6391736700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f638c0a9040 0x7f638c0a9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.777+0000 7f6390f35700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f638c142430 0x7f638c1428b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:60038/0 (socket says 172.21.15.153:60038) 2024-08-17T02:26:35.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.777+0000 7f6390f35700 1 -- 172.21.15.153:0/2168340166 learned_addr learned my addr 172.21.15.153:0/2168340166 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:35.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.777+0000 7f6391f37700 1 --2- 172.21.15.153:0/2168340166 >> v2:172.21.15.174:3300/0 conn(0x7f638c06d5b0 0x7f638c06da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.777+0000 7f6391736700 1 -- 172.21.15.153:0/2168340166 >> v2:172.21.15.174:3300/0 conn(0x7f638c06d5b0 msgr2=0x7f638c06da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:35.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.777+0000 7f6391736700 1 --2- 172.21.15.153:0/2168340166 >> v2:172.21.15.174:3300/0 conn(0x7f638c06d5b0 0x7f638c06da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.777+0000 7f6391736700 1 -- 172.21.15.153:0/2168340166 >> v1:172.21.15.153:6789/0 conn(0x7f638c142430 legacy=0x7f638c1428b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.777+0000 7f637ffff700 1 -- 172.21.15.153:0/2168340166 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3446866418 0 0) 0x7f638c06ee60 con 0x7f638c142430 2024-08-17T02:26:35.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.777+0000 7f6391736700 1 -- 172.21.15.153:0/2168340166 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638c06e8a0 con 0x7f638c0a9040 2024-08-17T02:26:35.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.777+0000 7f6391736700 1 --2- 172.21.15.153:0/2168340166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f638c0a9040 0x7f638c0a9410 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f638c142fc0 tx=0x7f63880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a67c5a50422bc316 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.777+0000 7f637ffff700 1 -- 172.21.15.153:0/2168340166 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6388011630 con 0x7f638c0a9040 2024-08-17T02:26:35.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.777+0000 7f637ffff700 1 -- 172.21.15.153:0/2168340166 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6388011790 con 0x7f638c0a9040 2024-08-17T02:26:35.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.777+0000 7f637ffff700 1 -- 172.21.15.153:0/2168340166 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6388011b30 con 0x7f638c0a9040 2024-08-17T02:26:35.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.781+0000 7f639399a700 1 -- 172.21.15.153:0/2168340166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f638c0a9040 msgr2=0x7f638c0a9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.781+0000 7f639399a700 1 --2- 172.21.15.153:0/2168340166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f638c0a9040 0x7f638c0a9410 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f638c142fc0 tx=0x7f63880091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.781+0000 7f639399a700 1 -- 172.21.15.153:0/2168340166 shutdown_connections 2024-08-17T02:26:35.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.781+0000 7f639399a700 1 --2- 172.21.15.153:0/2168340166 >> v2:172.21.15.174:3300/0 conn(0x7f638c06d5b0 0x7f638c06da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.781+0000 7f639399a700 1 --2- 172.21.15.153:0/2168340166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f638c0a9040 0x7f638c0a9410 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.781+0000 7f639399a700 1 -- 172.21.15.153:0/2168340166 >> 172.21.15.153:0/2168340166 conn(0x7f638c066e00 msgr2=0x7f638c067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:35.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.781+0000 7f639399a700 1 -- 172.21.15.153:0/2168340166 shutdown_connections 2024-08-17T02:26:35.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.781+0000 7f639399a700 1 -- 172.21.15.153:0/2168340166 wait complete. 2024-08-17T02:26:35.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.781+0000 7f639399a700 1 Processor -- start 2024-08-17T02:26:35.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.785+0000 7f639399a700 1 -- start start 2024-08-17T02:26:35.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.785+0000 7f639399a700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f638c06d5b0 0x7f638c140870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.785+0000 7f639399a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f638c0a9040 0x7f638c0ad300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.785+0000 7f639399a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f638c142430 0x7f638c0ac280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.785+0000 7f639399a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638c1406b0 con 0x7f638c0a9040 2024-08-17T02:26:35.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.785+0000 7f639399a700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638c1401c0 con 0x7f638c06d5b0 2024-08-17T02:26:35.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.785+0000 7f639399a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f638c0add10 con 0x7f638c142430 2024-08-17T02:26:35.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.785+0000 7f6390f35700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f638c0a9040 0x7f638c0ad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.785+0000 7f6390f35700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f638c0a9040 0x7f638c0ad300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59480/0 (socket says 172.21.15.153:59480) 2024-08-17T02:26:35.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.785+0000 7f6390f35700 1 -- 172.21.15.153:0/912212412 learned_addr learned my addr 172.21.15.153:0/912212412 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:35.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.785+0000 7f6391736700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f638c06d5b0 0x7f638c140870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.785+0000 7f6391f37700 1 --2- 172.21.15.153:0/912212412 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f638c142430 0x7f638c0ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.785+0000 7f6390f35700 1 -- 172.21.15.153:0/912212412 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f638c142430 msgr2=0x7f638c0ac280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.785+0000 7f6390f35700 1 --2- 172.21.15.153:0/912212412 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f638c142430 0x7f638c0ac280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.785+0000 7f6390f35700 1 -- 172.21.15.153:0/912212412 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f638c06d5b0 msgr2=0x7f638c140870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.785+0000 7f6390f35700 1 --2- 172.21.15.153:0/912212412 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f638c06d5b0 0x7f638c140870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.785+0000 7f6390f35700 1 -- 172.21.15.153:0/912212412 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6388009420 con 0x7f638c0a9040 2024-08-17T02:26:35.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.785+0000 7f6390f35700 1 --2- 172.21.15.153:0/912212412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f638c0a9040 0x7f638c0ad300 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f638000c5b0 tx=0x7f6380001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.785+0000 7f637d7fa700 1 -- 172.21.15.153:0/912212412 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6380005b30 con 0x7f638c0a9040 2024-08-17T02:26:35.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.785+0000 7f637d7fa700 1 -- 172.21.15.153:0/912212412 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6380005c90 con 0x7f638c0a9040 2024-08-17T02:26:35.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.785+0000 7f639399a700 1 -- 172.21.15.153:0/912212412 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f638c1403d0 con 0x7f638c0a9040 2024-08-17T02:26:35.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.785+0000 7f637d7fa700 1 -- 172.21.15.153:0/912212412 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6380007300 con 0x7f638c0a9040 2024-08-17T02:26:35.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.785+0000 7f639399a700 1 -- 172.21.15.153:0/912212412 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f638c0abe50 con 0x7f638c0a9040 2024-08-17T02:26:35.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.789+0000 7f639399a700 1 -- 172.21.15.153:0/912212412 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f638c16a4c0 con 0x7f638c0a9040 2024-08-17T02:26:35.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.789+0000 7f637d7fa700 1 -- 172.21.15.153:0/912212412 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f638001b3b0 con 0x7f638c0a9040 2024-08-17T02:26:35.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.789+0000 7f637d7fa700 1 --2- 172.21.15.153:0/912212412 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6370060890 0x7f6370062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.789+0000 7f6391736700 1 --2- 172.21.15.153:0/912212412 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6370060890 0x7f6370062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.789+0000 7f637d7fa700 1 -- 172.21.15.153:0/912212412 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f638007bff0 con 0x7f638c0a9040 2024-08-17T02:26:35.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.793+0000 7f6391736700 1 --2- 172.21.15.153:0/912212412 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6370060890 0x7f6370062d40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f63880093f0 tx=0x7f6388017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.797+0000 7f637d7fa700 1 -- 172.21.15.153:0/912212412 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f638c16a4c0 con 0x7f638c0a9040 2024-08-17T02:26:35.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.961+0000 7f639399a700 1 -- 172.21.15.153:0/912212412 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f638c16a4c0 con 0x7f638c0a9040 2024-08-17T02:26:35.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.961+0000 7f637d7fa700 1 -- 172.21.15.153:0/912212412 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f638c16a4c0 con 0x7f638c0a9040 2024-08-17T02:26:35.964 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2024-08-17T02:26:35.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.961+0000 7f639399a700 1 -- 172.21.15.153:0/912212412 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6370060890 msgr2=0x7f6370062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.965+0000 7f639399a700 1 --2- 172.21.15.153:0/912212412 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6370060890 0x7f6370062d40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f63880093f0 tx=0x7f6388017000 comp rx=0 tx=0).stop 2024-08-17T02:26:35.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.965+0000 7f639399a700 1 -- 172.21.15.153:0/912212412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f638c0a9040 msgr2=0x7f638c0ad300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.965+0000 7f639399a700 1 --2- 172.21.15.153:0/912212412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f638c0a9040 0x7f638c0ad300 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f638000c5b0 tx=0x7f6380001070 comp rx=0 tx=0).stop 2024-08-17T02:26:35.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.965+0000 7f639399a700 1 -- 172.21.15.153:0/912212412 shutdown_connections 2024-08-17T02:26:35.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.965+0000 7f639399a700 1 --2- 172.21.15.153:0/912212412 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6370060890 0x7f6370062d40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.965+0000 7f639399a700 1 --2- 172.21.15.153:0/912212412 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f638c142430 0x7f638c0ac280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.965+0000 7f639399a700 1 --2- 172.21.15.153:0/912212412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f638c0a9040 0x7f638c0ad300 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.965+0000 7f639399a700 1 --2- 172.21.15.153:0/912212412 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f638c06d5b0 0x7f638c140870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.965+0000 7f639399a700 1 -- 172.21.15.153:0/912212412 >> 172.21.15.153:0/912212412 conn(0x7f638c066e00 msgr2=0x7f638c0cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:35.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.965+0000 7f639399a700 1 -- 172.21.15.153:0/912212412 shutdown_connections 2024-08-17T02:26:35.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:35.965+0000 7f639399a700 1 -- 172.21.15.153:0/912212412 wait complete. 2024-08-17T02:26:35.978 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:26:36.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.085+0000 7fcb58952700 1 Processor -- start 2024-08-17T02:26:36.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.085+0000 7fcb58952700 1 -- start start 2024-08-17T02:26:36.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.089+0000 7fcb58952700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb54159300 0x7fcb540b2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.089+0000 7fcb58952700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcb54067510 0x7fcb540cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.089+0000 7fcb58952700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb540cba90 con 0x7fcb541596d0 2024-08-17T02:26:36.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.089+0000 7fcb58952700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb540b2b60 con 0x7fcb54067510 2024-08-17T02:26:36.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.089+0000 7fcb58952700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb540cb160 con 0x7fcb54159300 2024-08-17T02:26:36.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.089+0000 7fcb52d9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcb54067510 0x7fcb540cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.089+0000 7fcb51d9b700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fcb541596d0 0x7fcb54066e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:60040/0 (socket says 172.21.15.153:60040) 2024-08-17T02:26:36.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.089+0000 7fcb52d9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcb54067510 0x7fcb540cbf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59490/0 (socket says 172.21.15.153:59490) 2024-08-17T02:26:36.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.089+0000 7fcb51d9b700 1 -- 172.21.15.153:0/1087951874 learned_addr learned my addr 172.21.15.153:0/1087951874 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:36.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.089+0000 7fcb5259c700 1 --2- 172.21.15.153:0/1087951874 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb54159300 0x7fcb540b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.089+0000 7fcb52d9d700 1 -- 172.21.15.153:0/1087951874 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb54159300 msgr2=0x7fcb540b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:36.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.089+0000 7fcb52d9d700 1 --2- 172.21.15.153:0/1087951874 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb54159300 0x7fcb540b2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.089+0000 7fcb52d9d700 1 -- 172.21.15.153:0/1087951874 >> v1:172.21.15.153:6789/0 conn(0x7fcb541596d0 legacy=0x7fcb54066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.089+0000 7fcb5159a700 1 -- 172.21.15.153:0/1087951874 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3032732609 0 0) 0x7fcb540cba90 con 0x7fcb541596d0 2024-08-17T02:26:36.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.089+0000 7fcb52d9d700 1 -- 172.21.15.153:0/1087951874 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb540cb440 con 0x7fcb54067510 2024-08-17T02:26:36.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.089+0000 7fcb52d9d700 1 --2- 172.21.15.153:0/1087951874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb54067510 0x7fcb540cbf20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c009e60 tx=0x7fcb4c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e0b5a9c5ec4146 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:36.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.089+0000 7fcb5159a700 1 -- 172.21.15.153:0/1087951874 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c00e070 con 0x7fcb54067510 2024-08-17T02:26:36.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.089+0000 7fcb5159a700 1 -- 172.21.15.153:0/1087951874 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4c00bb60 con 0x7fcb54067510 2024-08-17T02:26:36.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.089+0000 7fcb5159a700 1 -- 172.21.15.153:0/1087951874 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c012430 con 0x7fcb54067510 2024-08-17T02:26:36.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.089+0000 7fcb58952700 1 -- 172.21.15.153:0/1087951874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb54067510 msgr2=0x7fcb540cbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.089+0000 7fcb58952700 1 --2- 172.21.15.153:0/1087951874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb54067510 0x7fcb540cbf20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c009e60 tx=0x7fcb4c009780 comp rx=0 tx=0).stop 2024-08-17T02:26:36.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.089+0000 7fcb58952700 1 -- 172.21.15.153:0/1087951874 shutdown_connections 2024-08-17T02:26:36.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.089+0000 7fcb58952700 1 --2- 172.21.15.153:0/1087951874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb54067510 0x7fcb540cbf20 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.089+0000 7fcb58952700 1 --2- 172.21.15.153:0/1087951874 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb54159300 0x7fcb540b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.089+0000 7fcb58952700 1 -- 172.21.15.153:0/1087951874 >> 172.21.15.153:0/1087951874 conn(0x7fcb540682c0 msgr2=0x7fcb540686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:36.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.089+0000 7fcb58952700 1 -- 172.21.15.153:0/1087951874 shutdown_connections 2024-08-17T02:26:36.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.089+0000 7fcb58952700 1 -- 172.21.15.153:0/1087951874 wait complete. 2024-08-17T02:26:36.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.093+0000 7fcb58952700 1 Processor -- start 2024-08-17T02:26:36.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.093+0000 7fcb58952700 1 -- start start 2024-08-17T02:26:36.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.093+0000 7fcb58952700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb54067510 0x7fcb54156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.093+0000 7fcb58952700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb54159300 0x7fcb540c7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.093+0000 7fcb58952700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb541596d0 0x7fcb5415ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.093+0000 7fcb58952700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb540c40c0 con 0x7fcb54067510 2024-08-17T02:26:36.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.093+0000 7fcb58952700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb540c7b60 con 0x7fcb54159300 2024-08-17T02:26:36.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.093+0000 7fcb58952700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb540c7e40 con 0x7fcb541596d0 2024-08-17T02:26:36.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.093+0000 7fcb5259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb54067510 0x7fcb54156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.097+0000 7fcb5259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb54067510 0x7fcb54156db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59506/0 (socket says 172.21.15.153:59506) 2024-08-17T02:26:36.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.097+0000 7fcb5259c700 1 -- 172.21.15.153:0/3764170032 learned_addr learned my addr 172.21.15.153:0/3764170032 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:36.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.097+0000 7fcb51d9b700 1 --2- 172.21.15.153:0/3764170032 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb54159300 0x7fcb540c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.097+0000 7fcb52d9d700 1 --2- 172.21.15.153:0/3764170032 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb541596d0 0x7fcb5415ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.097+0000 7fcb5259c700 1 -- 172.21.15.153:0/3764170032 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb541596d0 msgr2=0x7fcb5415ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.097+0000 7fcb5259c700 1 --2- 172.21.15.153:0/3764170032 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb541596d0 0x7fcb5415ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.097+0000 7fcb5259c700 1 -- 172.21.15.153:0/3764170032 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb54159300 msgr2=0x7fcb540c7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.097+0000 7fcb5259c700 1 --2- 172.21.15.153:0/3764170032 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb54159300 0x7fcb540c7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.097+0000 7fcb5259c700 1 -- 172.21.15.153:0/3764170032 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb4c009a20 con 0x7fcb54067510 2024-08-17T02:26:36.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.097+0000 7fcb5259c700 1 --2- 172.21.15.153:0/3764170032 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb54067510 0x7fcb54156db0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400ec80 tx=0x7fcb440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:36.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.097+0000 7fcb427fc700 1 -- 172.21.15.153:0/3764170032 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4400c850 con 0x7fcb54067510 2024-08-17T02:26:36.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.097+0000 7fcb427fc700 1 -- 172.21.15.153:0/3764170032 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4400c9b0 con 0x7fcb54067510 2024-08-17T02:26:36.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.097+0000 7fcb427fc700 1 -- 172.21.15.153:0/3764170032 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4400cd50 con 0x7fcb54067510 2024-08-17T02:26:36.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.097+0000 7fcb58952700 1 -- 172.21.15.153:0/3764170032 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb540c8120 con 0x7fcb54067510 2024-08-17T02:26:36.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.097+0000 7fcb58952700 1 -- 172.21.15.153:0/3764170032 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb541572f0 con 0x7fcb54067510 2024-08-17T02:26:36.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.097+0000 7fcb58952700 1 -- 172.21.15.153:0/3764170032 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb540645c0 con 0x7fcb54067510 2024-08-17T02:26:36.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.097+0000 7fcb427fc700 1 -- 172.21.15.153:0/3764170032 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fcb44013680 con 0x7fcb54067510 2024-08-17T02:26:36.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.097+0000 7fcb427fc700 1 --2- 172.21.15.153:0/3764170032 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fcb34060890 0x7fcb34062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.101+0000 7fcb427fc700 1 -- 172.21.15.153:0/3764170032 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcb4407cdd0 con 0x7fcb54067510 2024-08-17T02:26:36.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.101+0000 7fcb51d9b700 1 --2- 172.21.15.153:0/3764170032 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fcb34060890 0x7fcb34062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.101+0000 7fcb51d9b700 1 --2- 172.21.15.153:0/3764170032 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fcb34060890 0x7fcb34062d40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcb540ca440 tx=0x7fcb48007f50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:36.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.105+0000 7fcb427fc700 1 -- 172.21.15.153:0/3764170032 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fcb4404d220 con 0x7fcb54067510 2024-08-17T02:26:36.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.265+0000 7fcb58952700 1 -- 172.21.15.153:0/3764170032 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcb540cd0a0 con 0x7fcb54067510 2024-08-17T02:26:36.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.265+0000 7fcb427fc700 1 -- 172.21.15.153:0/3764170032 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcb44050840 con 0x7fcb54067510 2024-08-17T02:26:36.270 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2024-08-17T02:26:36.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.269+0000 7fcb58952700 1 -- 172.21.15.153:0/3764170032 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fcb34060890 msgr2=0x7fcb34062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.269+0000 7fcb58952700 1 --2- 172.21.15.153:0/3764170032 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fcb34060890 0x7fcb34062d40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcb540ca440 tx=0x7fcb48007f50 comp rx=0 tx=0).stop 2024-08-17T02:26:36.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.269+0000 7fcb58952700 1 -- 172.21.15.153:0/3764170032 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb54067510 msgr2=0x7fcb54156db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.269+0000 7fcb58952700 1 --2- 172.21.15.153:0/3764170032 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb54067510 0x7fcb54156db0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400ec80 tx=0x7fcb440091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.269+0000 7fcb58952700 1 -- 172.21.15.153:0/3764170032 shutdown_connections 2024-08-17T02:26:36.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.269+0000 7fcb58952700 1 --2- 172.21.15.153:0/3764170032 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fcb34060890 0x7fcb34062d40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.269+0000 7fcb58952700 1 --2- 172.21.15.153:0/3764170032 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb541596d0 0x7fcb5415ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.269+0000 7fcb58952700 1 --2- 172.21.15.153:0/3764170032 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb54159300 0x7fcb540c7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.269+0000 7fcb58952700 1 --2- 172.21.15.153:0/3764170032 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb54067510 0x7fcb54156db0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.269+0000 7fcb58952700 1 -- 172.21.15.153:0/3764170032 >> 172.21.15.153:0/3764170032 conn(0x7fcb540682c0 msgr2=0x7fcb54157ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:36.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.269+0000 7fcb58952700 1 -- 172.21.15.153:0/3764170032 shutdown_connections 2024-08-17T02:26:36.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.269+0000 7fcb58952700 1 -- 172.21.15.153:0/3764170032 wait complete. 2024-08-17T02:26:36.284 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:36.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.381+0000 7fd325904700 1 Processor -- start 2024-08-17T02:26:36.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.381+0000 7fd325904700 1 -- start start 2024-08-17T02:26:36.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.385+0000 7fd325904700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd3200688d0 0x7fd320068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.385+0000 7fd325904700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd3200a9860 0x7fd3200a9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.385+0000 7fd325904700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3200aa300 con 0x7fd320158af0 2024-08-17T02:26:36.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.385+0000 7fd325904700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3200ac3b0 con 0x7fd3200688d0 2024-08-17T02:26:36.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.385+0000 7fd325904700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3200aa5e0 con 0x7fd3200a9860 2024-08-17T02:26:36.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.385+0000 7fd324902700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd3200688d0 0x7fd320068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.385+0000 7fd325103700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fd320158af0 0x7fd320158f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:60054/0 (socket says 172.21.15.153:60054) 2024-08-17T02:26:36.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.385+0000 7fd325103700 1 -- 172.21.15.153:0/4062424088 learned_addr learned my addr 172.21.15.153:0/4062424088 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:36.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.385+0000 7fd31ffff700 1 --2- 172.21.15.153:0/4062424088 >> v2:172.21.15.174:3300/0 conn(0x7fd3200a9860 0x7fd3200a9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.385+0000 7fd324902700 1 -- 172.21.15.153:0/4062424088 >> v2:172.21.15.174:3300/0 conn(0x7fd3200a9860 msgr2=0x7fd3200a9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:36.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.385+0000 7fd324902700 1 --2- 172.21.15.153:0/4062424088 >> v2:172.21.15.174:3300/0 conn(0x7fd3200a9860 0x7fd3200a9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.385+0000 7fd324902700 1 -- 172.21.15.153:0/4062424088 >> v1:172.21.15.153:6789/0 conn(0x7fd320158af0 legacy=0x7fd320158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.385+0000 7fd31f7fe700 1 -- 172.21.15.153:0/4062424088 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3311842352 0 0) 0x7fd3200aa300 con 0x7fd320158af0 2024-08-17T02:26:36.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.385+0000 7fd324902700 1 -- 172.21.15.153:0/4062424088 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3200aa8c0 con 0x7fd3200688d0 2024-08-17T02:26:36.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.385+0000 7fd324902700 1 --2- 172.21.15.153:0/4062424088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3200688d0 0x7fd320068ca0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd3200ad6c0 tx=0x7fd3100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=131a87e219344293 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:36.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.385+0000 7fd31f7fe700 1 -- 172.21.15.153:0/4062424088 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd310011630 con 0x7fd3200688d0 2024-08-17T02:26:36.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.385+0000 7fd31f7fe700 1 -- 172.21.15.153:0/4062424088 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd310011790 con 0x7fd3200688d0 2024-08-17T02:26:36.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.385+0000 7fd31f7fe700 1 -- 172.21.15.153:0/4062424088 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd310011b30 con 0x7fd3200688d0 2024-08-17T02:26:36.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.385+0000 7fd325904700 1 -- 172.21.15.153:0/4062424088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3200688d0 msgr2=0x7fd320068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.385+0000 7fd325904700 1 --2- 172.21.15.153:0/4062424088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3200688d0 0x7fd320068ca0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd3200ad6c0 tx=0x7fd3100091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.385+0000 7fd325904700 1 -- 172.21.15.153:0/4062424088 shutdown_connections 2024-08-17T02:26:36.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.385+0000 7fd325904700 1 --2- 172.21.15.153:0/4062424088 >> v2:172.21.15.174:3300/0 conn(0x7fd3200a9860 0x7fd3200a9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.385+0000 7fd325904700 1 --2- 172.21.15.153:0/4062424088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3200688d0 0x7fd320068ca0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.385+0000 7fd325904700 1 -- 172.21.15.153:0/4062424088 >> 172.21.15.153:0/4062424088 conn(0x7fd32006d790 msgr2=0x7fd32006db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:36.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.385+0000 7fd325904700 1 -- 172.21.15.153:0/4062424088 shutdown_connections 2024-08-17T02:26:36.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.385+0000 7fd325904700 1 -- 172.21.15.153:0/4062424088 wait complete. 2024-08-17T02:26:36.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.389+0000 7fd325904700 1 Processor -- start 2024-08-17T02:26:36.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.389+0000 7fd325904700 1 -- start start 2024-08-17T02:26:36.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.393+0000 7fd325904700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3200688d0 0x7fd3200b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.393+0000 7fd325904700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3200a9860 0x7fd320156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.393+0000 7fd325904700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd320158af0 0x7fd320169640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.393+0000 7fd325904700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3200afd20 con 0x7fd3200a9860 2024-08-17T02:26:36.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.393+0000 7fd325904700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd320157450 con 0x7fd3200688d0 2024-08-17T02:26:36.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.393+0000 7fd325904700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd320169b80 con 0x7fd320158af0 2024-08-17T02:26:36.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.393+0000 7fd31ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3200a9860 0x7fd320156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.393+0000 7fd31ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3200a9860 0x7fd320156f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59520/0 (socket says 172.21.15.153:59520) 2024-08-17T02:26:36.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.393+0000 7fd31ffff700 1 -- 172.21.15.153:0/3472194931 learned_addr learned my addr 172.21.15.153:0/3472194931 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:36.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.393+0000 7fd324902700 1 --2- 172.21.15.153:0/3472194931 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3200688d0 0x7fd3200b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.393+0000 7fd325103700 1 --2- 172.21.15.153:0/3472194931 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd320158af0 0x7fd320169640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.393+0000 7fd31ffff700 1 -- 172.21.15.153:0/3472194931 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd320158af0 msgr2=0x7fd320169640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.393+0000 7fd31ffff700 1 --2- 172.21.15.153:0/3472194931 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd320158af0 0x7fd320169640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.393+0000 7fd31ffff700 1 -- 172.21.15.153:0/3472194931 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3200688d0 msgr2=0x7fd3200b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.393+0000 7fd31ffff700 1 --2- 172.21.15.153:0/3472194931 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3200688d0 0x7fd3200b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.393+0000 7fd31ffff700 1 -- 172.21.15.153:0/3472194931 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd310009420 con 0x7fd3200a9860 2024-08-17T02:26:36.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.393+0000 7fd31ffff700 1 --2- 172.21.15.153:0/3472194931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3200a9860 0x7fd320156f10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd30800ecb0 tx=0x7fd3080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:36.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.393+0000 7fd31cff9700 1 -- 172.21.15.153:0/3472194931 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30800c850 con 0x7fd3200a9860 2024-08-17T02:26:36.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.393+0000 7fd31cff9700 1 -- 172.21.15.153:0/3472194931 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30800c9b0 con 0x7fd3200a9860 2024-08-17T02:26:36.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.393+0000 7fd325904700 1 -- 172.21.15.153:0/3472194931 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3201576d0 con 0x7fd3200a9860 2024-08-17T02:26:36.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.393+0000 7fd31cff9700 1 -- 172.21.15.153:0/3472194931 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30800cd50 con 0x7fd3200a9860 2024-08-17T02:26:36.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.393+0000 7fd325904700 1 -- 172.21.15.153:0/3472194931 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3200af6d0 con 0x7fd3200a9860 2024-08-17T02:26:36.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.393+0000 7fd325904700 1 -- 172.21.15.153:0/3472194931 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3200643a0 con 0x7fd3200a9860 2024-08-17T02:26:36.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.397+0000 7fd31cff9700 1 -- 172.21.15.153:0/3472194931 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd308013680 con 0x7fd3200a9860 2024-08-17T02:26:36.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.397+0000 7fd31cff9700 1 --2- 172.21.15.153:0/3472194931 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd304060860 0x7fd304062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.397+0000 7fd31cff9700 1 -- 172.21.15.153:0/3472194931 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd30807cd70 con 0x7fd3200a9860 2024-08-17T02:26:36.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.397+0000 7fd324902700 1 --2- 172.21.15.153:0/3472194931 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd304060860 0x7fd304062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.397+0000 7fd324902700 1 --2- 172.21.15.153:0/3472194931 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd304060860 0x7fd304062d10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd3100093f0 tx=0x7fd310017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:36.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.401+0000 7fd31cff9700 1 -- 172.21.15.153:0/3472194931 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd30804d1c0 con 0x7fd3200a9860 2024-08-17T02:26:36.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.569+0000 7fd325904700 1 -- 172.21.15.153:0/3472194931 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd320154dc0 con 0x7fd3200a9860 2024-08-17T02:26:36.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.573+0000 7fd31cff9700 1 -- 172.21.15.153:0/3472194931 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fd3080507e0 con 0x7fd3200a9860 2024-08-17T02:26:36.575 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:36.576 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":21,"fsid":"56d41c33-b929-456d-96be-2aac4ecd299d","created":"2024-08-17T02:25:47.756085+0000","modified":"2024-08-17T02:26:13.759246+0000","last_up_change":"2024-08-17T02:25:58.643690+0000","last_in_change":"2024-08-17T02:25:49.809186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:58.093273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:09.856520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:11.080706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0736f8e6-818e-42e6-a0dc-8aaf813315d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":24234},{"type":"v1","addr":"172.21.15.153:6817","nonce":24234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":24234},{"type":"v1","addr":"172.21.15.153:6819","nonce":24234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":24234},{"type":"v1","addr":"172.21.15.153:6823","nonce":24234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":24234},{"type":"v1","addr":"172.21.15.153:6821","nonce":24234}]},"public_addr":"172.21.15.153:6817/24234","cluster_addr":"172.21.15.153:6819/24234","heartbeat_back_addr":"172.21.15.153:6823/24234","heartbeat_front_addr":"172.21.15.153:6821/24234","state":["exists","up"]},{"osd":1,"uuid":"011762e9-6c2d-441a-aa56-68474639d72f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":24232},{"type":"v1","addr":"172.21.15.153:6801","nonce":24232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":24232},{"type":"v1","addr":"172.21.15.153:6803","nonce":24232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":24232},{"type":"v1","addr":"172.21.15.153:6809","nonce":24232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":24232},{"type":"v1","addr":"172.21.15.153:6806","nonce":24232}]},"public_addr":"172.21.15.153:6801/24232","cluster_addr":"172.21.15.153:6803/24232","heartbeat_back_addr":"172.21.15.153:6809/24232","heartbeat_front_addr":"172.21.15.153:6806/24232","state":["exists","up"]},{"osd":2,"uuid":"b562cd97-aa12-455e-b46a-e720a2ec9d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":24235},{"type":"v1","addr":"172.21.15.153:6808","nonce":24235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":24235},{"type":"v1","addr":"172.21.15.153:6811","nonce":24235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":24235},{"type":"v1","addr":"172.21.15.153:6815","nonce":24235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":24235},{"type":"v1","addr":"172.21.15.153:6813","nonce":24235}]},"public_addr":"172.21.15.153:6808/24235","cluster_addr":"172.21.15.153:6811/24235","heartbeat_back_addr":"172.21.15.153:6815/24235","heartbeat_front_addr":"172.21.15.153:6813/24235","state":["exists","up"]},{"osd":3,"uuid":"222da52f-90c2-4132-a5d2-6f6cf83d4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":24236},{"type":"v1","addr":"172.21.15.153:6825","nonce":24236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":24236},{"type":"v1","addr":"172.21.15.153:6827","nonce":24236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":24236},{"type":"v1","addr":"172.21.15.153:6831","nonce":24236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":24236},{"type":"v1","addr":"172.21.15.153:6829","nonce":24236}]},"public_addr":"172.21.15.153:6825/24236","cluster_addr":"172.21.15.153:6827/24236","heartbeat_back_addr":"172.21.15.153:6831/24236","heartbeat_front_addr":"172.21.15.153:6829/24236","state":["exists","up"]},{"osd":4,"uuid":"a38a04cd-032b-4977-a260-1ef3567d0c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24456},{"type":"v1","addr":"172.21.15.174:6809","nonce":24456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24456},{"type":"v1","addr":"172.21.15.174:6811","nonce":24456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24456},{"type":"v1","addr":"172.21.15.174:6815","nonce":24456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24456},{"type":"v1","addr":"172.21.15.174:6813","nonce":24456}]},"public_addr":"172.21.15.174:6809/24456","cluster_addr":"172.21.15.174:6811/24456","heartbeat_back_addr":"172.21.15.174:6815/24456","heartbeat_front_addr":"172.21.15.174:6813/24456","state":["exists","up"]},{"osd":5,"uuid":"c7778084-e751-48da-87a1-ab8bbe85aa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24457},{"type":"v1","addr":"172.21.15.174:6825","nonce":24457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24457},{"type":"v1","addr":"172.21.15.174:6827","nonce":24457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24457},{"type":"v1","addr":"172.21.15.174:6831","nonce":24457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24457},{"type":"v1","addr":"172.21.15.174:6829","nonce":24457}]},"public_addr":"172.21.15.174:6825/24457","cluster_addr":"172.21.15.174:6827/24457","heartbeat_back_addr":"172.21.15.174:6831/24457","heartbeat_front_addr":"172.21.15.174:6829/24457","state":["exists","up"]},{"osd":6,"uuid":"2d8e0715-254f-442c-9625-50721d0bc858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24477},{"type":"v1","addr":"172.21.15.174:6801","nonce":24477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24477},{"type":"v1","addr":"172.21.15.174:6803","nonce":24477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24477},{"type":"v1","addr":"172.21.15.174:6807","nonce":24477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24477},{"type":"v1","addr":"172.21.15.174:6805","nonce":24477}]},"public_addr":"172.21.15.174:6801/24477","cluster_addr":"172.21.15.174:6803/24477","heartbeat_back_addr":"172.21.15.174:6807/24477","heartbeat_front_addr":"172.21.15.174:6805/24477","state":["exists","up"]},{"osd":7,"uuid":"dffda25a-4601-4ddb-9a27-b0be1cadde27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24455},{"type":"v1","addr":"172.21.15.174:6817","nonce":24455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24455},{"type":"v1","addr":"172.21.15.174:6819","nonce":24455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24455},{"type":"v1","addr":"172.21.15.174:6823","nonce":24455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24455},{"type":"v1","addr":"172.21.15.174:6821","nonce":24455}]},"public_addr":"172.21.15.174:6817/24455","cluster_addr":"172.21.15.174:6819/24455","heartbeat_back_addr":"172.21.15.174:6823/24455","heartbeat_front_addr":"172.21.15.174:6821/24455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.990117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.033862+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.748087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.112877+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.070448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.360961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.110940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.226377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:36.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.573+0000 7fd325904700 1 -- 172.21.15.153:0/3472194931 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd304060860 msgr2=0x7fd304062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.573+0000 7fd325904700 1 --2- 172.21.15.153:0/3472194931 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd304060860 0x7fd304062d10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd3100093f0 tx=0x7fd310017000 comp rx=0 tx=0).stop 2024-08-17T02:26:36.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.573+0000 7fd325904700 1 -- 172.21.15.153:0/3472194931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3200a9860 msgr2=0x7fd320156f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.573+0000 7fd325904700 1 --2- 172.21.15.153:0/3472194931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3200a9860 0x7fd320156f10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd30800ecb0 tx=0x7fd3080091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.573+0000 7fd325904700 1 -- 172.21.15.153:0/3472194931 shutdown_connections 2024-08-17T02:26:36.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.573+0000 7fd325904700 1 --2- 172.21.15.153:0/3472194931 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd304060860 0x7fd304062d10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.573+0000 7fd325904700 1 --2- 172.21.15.153:0/3472194931 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd320158af0 0x7fd320169640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.573+0000 7fd325904700 1 --2- 172.21.15.153:0/3472194931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3200a9860 0x7fd320156f10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.573+0000 7fd325904700 1 --2- 172.21.15.153:0/3472194931 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3200688d0 0x7fd3200b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.573+0000 7fd325904700 1 -- 172.21.15.153:0/3472194931 >> 172.21.15.153:0/3472194931 conn(0x7fd32006d790 msgr2=0x7fd3200ab1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:36.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.573+0000 7fd325904700 1 -- 172.21.15.153:0/3472194931 shutdown_connections 2024-08-17T02:26:36.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.573+0000 7fd325904700 1 -- 172.21.15.153:0/3472194931 wait complete. 2024-08-17T02:26:36.590 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:58.093273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:26:09.856520+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:26:11.080706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:26:36.590 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:36.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.701+0000 7fcc84bdd700 1 Processor -- start 2024-08-17T02:26:36.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.701+0000 7fcc84bdd700 1 -- start start 2024-08-17T02:26:36.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.701+0000 7fcc84bdd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcc80067510 0x7fcc800ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.701+0000 7fcc84bdd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc80159480 0x7fcc800cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.701+0000 7fcc84bdd700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc800ce210 con 0x7fcc801590b0 2024-08-17T02:26:36.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.701+0000 7fcc84bdd700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc800cba00 con 0x7fcc80067510 2024-08-17T02:26:36.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.701+0000 7fcc84bdd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc800cdc90 con 0x7fcc80159480 2024-08-17T02:26:36.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.705+0000 7fcc7f7fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fcc801590b0 0x7fcc80066e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:60058/0 (socket says 172.21.15.153:60058) 2024-08-17T02:26:36.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.705+0000 7fcc7f7fe700 1 -- 172.21.15.153:0/2151124391 learned_addr learned my addr 172.21.15.153:0/2151124391 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:36.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.705+0000 7fcc76ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcc80067510 0x7fcc800ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.705+0000 7fcc7ffff700 1 --2- 172.21.15.153:0/2151124391 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc80159480 0x7fcc800cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.705+0000 7fcc7effd700 1 -- 172.21.15.153:0/2151124391 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2619611309 0 0) 0x7fcc800ce210 con 0x7fcc801590b0 2024-08-17T02:26:36.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.705+0000 7fcc7effd700 1 -- 172.21.15.153:0/2151124391 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc6c003570 con 0x7fcc801590b0 2024-08-17T02:26:36.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.705+0000 7fcc7ffff700 1 -- 172.21.15.153:0/2151124391 >> v2:172.21.15.153:3300/0 conn(0x7fcc80067510 msgr2=0x7fcc800ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:36.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.705+0000 7fcc7ffff700 1 --2- 172.21.15.153:0/2151124391 >> v2:172.21.15.153:3300/0 conn(0x7fcc80067510 0x7fcc800ce6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.705+0000 7fcc7ffff700 1 -- 172.21.15.153:0/2151124391 >> v1:172.21.15.153:6789/0 conn(0x7fcc801590b0 legacy=0x7fcc80066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.705+0000 7fcc7ffff700 1 -- 172.21.15.153:0/2151124391 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc800cb440 con 0x7fcc80159480 2024-08-17T02:26:36.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.705+0000 7fcc7ffff700 1 --2- 172.21.15.153:0/2151124391 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc80159480 0x7fcc800cebe0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcc78009e60 tx=0x7fcc78009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a940bc150cf754a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:36.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.705+0000 7fcc7effd700 1 -- 172.21.15.153:0/2151124391 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7800e070 con 0x7fcc80159480 2024-08-17T02:26:36.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.705+0000 7fcc7effd700 1 -- 172.21.15.153:0/2151124391 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7800bab0 con 0x7fcc80159480 2024-08-17T02:26:36.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.705+0000 7fcc7effd700 1 -- 172.21.15.153:0/2151124391 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7800be70 con 0x7fcc80159480 2024-08-17T02:26:36.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.705+0000 7fcc84bdd700 1 -- 172.21.15.153:0/2151124391 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc80159480 msgr2=0x7fcc800cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.705+0000 7fcc84bdd700 1 --2- 172.21.15.153:0/2151124391 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc80159480 0x7fcc800cebe0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcc78009e60 tx=0x7fcc78009780 comp rx=0 tx=0).stop 2024-08-17T02:26:36.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.705+0000 7fcc84bdd700 1 -- 172.21.15.153:0/2151124391 shutdown_connections 2024-08-17T02:26:36.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.705+0000 7fcc84bdd700 1 --2- 172.21.15.153:0/2151124391 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc80159480 0x7fcc800cebe0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.705+0000 7fcc84bdd700 1 --2- 172.21.15.153:0/2151124391 >> v2:172.21.15.153:3300/0 conn(0x7fcc80067510 0x7fcc800ce6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.705+0000 7fcc84bdd700 1 -- 172.21.15.153:0/2151124391 >> 172.21.15.153:0/2151124391 conn(0x7fcc800d0b90 msgr2=0x7fcc800ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:36.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.705+0000 7fcc84bdd700 1 -- 172.21.15.153:0/2151124391 shutdown_connections 2024-08-17T02:26:36.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.705+0000 7fcc84bdd700 1 -- 172.21.15.153:0/2151124391 wait complete. 2024-08-17T02:26:36.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.709+0000 7fcc84bdd700 1 Processor -- start 2024-08-17T02:26:36.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.709+0000 7fcc84bdd700 1 -- start start 2024-08-17T02:26:36.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.709+0000 7fcc84bdd700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc80067510 0x7fcc8013fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.709+0000 7fcc84bdd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc801590b0 0x7fcc800c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.709+0000 7fcc84bdd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc80159480 0x7fcc8014fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.709+0000 7fcc84bdd700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc80151dc0 con 0x7fcc801590b0 2024-08-17T02:26:36.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.709+0000 7fcc84bdd700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc800c97f0 con 0x7fcc80067510 2024-08-17T02:26:36.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.709+0000 7fcc84bdd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc800c9ad0 con 0x7fcc80159480 2024-08-17T02:26:36.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.709+0000 7fcc76ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc801590b0 0x7fcc800c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.709+0000 7fcc76ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc801590b0 0x7fcc800c8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59530/0 (socket says 172.21.15.153:59530) 2024-08-17T02:26:36.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.709+0000 7fcc76ffd700 1 -- 172.21.15.153:0/2071624058 learned_addr learned my addr 172.21.15.153:0/2071624058 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:36.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.709+0000 7fcc7f7fe700 1 --2- 172.21.15.153:0/2071624058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc80067510 0x7fcc8013fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.709+0000 7fcc7ffff700 1 --2- 172.21.15.153:0/2071624058 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc80159480 0x7fcc8014fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.709+0000 7fcc76ffd700 1 -- 172.21.15.153:0/2071624058 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc80159480 msgr2=0x7fcc8014fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.709+0000 7fcc76ffd700 1 --2- 172.21.15.153:0/2071624058 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc80159480 0x7fcc8014fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.709+0000 7fcc76ffd700 1 -- 172.21.15.153:0/2071624058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc80067510 msgr2=0x7fcc8013fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.709+0000 7fcc76ffd700 1 --2- 172.21.15.153:0/2071624058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc80067510 0x7fcc8013fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.709+0000 7fcc76ffd700 1 -- 172.21.15.153:0/2071624058 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc78009a20 con 0x7fcc801590b0 2024-08-17T02:26:36.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.709+0000 7fcc7f7fe700 1 --2- 172.21.15.153:0/2071624058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc80067510 0x7fcc8013fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:36.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.709+0000 7fcc7ffff700 1 --2- 172.21.15.153:0/2071624058 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc80159480 0x7fcc8014fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:36.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.713+0000 7fcc76ffd700 1 --2- 172.21.15.153:0/2071624058 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc801590b0 0x7fcc800c8ef0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcc6800ec80 tx=0x7fcc680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:36.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.713+0000 7fcc77fff700 1 -- 172.21.15.153:0/2071624058 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6800c9d0 con 0x7fcc801590b0 2024-08-17T02:26:36.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.713+0000 7fcc84bdd700 1 -- 172.21.15.153:0/2071624058 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc800c9db0 con 0x7fcc801590b0 2024-08-17T02:26:36.717 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.713+0000 7fcc77fff700 1 -- 172.21.15.153:0/2071624058 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6800cb30 con 0x7fcc801590b0 2024-08-17T02:26:36.717 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.713+0000 7fcc77fff700 1 -- 172.21.15.153:0/2071624058 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc68013470 con 0x7fcc801590b0 2024-08-17T02:26:36.717 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.713+0000 7fcc84bdd700 1 -- 172.21.15.153:0/2071624058 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc800c9430 con 0x7fcc801590b0 2024-08-17T02:26:36.717 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.713+0000 7fcc84bdd700 1 -- 172.21.15.153:0/2071624058 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc80064330 con 0x7fcc801590b0 2024-08-17T02:26:36.717 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.713+0000 7fcc77fff700 1 -- 172.21.15.153:0/2071624058 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fcc68013820 con 0x7fcc801590b0 2024-08-17T02:26:36.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.713+0000 7fcc77fff700 1 --2- 172.21.15.153:0/2071624058 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fcc60060860 0x7fcc60062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.713+0000 7fcc77fff700 1 -- 172.21.15.153:0/2071624058 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcc6807cf90 con 0x7fcc801590b0 2024-08-17T02:26:36.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.713+0000 7fcc7f7fe700 1 --2- 172.21.15.153:0/2071624058 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fcc60060860 0x7fcc60062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.717+0000 7fcc7f7fe700 1 --2- 172.21.15.153:0/2071624058 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fcc60060860 0x7fcc60062d10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcc700058d0 tx=0x7fcc70009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:36.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.721+0000 7fcc77fff700 1 -- 172.21.15.153:0/2071624058 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fcc680ad480 con 0x7fcc801590b0 2024-08-17T02:26:36.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.885+0000 7fcc84bdd700 1 -- 172.21.15.153:0/2071624058 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcc80070cf0 con 0x7fcc801590b0 2024-08-17T02:26:36.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.885+0000 7fcc77fff700 1 -- 172.21.15.153:0/2071624058 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcc680170a0 con 0x7fcc801590b0 2024-08-17T02:26:36.888 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2024-08-17T02:26:36.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.889+0000 7fcc84bdd700 1 -- 172.21.15.153:0/2071624058 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fcc60060860 msgr2=0x7fcc60062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.889+0000 7fcc84bdd700 1 --2- 172.21.15.153:0/2071624058 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fcc60060860 0x7fcc60062d10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcc700058d0 tx=0x7fcc70009040 comp rx=0 tx=0).stop 2024-08-17T02:26:36.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.889+0000 7fcc84bdd700 1 -- 172.21.15.153:0/2071624058 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc801590b0 msgr2=0x7fcc800c8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.889+0000 7fcc84bdd700 1 --2- 172.21.15.153:0/2071624058 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc801590b0 0x7fcc800c8ef0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcc6800ec80 tx=0x7fcc680091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.889+0000 7fcc84bdd700 1 -- 172.21.15.153:0/2071624058 shutdown_connections 2024-08-17T02:26:36.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.889+0000 7fcc84bdd700 1 --2- 172.21.15.153:0/2071624058 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fcc60060860 0x7fcc60062d10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.889+0000 7fcc84bdd700 1 --2- 172.21.15.153:0/2071624058 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc80159480 0x7fcc8014fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.889+0000 7fcc84bdd700 1 --2- 172.21.15.153:0/2071624058 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc801590b0 0x7fcc800c8ef0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.889+0000 7fcc84bdd700 1 --2- 172.21.15.153:0/2071624058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc80067510 0x7fcc8013fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.889+0000 7fcc84bdd700 1 -- 172.21.15.153:0/2071624058 >> 172.21.15.153:0/2071624058 conn(0x7fcc800d0b90 msgr2=0x7fcc800b03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:36.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.889+0000 7fcc84bdd700 1 -- 172.21.15.153:0/2071624058 shutdown_connections 2024-08-17T02:26:36.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:36.889+0000 7fcc84bdd700 1 -- 172.21.15.153:0/2071624058 wait complete. 2024-08-17T02:26:36.902 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:26:37.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.013+0000 7fd3da07c700 1 Processor -- start 2024-08-17T02:26:37.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.013+0000 7fd3da07c700 1 -- start start 2024-08-17T02:26:37.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.017+0000 7fd3da07c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3d40cbab0 0x7fd3d40cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.017+0000 7fd3da07c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd3d40ad6e0 0x7fd3d40adae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.017+0000 7fd3da07c700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3d40c8c30 con 0x7fd3d4140910 2024-08-17T02:26:37.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.017+0000 7fd3da07c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3d40cc470 con 0x7fd3d40ad6e0 2024-08-17T02:26:37.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.017+0000 7fd3da07c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d40c3e30 con 0x7fd3d40cbab0 2024-08-17T02:26:37.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.017+0000 7fd3d907a700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fd3d4140910 0x7fd3d40c8520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:60072/0 (socket says 172.21.15.153:60072) 2024-08-17T02:26:37.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.017+0000 7fd3d907a700 1 -- 172.21.15.153:0/820059699 learned_addr learned my addr 172.21.15.153:0/820059699 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:37.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.017+0000 7fd3d987b700 1 --2- 172.21.15.153:0/820059699 >> v2:172.21.15.174:3300/0 conn(0x7fd3d40ad6e0 0x7fd3d40adae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.017+0000 7fd3d8879700 1 --2- 172.21.15.153:0/820059699 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3d40cbab0 0x7fd3d40cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.017+0000 7fd3cbfff700 1 -- 172.21.15.153:0/820059699 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2013574743 0 0) 0x7fd3d40c8c30 con 0x7fd3d4140910 2024-08-17T02:26:37.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.017+0000 7fd3cbfff700 1 -- 172.21.15.153:0/820059699 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3c0003570 con 0x7fd3d4140910 2024-08-17T02:26:37.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.017+0000 7fd3d987b700 1 -- 172.21.15.153:0/820059699 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3d40cbab0 msgr2=0x7fd3d40cbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:37.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.017+0000 7fd3d987b700 1 --2- 172.21.15.153:0/820059699 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3d40cbab0 0x7fd3d40cbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.017+0000 7fd3d987b700 1 -- 172.21.15.153:0/820059699 >> v1:172.21.15.153:6789/0 conn(0x7fd3d4140910 legacy=0x7fd3d40c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.017+0000 7fd3d987b700 1 -- 172.21.15.153:0/820059699 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d40c4110 con 0x7fd3d40ad6e0 2024-08-17T02:26:37.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.017+0000 7fd3d987b700 1 --2- 172.21.15.153:0/820059699 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3d40ad6e0 0x7fd3d40adae0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc009e60 tx=0x7fd3cc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48648be160a6248a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.017+0000 7fd3cbfff700 1 -- 172.21.15.153:0/820059699 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc00e070 con 0x7fd3d40ad6e0 2024-08-17T02:26:37.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.017+0000 7fd3cbfff700 1 -- 172.21.15.153:0/820059699 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3cc00bab0 con 0x7fd3d40ad6e0 2024-08-17T02:26:37.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.017+0000 7fd3cbfff700 1 -- 172.21.15.153:0/820059699 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc00be70 con 0x7fd3d40ad6e0 2024-08-17T02:26:37.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.017+0000 7fd3da07c700 1 -- 172.21.15.153:0/820059699 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3d40ad6e0 msgr2=0x7fd3d40adae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.017+0000 7fd3da07c700 1 --2- 172.21.15.153:0/820059699 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3d40ad6e0 0x7fd3d40adae0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc009e60 tx=0x7fd3cc009780 comp rx=0 tx=0).stop 2024-08-17T02:26:37.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.017+0000 7fd3da07c700 1 -- 172.21.15.153:0/820059699 shutdown_connections 2024-08-17T02:26:37.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.017+0000 7fd3da07c700 1 --2- 172.21.15.153:0/820059699 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3d40ad6e0 0x7fd3d40adae0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.017+0000 7fd3da07c700 1 --2- 172.21.15.153:0/820059699 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3d40cbab0 0x7fd3d40cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.017+0000 7fd3da07c700 1 -- 172.21.15.153:0/820059699 >> 172.21.15.153:0/820059699 conn(0x7fd3d40cdee0 msgr2=0x7fd3d40ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:37.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.017+0000 7fd3da07c700 1 -- 172.21.15.153:0/820059699 shutdown_connections 2024-08-17T02:26:37.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.017+0000 7fd3da07c700 1 -- 172.21.15.153:0/820059699 wait complete. 2024-08-17T02:26:37.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.021+0000 7fd3da07c700 1 Processor -- start 2024-08-17T02:26:37.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.021+0000 7fd3da07c700 1 -- start start 2024-08-17T02:26:37.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.025+0000 7fd3da07c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3d40ad6e0 0x7fd3d406b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.025+0000 7fd3da07c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3d40cbab0 0x7fd3d413c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.025+0000 7fd3da07c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3d4140910 0x7fd3d413b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.025+0000 7fd3da07c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d413ce90 con 0x7fd3d40ad6e0 2024-08-17T02:26:37.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.025+0000 7fd3da07c700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d40c6190 con 0x7fd3d4140910 2024-08-17T02:26:37.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.025+0000 7fd3da07c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d40c6470 con 0x7fd3d40cbab0 2024-08-17T02:26:37.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.025+0000 7fd3d907a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3d40ad6e0 0x7fd3d406b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.025+0000 7fd3d907a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3d40ad6e0 0x7fd3d406b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59536/0 (socket says 172.21.15.153:59536) 2024-08-17T02:26:37.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.025+0000 7fd3d907a700 1 -- 172.21.15.153:0/3325217450 learned_addr learned my addr 172.21.15.153:0/3325217450 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:37.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.025+0000 7fd3d8879700 1 --2- 172.21.15.153:0/3325217450 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3d40cbab0 0x7fd3d413c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.025+0000 7fd3d987b700 1 --2- 172.21.15.153:0/3325217450 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3d4140910 0x7fd3d413b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.025+0000 7fd3d907a700 1 -- 172.21.15.153:0/3325217450 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3d40cbab0 msgr2=0x7fd3d413c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.025+0000 7fd3d907a700 1 --2- 172.21.15.153:0/3325217450 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3d40cbab0 0x7fd3d413c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.025+0000 7fd3d907a700 1 -- 172.21.15.153:0/3325217450 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3d4140910 msgr2=0x7fd3d413b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.025+0000 7fd3d907a700 1 --2- 172.21.15.153:0/3325217450 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3d4140910 0x7fd3d413b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.025+0000 7fd3d907a700 1 -- 172.21.15.153:0/3325217450 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3cc009a20 con 0x7fd3d40ad6e0 2024-08-17T02:26:37.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.025+0000 7fd3d907a700 1 --2- 172.21.15.153:0/3325217450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3d40ad6e0 0x7fd3d406b190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd3d000c7c0 tx=0x7fd3d0007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.025+0000 7fd3c97fa700 1 -- 172.21.15.153:0/3325217450 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d0005cd0 con 0x7fd3d40ad6e0 2024-08-17T02:26:37.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.025+0000 7fd3c97fa700 1 -- 172.21.15.153:0/3325217450 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d0005e30 con 0x7fd3d40ad6e0 2024-08-17T02:26:37.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.025+0000 7fd3da07c700 1 -- 172.21.15.153:0/3325217450 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3d413d0b0 con 0x7fd3d40ad6e0 2024-08-17T02:26:37.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.025+0000 7fd3c97fa700 1 -- 172.21.15.153:0/3325217450 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d0007320 con 0x7fd3d40ad6e0 2024-08-17T02:26:37.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.025+0000 7fd3da07c700 1 -- 172.21.15.153:0/3325217450 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3d413d670 con 0x7fd3d40ad6e0 2024-08-17T02:26:37.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.029+0000 7fd3da07c700 1 -- 172.21.15.153:0/3325217450 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3d40638f0 con 0x7fd3d40ad6e0 2024-08-17T02:26:37.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.029+0000 7fd3c97fa700 1 -- 172.21.15.153:0/3325217450 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd3d0007690 con 0x7fd3d40ad6e0 2024-08-17T02:26:37.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.029+0000 7fd3c97fa700 1 --2- 172.21.15.153:0/3325217450 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd3b8060860 0x7fd3b8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.029+0000 7fd3c97fa700 1 -- 172.21.15.153:0/3325217450 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd3d007c270 con 0x7fd3d40ad6e0 2024-08-17T02:26:37.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.029+0000 7fd3d8879700 1 --2- 172.21.15.153:0/3325217450 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd3b8060860 0x7fd3b8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.029+0000 7fd3d8879700 1 --2- 172.21.15.153:0/3325217450 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd3b8060860 0x7fd3b8062d10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4157c40 tx=0x7fd3c40091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.036 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.033+0000 7fd3c97fa700 1 -- 172.21.15.153:0/3325217450 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd3d004c6c0 con 0x7fd3d40ad6e0 2024-08-17T02:26:37.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.193+0000 7fd3da07c700 1 -- 172.21.15.153:0/3325217450 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd3d40ca440 con 0x7fd3d40ad6e0 2024-08-17T02:26:37.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.193+0000 7fd3c97fa700 1 -- 172.21.15.153:0/3325217450 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd3d004fce0 con 0x7fd3d40ad6e0 2024-08-17T02:26:37.195 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2024-08-17T02:26:37.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.193+0000 7fd3da07c700 1 -- 172.21.15.153:0/3325217450 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd3b8060860 msgr2=0x7fd3b8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.193+0000 7fd3da07c700 1 --2- 172.21.15.153:0/3325217450 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd3b8060860 0x7fd3b8062d10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4157c40 tx=0x7fd3c40091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.193+0000 7fd3da07c700 1 -- 172.21.15.153:0/3325217450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3d40ad6e0 msgr2=0x7fd3d406b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.193+0000 7fd3da07c700 1 --2- 172.21.15.153:0/3325217450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3d40ad6e0 0x7fd3d406b190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd3d000c7c0 tx=0x7fd3d0007e00 comp rx=0 tx=0).stop 2024-08-17T02:26:37.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.193+0000 7fd3da07c700 1 -- 172.21.15.153:0/3325217450 shutdown_connections 2024-08-17T02:26:37.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.193+0000 7fd3da07c700 1 --2- 172.21.15.153:0/3325217450 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd3b8060860 0x7fd3b8062d10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.193+0000 7fd3da07c700 1 --2- 172.21.15.153:0/3325217450 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3d4140910 0x7fd3d413b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.193+0000 7fd3da07c700 1 --2- 172.21.15.153:0/3325217450 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3d40cbab0 0x7fd3d413c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.193+0000 7fd3da07c700 1 --2- 172.21.15.153:0/3325217450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3d40ad6e0 0x7fd3d406b190 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.193+0000 7fd3da07c700 1 -- 172.21.15.153:0/3325217450 >> 172.21.15.153:0/3325217450 conn(0x7fd3d40cdee0 msgr2=0x7fd3d40ade70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:37.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.193+0000 7fd3da07c700 1 -- 172.21.15.153:0/3325217450 shutdown_connections 2024-08-17T02:26:37.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.193+0000 7fd3da07c700 1 -- 172.21.15.153:0/3325217450 wait complete. 2024-08-17T02:26:37.209 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:26:37.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.317+0000 7f8bdff32700 1 Processor -- start 2024-08-17T02:26:37.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.317+0000 7f8bdff32700 1 -- start start 2024-08-17T02:26:37.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.317+0000 7f8bdff32700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8bd8142980 0x7f8bd80b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.317+0000 7f8bdff32700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bd815dd00 con 0x7f8bd8142d50 2024-08-17T02:26:37.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.317+0000 7f8bdff32700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bd815ce30 con 0x7f8bd806da00 2024-08-17T02:26:37.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.317+0000 7f8bdff32700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd815d0f0 con 0x7f8bd8142980 2024-08-17T02:26:37.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.317+0000 7f8bddcce700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8bd8142980 0x7f8bd80b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.317+0000 7f8bdd4cd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f8bd8142d50 0x7f8bd806d2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:60084/0 (socket says 172.21.15.153:60084) 2024-08-17T02:26:37.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.317+0000 7f8bdd4cd700 1 -- 172.21.15.153:0/1642907780 learned_addr learned my addr 172.21.15.153:0/1642907780 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:37.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.321+0000 7f8bddcce700 1 -- 172.21.15.153:0/1642907780 >> v1:172.21.15.174:6789/0 conn(0x7f8bd806da00 legacy=0x7f8bd80689a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.321+0000 7f8bdcccc700 1 -- 172.21.15.153:0/1642907780 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 581854500 0 0) 0x7f8bd815ce30 con 0x7f8bd806da00 2024-08-17T02:26:37.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.321+0000 7f8bddcce700 1 -- 172.21.15.153:0/1642907780 >> v1:172.21.15.153:6789/0 conn(0x7f8bd8142d50 legacy=0x7f8bd806d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.321+0000 7f8bddcce700 1 -- 172.21.15.153:0/1642907780 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd815d3d0 con 0x7f8bd8142980 2024-08-17T02:26:37.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.321+0000 7f8bddcce700 1 --2- 172.21.15.153:0/1642907780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bd8142980 0x7f8bd80b15e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8009910 tx=0x7f8bc80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17cc7946832a7bf1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.321+0000 7f8bdcccc700 1 -- 172.21.15.153:0/1642907780 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc8009eb0 con 0x7f8bd8142980 2024-08-17T02:26:37.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.321+0000 7f8bdcccc700 1 -- 172.21.15.153:0/1642907780 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc800b760 con 0x7f8bd8142980 2024-08-17T02:26:37.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.321+0000 7f8bdcccc700 1 -- 172.21.15.153:0/1642907780 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc800bb00 con 0x7f8bd8142980 2024-08-17T02:26:37.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.321+0000 7f8bdff32700 1 -- 172.21.15.153:0/1642907780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bd8142980 msgr2=0x7f8bd80b15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.321+0000 7f8bdff32700 1 --2- 172.21.15.153:0/1642907780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bd8142980 0x7f8bd80b15e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8009910 tx=0x7f8bc80091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.321+0000 7f8bdff32700 1 -- 172.21.15.153:0/1642907780 shutdown_connections 2024-08-17T02:26:37.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.321+0000 7f8bdff32700 1 --2- 172.21.15.153:0/1642907780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bd8142980 0x7f8bd80b15e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.321+0000 7f8bdff32700 1 -- 172.21.15.153:0/1642907780 >> 172.21.15.153:0/1642907780 conn(0x7f8bd80ceb30 msgr2=0x7f8bd806cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:37.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.321+0000 7f8bdff32700 1 -- 172.21.15.153:0/1642907780 shutdown_connections 2024-08-17T02:26:37.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.321+0000 7f8bdff32700 1 -- 172.21.15.153:0/1642907780 wait complete. 2024-08-17T02:26:37.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.321+0000 7f8bdff32700 1 Processor -- start 2024-08-17T02:26:37.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.321+0000 7f8bdff32700 1 -- start start 2024-08-17T02:26:37.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.325+0000 7f8bdff32700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bd806da00 0x7f8bd816cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.325+0000 7f8bdff32700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bd8142d50 0x7f8bd80c7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.325+0000 7f8bdff32700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bd806a350 0x7f8bd816a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.325+0000 7f8bdff32700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd816af40 con 0x7f8bd8142d50 2024-08-17T02:26:37.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.325+0000 7f8bdff32700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd816b210 con 0x7f8bd806da00 2024-08-17T02:26:37.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.325+0000 7f8bdff32700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd816d3e0 con 0x7f8bd806a350 2024-08-17T02:26:37.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.325+0000 7f8bdd4cd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bd8142d50 0x7f8bd80c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.325+0000 7f8bdd4cd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bd8142d50 0x7f8bd80c7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59546/0 (socket says 172.21.15.153:59546) 2024-08-17T02:26:37.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.325+0000 7f8bdd4cd700 1 -- 172.21.15.153:0/165262742 learned_addr learned my addr 172.21.15.153:0/165262742 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:37.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.325+0000 7f8bddcce700 1 --2- 172.21.15.153:0/165262742 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bd806da00 0x7f8bd816cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.325+0000 7f8bde4cf700 1 --2- 172.21.15.153:0/165262742 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bd806a350 0x7f8bd816a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.325+0000 7f8bdd4cd700 1 -- 172.21.15.153:0/165262742 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bd806a350 msgr2=0x7f8bd816a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.325+0000 7f8bdd4cd700 1 --2- 172.21.15.153:0/165262742 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bd806a350 0x7f8bd816a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.325+0000 7f8bdd4cd700 1 -- 172.21.15.153:0/165262742 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bd806da00 msgr2=0x7f8bd816cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.325+0000 7f8bdd4cd700 1 --2- 172.21.15.153:0/165262742 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bd806da00 0x7f8bd816cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.325+0000 7f8bdd4cd700 1 -- 172.21.15.153:0/165262742 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc8009420 con 0x7f8bd8142d50 2024-08-17T02:26:37.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.325+0000 7f8bde4cf700 1 --2- 172.21.15.153:0/165262742 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bd806a350 0x7f8bd816a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:37.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.325+0000 7f8bdd4cd700 1 --2- 172.21.15.153:0/165262742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bd8142d50 0x7f8bd80c7260 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8bd400c840 tx=0x7f8bd4007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.325+0000 7f8bcdffb700 1 -- 172.21.15.153:0/165262742 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4005b30 con 0x7f8bd8142d50 2024-08-17T02:26:37.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.325+0000 7f8bcdffb700 1 -- 172.21.15.153:0/165262742 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd4005cb0 con 0x7f8bd8142d50 2024-08-17T02:26:37.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.325+0000 7f8bdff32700 1 -- 172.21.15.153:0/165262742 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd80c77a0 con 0x7f8bd8142d50 2024-08-17T02:26:37.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.325+0000 7f8bcdffb700 1 -- 172.21.15.153:0/165262742 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4007320 con 0x7f8bd8142d50 2024-08-17T02:26:37.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.325+0000 7f8bdff32700 1 -- 172.21.15.153:0/165262742 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd806ab90 con 0x7f8bd8142d50 2024-08-17T02:26:37.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.329+0000 7f8bdff32700 1 -- 172.21.15.153:0/165262742 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd80645c0 con 0x7f8bd8142d50 2024-08-17T02:26:37.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.329+0000 7f8bcdffb700 1 -- 172.21.15.153:0/165262742 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8bd401b3b0 con 0x7f8bd8142d50 2024-08-17T02:26:37.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.329+0000 7f8bcdffb700 1 --2- 172.21.15.153:0/165262742 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8bbc060860 0x7f8bbc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.329+0000 7f8bcdffb700 1 -- 172.21.15.153:0/165262742 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8bd407c150 con 0x7f8bd8142d50 2024-08-17T02:26:37.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.329+0000 7f8bddcce700 1 --2- 172.21.15.153:0/165262742 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8bbc060860 0x7f8bbc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.329+0000 7f8bddcce700 1 --2- 172.21.15.153:0/165262742 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8bbc060860 0x7f8bbc062d10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8bd806de60 tx=0x7f8bc8016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.337+0000 7f8bcdffb700 1 -- 172.21.15.153:0/165262742 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f8bd404c5a0 con 0x7f8bd8142d50 2024-08-17T02:26:37.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.497+0000 7f8bdff32700 1 -- 172.21.15.153:0/165262742 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8bd816b350 con 0x7f8bd8142d50 2024-08-17T02:26:37.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.497+0000 7f8bcdffb700 1 -- 172.21.15.153:0/165262742 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8bd404fbc0 con 0x7f8bd8142d50 2024-08-17T02:26:37.502 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2024-08-17T02:26:37.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.501+0000 7f8bdff32700 1 -- 172.21.15.153:0/165262742 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8bbc060860 msgr2=0x7f8bbc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.501+0000 7f8bdff32700 1 --2- 172.21.15.153:0/165262742 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8bbc060860 0x7f8bbc062d10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8bd806de60 tx=0x7f8bc8016000 comp rx=0 tx=0).stop 2024-08-17T02:26:37.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.501+0000 7f8bdff32700 1 -- 172.21.15.153:0/165262742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bd8142d50 msgr2=0x7f8bd80c7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.501+0000 7f8bdff32700 1 --2- 172.21.15.153:0/165262742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bd8142d50 0x7f8bd80c7260 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8bd400c840 tx=0x7f8bd4007ef0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.501+0000 7f8bdff32700 1 -- 172.21.15.153:0/165262742 shutdown_connections 2024-08-17T02:26:37.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.501+0000 7f8bdff32700 1 --2- 172.21.15.153:0/165262742 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8bbc060860 0x7f8bbc062d10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.501+0000 7f8bdff32700 1 --2- 172.21.15.153:0/165262742 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bd806a350 0x7f8bd816a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.501+0000 7f8bdff32700 1 --2- 172.21.15.153:0/165262742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bd8142d50 0x7f8bd80c7260 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.501+0000 7f8bdff32700 1 --2- 172.21.15.153:0/165262742 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bd806da00 0x7f8bd816cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.501+0000 7f8bdff32700 1 -- 172.21.15.153:0/165262742 >> 172.21.15.153:0/165262742 conn(0x7f8bd80ceb30 msgr2=0x7f8bd80b3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:37.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.501+0000 7f8bdff32700 1 -- 172.21.15.153:0/165262742 shutdown_connections 2024-08-17T02:26:37.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.501+0000 7f8bdff32700 1 -- 172.21.15.153:0/165262742 wait complete. 2024-08-17T02:26:37.516 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:37.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.617+0000 7eff2e071700 1 Processor -- start 2024-08-17T02:26:37.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.617+0000 7eff2e071700 1 -- start start 2024-08-17T02:26:37.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.617+0000 7eff2e071700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7eff28154900 0x7eff280b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.617+0000 7eff2e071700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff280cb560 0x7eff28160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.617+0000 7eff2e071700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff280b1730 con 0x7eff280b12d0 2024-08-17T02:26:37.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.617+0000 7eff2e071700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff28068790 con 0x7eff28154900 2024-08-17T02:26:37.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.617+0000 7eff2e071700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff281583f0 con 0x7eff280cb560 2024-08-17T02:26:37.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.617+0000 7eff2c86e700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7eff280b12d0 0x7eff280cae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:60092/0 (socket says 172.21.15.153:60092) 2024-08-17T02:26:37.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.617+0000 7eff2c86e700 1 -- 172.21.15.153:0/2385242481 learned_addr learned my addr 172.21.15.153:0/2385242481 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:37.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.617+0000 7eff2d06f700 1 --2- 172.21.15.153:0/2385242481 >> v2:172.21.15.153:3300/0 conn(0x7eff28154900 0x7eff280b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.621+0000 7eff2d870700 1 --2- 172.21.15.153:0/2385242481 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff280cb560 0x7eff28160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.621+0000 7eff1ffff700 1 -- 172.21.15.153:0/2385242481 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638714374 0 0) 0x7eff24001490 con 0x7eff280b12d0 2024-08-17T02:26:37.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.621+0000 7eff1ffff700 1 -- 172.21.15.153:0/2385242481 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff10003570 con 0x7eff280b12d0 2024-08-17T02:26:37.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.621+0000 7eff2d06f700 1 -- 172.21.15.153:0/2385242481 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff280cb560 msgr2=0x7eff28160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:37.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.621+0000 7eff2d06f700 1 --2- 172.21.15.153:0/2385242481 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff280cb560 0x7eff28160ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.621+0000 7eff2d06f700 1 -- 172.21.15.153:0/2385242481 >> v1:172.21.15.153:6789/0 conn(0x7eff280b12d0 legacy=0x7eff280cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.621+0000 7eff1ffff700 1 -- 172.21.15.153:0/2385242481 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 845080511 0 0) 0x7eff10003570 con 0x7eff280b12d0 2024-08-17T02:26:37.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.621+0000 7eff2d06f700 1 -- 172.21.15.153:0/2385242481 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff280cbaa0 con 0x7eff28154900 2024-08-17T02:26:37.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.621+0000 7eff2d06f700 1 --2- 172.21.15.153:0/2385242481 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff28154900 0x7eff280b0d90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7eff180098e0 tx=0x7eff180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e9f9893856ee43 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.621+0000 7eff1ffff700 1 -- 172.21.15.153:0/2385242481 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff240019a0 con 0x7eff28154900 2024-08-17T02:26:37.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.621+0000 7eff1ffff700 1 -- 172.21.15.153:0/2385242481 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff18011420 con 0x7eff28154900 2024-08-17T02:26:37.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.621+0000 7eff1ffff700 1 -- 172.21.15.153:0/2385242481 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff180117c0 con 0x7eff28154900 2024-08-17T02:26:37.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.621+0000 7eff2e071700 1 -- 172.21.15.153:0/2385242481 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff28154900 msgr2=0x7eff280b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.621+0000 7eff2e071700 1 --2- 172.21.15.153:0/2385242481 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff28154900 0x7eff280b0d90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7eff180098e0 tx=0x7eff180091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.621+0000 7eff2e071700 1 -- 172.21.15.153:0/2385242481 shutdown_connections 2024-08-17T02:26:37.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.621+0000 7eff2e071700 1 --2- 172.21.15.153:0/2385242481 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff280cb560 0x7eff28160ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.621+0000 7eff2e071700 1 --2- 172.21.15.153:0/2385242481 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff28154900 0x7eff280b0d90 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.621+0000 7eff2e071700 1 -- 172.21.15.153:0/2385242481 >> 172.21.15.153:0/2385242481 conn(0x7eff280678d0 msgr2=0x7eff28067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:37.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.621+0000 7eff2e071700 1 -- 172.21.15.153:0/2385242481 shutdown_connections 2024-08-17T02:26:37.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.621+0000 7eff2e071700 1 -- 172.21.15.153:0/2385242481 wait complete. 2024-08-17T02:26:37.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.625+0000 7eff2e071700 1 Processor -- start 2024-08-17T02:26:37.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.625+0000 7eff2e071700 1 -- start start 2024-08-17T02:26:37.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.625+0000 7eff2e071700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff280b12d0 0x7eff28142200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.625+0000 7eff2e071700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff280cb560 0x7eff28069f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.625+0000 7eff2e071700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff28154900 0x7eff2806a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.625+0000 7eff2e071700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff280a7320 con 0x7eff280b12d0 2024-08-17T02:26:37.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.625+0000 7eff2e071700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff280a7bc0 con 0x7eff280cb560 2024-08-17T02:26:37.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.625+0000 7eff2e071700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff280a62d0 con 0x7eff28154900 2024-08-17T02:26:37.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.625+0000 7eff2d06f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff280b12d0 0x7eff28142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.625+0000 7eff2d06f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff280b12d0 0x7eff28142200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59576/0 (socket says 172.21.15.153:59576) 2024-08-17T02:26:37.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.625+0000 7eff2d06f700 1 -- 172.21.15.153:0/3845737160 learned_addr learned my addr 172.21.15.153:0/3845737160 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:37.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.625+0000 7eff2c86e700 1 --2- 172.21.15.153:0/3845737160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff280cb560 0x7eff28069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.625+0000 7eff2d870700 1 --2- 172.21.15.153:0/3845737160 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff28154900 0x7eff2806a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.625+0000 7eff2d06f700 1 -- 172.21.15.153:0/3845737160 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff28154900 msgr2=0x7eff2806a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.625+0000 7eff2d06f700 1 --2- 172.21.15.153:0/3845737160 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff28154900 0x7eff2806a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.625+0000 7eff2d06f700 1 -- 172.21.15.153:0/3845737160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff280cb560 msgr2=0x7eff28069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.625+0000 7eff2d06f700 1 --2- 172.21.15.153:0/3845737160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff280cb560 0x7eff28069f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.625+0000 7eff2d06f700 1 -- 172.21.15.153:0/3845737160 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff18009420 con 0x7eff280b12d0 2024-08-17T02:26:37.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.625+0000 7eff2c86e700 1 --2- 172.21.15.153:0/3845737160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff280cb560 0x7eff28069f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:37.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.625+0000 7eff2d06f700 1 --2- 172.21.15.153:0/3845737160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff280b12d0 0x7eff28142200 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7eff2806c2d0 tx=0x7eff18016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.625+0000 7eff1d7fa700 1 -- 172.21.15.153:0/3845737160 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1801cc50 con 0x7eff280b12d0 2024-08-17T02:26:37.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.629+0000 7eff1d7fa700 1 -- 172.21.15.153:0/3845737160 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1801cdb0 con 0x7eff280b12d0 2024-08-17T02:26:37.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.629+0000 7eff2e071700 1 -- 172.21.15.153:0/3845737160 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff280a7570 con 0x7eff280b12d0 2024-08-17T02:26:37.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.629+0000 7eff1d7fa700 1 -- 172.21.15.153:0/3845737160 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1801a6a0 con 0x7eff280b12d0 2024-08-17T02:26:37.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.629+0000 7eff2e071700 1 -- 172.21.15.153:0/3845737160 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff28142740 con 0x7eff280b12d0 2024-08-17T02:26:37.633 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.629+0000 7eff2e071700 1 -- 172.21.15.153:0/3845737160 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff28142930 con 0x7eff280b12d0 2024-08-17T02:26:37.633 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.629+0000 7eff1d7fa700 1 -- 172.21.15.153:0/3845737160 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7eff1801aad0 con 0x7eff280b12d0 2024-08-17T02:26:37.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.629+0000 7eff1d7fa700 1 --2- 172.21.15.153:0/3845737160 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7eff14060860 0x7eff14062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.629+0000 7eff1d7fa700 1 -- 172.21.15.153:0/3845737160 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7eff1807e520 con 0x7eff280b12d0 2024-08-17T02:26:37.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.629+0000 7eff2c86e700 1 --2- 172.21.15.153:0/3845737160 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7eff14060860 0x7eff14062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.629+0000 7eff2c86e700 1 --2- 172.21.15.153:0/3845737160 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7eff14060860 0x7eff14062d10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7eff28153a20 tx=0x7eff240015f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.637+0000 7eff1d7fa700 1 -- 172.21.15.153:0/3845737160 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7eff1804e970 con 0x7eff280b12d0 2024-08-17T02:26:37.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.801+0000 7eff2e071700 1 -- 172.21.15.153:0/3845737160 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff280643a0 con 0x7eff280b12d0 2024-08-17T02:26:37.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.805+0000 7eff1d7fa700 1 -- 172.21.15.153:0/3845737160 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7eff1807ce60 con 0x7eff280b12d0 2024-08-17T02:26:37.808 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:37.808 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":21,"fsid":"56d41c33-b929-456d-96be-2aac4ecd299d","created":"2024-08-17T02:25:47.756085+0000","modified":"2024-08-17T02:26:13.759246+0000","last_up_change":"2024-08-17T02:25:58.643690+0000","last_in_change":"2024-08-17T02:25:49.809186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:58.093273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:09.856520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:11.080706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0736f8e6-818e-42e6-a0dc-8aaf813315d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":24234},{"type":"v1","addr":"172.21.15.153:6817","nonce":24234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":24234},{"type":"v1","addr":"172.21.15.153:6819","nonce":24234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":24234},{"type":"v1","addr":"172.21.15.153:6823","nonce":24234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":24234},{"type":"v1","addr":"172.21.15.153:6821","nonce":24234}]},"public_addr":"172.21.15.153:6817/24234","cluster_addr":"172.21.15.153:6819/24234","heartbeat_back_addr":"172.21.15.153:6823/24234","heartbeat_front_addr":"172.21.15.153:6821/24234","state":["exists","up"]},{"osd":1,"uuid":"011762e9-6c2d-441a-aa56-68474639d72f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":24232},{"type":"v1","addr":"172.21.15.153:6801","nonce":24232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":24232},{"type":"v1","addr":"172.21.15.153:6803","nonce":24232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":24232},{"type":"v1","addr":"172.21.15.153:6809","nonce":24232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":24232},{"type":"v1","addr":"172.21.15.153:6806","nonce":24232}]},"public_addr":"172.21.15.153:6801/24232","cluster_addr":"172.21.15.153:6803/24232","heartbeat_back_addr":"172.21.15.153:6809/24232","heartbeat_front_addr":"172.21.15.153:6806/24232","state":["exists","up"]},{"osd":2,"uuid":"b562cd97-aa12-455e-b46a-e720a2ec9d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":24235},{"type":"v1","addr":"172.21.15.153:6808","nonce":24235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":24235},{"type":"v1","addr":"172.21.15.153:6811","nonce":24235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":24235},{"type":"v1","addr":"172.21.15.153:6815","nonce":24235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":24235},{"type":"v1","addr":"172.21.15.153:6813","nonce":24235}]},"public_addr":"172.21.15.153:6808/24235","cluster_addr":"172.21.15.153:6811/24235","heartbeat_back_addr":"172.21.15.153:6815/24235","heartbeat_front_addr":"172.21.15.153:6813/24235","state":["exists","up"]},{"osd":3,"uuid":"222da52f-90c2-4132-a5d2-6f6cf83d4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":24236},{"type":"v1","addr":"172.21.15.153:6825","nonce":24236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":24236},{"type":"v1","addr":"172.21.15.153:6827","nonce":24236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":24236},{"type":"v1","addr":"172.21.15.153:6831","nonce":24236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":24236},{"type":"v1","addr":"172.21.15.153:6829","nonce":24236}]},"public_addr":"172.21.15.153:6825/24236","cluster_addr":"172.21.15.153:6827/24236","heartbeat_back_addr":"172.21.15.153:6831/24236","heartbeat_front_addr":"172.21.15.153:6829/24236","state":["exists","up"]},{"osd":4,"uuid":"a38a04cd-032b-4977-a260-1ef3567d0c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24456},{"type":"v1","addr":"172.21.15.174:6809","nonce":24456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24456},{"type":"v1","addr":"172.21.15.174:6811","nonce":24456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24456},{"type":"v1","addr":"172.21.15.174:6815","nonce":24456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24456},{"type":"v1","addr":"172.21.15.174:6813","nonce":24456}]},"public_addr":"172.21.15.174:6809/24456","cluster_addr":"172.21.15.174:6811/24456","heartbeat_back_addr":"172.21.15.174:6815/24456","heartbeat_front_addr":"172.21.15.174:6813/24456","state":["exists","up"]},{"osd":5,"uuid":"c7778084-e751-48da-87a1-ab8bbe85aa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24457},{"type":"v1","addr":"172.21.15.174:6825","nonce":24457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24457},{"type":"v1","addr":"172.21.15.174:6827","nonce":24457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24457},{"type":"v1","addr":"172.21.15.174:6831","nonce":24457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24457},{"type":"v1","addr":"172.21.15.174:6829","nonce":24457}]},"public_addr":"172.21.15.174:6825/24457","cluster_addr":"172.21.15.174:6827/24457","heartbeat_back_addr":"172.21.15.174:6831/24457","heartbeat_front_addr":"172.21.15.174:6829/24457","state":["exists","up"]},{"osd":6,"uuid":"2d8e0715-254f-442c-9625-50721d0bc858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24477},{"type":"v1","addr":"172.21.15.174:6801","nonce":24477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24477},{"type":"v1","addr":"172.21.15.174:6803","nonce":24477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24477},{"type":"v1","addr":"172.21.15.174:6807","nonce":24477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24477},{"type":"v1","addr":"172.21.15.174:6805","nonce":24477}]},"public_addr":"172.21.15.174:6801/24477","cluster_addr":"172.21.15.174:6803/24477","heartbeat_back_addr":"172.21.15.174:6807/24477","heartbeat_front_addr":"172.21.15.174:6805/24477","state":["exists","up"]},{"osd":7,"uuid":"dffda25a-4601-4ddb-9a27-b0be1cadde27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24455},{"type":"v1","addr":"172.21.15.174:6817","nonce":24455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24455},{"type":"v1","addr":"172.21.15.174:6819","nonce":24455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24455},{"type":"v1","addr":"172.21.15.174:6823","nonce":24455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24455},{"type":"v1","addr":"172.21.15.174:6821","nonce":24455}]},"public_addr":"172.21.15.174:6817/24455","cluster_addr":"172.21.15.174:6819/24455","heartbeat_back_addr":"172.21.15.174:6823/24455","heartbeat_front_addr":"172.21.15.174:6821/24455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.990117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.033862+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.748087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.112877+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.070448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.360961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.110940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.226377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:37.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.805+0000 7eff2e071700 1 -- 172.21.15.153:0/3845737160 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7eff14060860 msgr2=0x7eff14062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.805+0000 7eff2e071700 1 --2- 172.21.15.153:0/3845737160 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7eff14060860 0x7eff14062d10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7eff28153a20 tx=0x7eff240015f0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.805+0000 7eff2e071700 1 -- 172.21.15.153:0/3845737160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff280b12d0 msgr2=0x7eff28142200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.805+0000 7eff2e071700 1 --2- 172.21.15.153:0/3845737160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff280b12d0 0x7eff28142200 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7eff2806c2d0 tx=0x7eff18016000 comp rx=0 tx=0).stop 2024-08-17T02:26:37.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.805+0000 7eff2e071700 1 -- 172.21.15.153:0/3845737160 shutdown_connections 2024-08-17T02:26:37.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.805+0000 7eff2e071700 1 --2- 172.21.15.153:0/3845737160 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7eff14060860 0x7eff14062d10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.805+0000 7eff2e071700 1 --2- 172.21.15.153:0/3845737160 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff28154900 0x7eff2806a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.805+0000 7eff2e071700 1 --2- 172.21.15.153:0/3845737160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff280cb560 0x7eff28069f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.805+0000 7eff2e071700 1 --2- 172.21.15.153:0/3845737160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff280b12d0 0x7eff28142200 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.805+0000 7eff2e071700 1 -- 172.21.15.153:0/3845737160 >> 172.21.15.153:0/3845737160 conn(0x7eff280678d0 msgr2=0x7eff281522e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:37.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.805+0000 7eff2e071700 1 -- 172.21.15.153:0/3845737160 shutdown_connections 2024-08-17T02:26:37.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.805+0000 7eff2e071700 1 -- 172.21.15.153:0/3845737160 wait complete. 2024-08-17T02:26:37.822 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:58.093273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:26:09.856520+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:26:11.080706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:26:37.823 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:37.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.929+0000 7f1331838700 1 Processor -- start 2024-08-17T02:26:37.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.929+0000 7f1331838700 1 -- start start 2024-08-17T02:26:37.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.933+0000 7f1331838700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f132c159300 0x7f132c0b2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.933+0000 7f1331838700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f132c1596d0 0x7f132c066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.933+0000 7f1331838700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f132c0cba90 con 0x7f132c15dbc0 2024-08-17T02:26:37.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.933+0000 7f1331838700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f132c0b2b60 con 0x7f132c159300 2024-08-17T02:26:37.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.933+0000 7f1331838700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f132c0cb160 con 0x7f132c1596d0 2024-08-17T02:26:37.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.933+0000 7f132affd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f132c159300 0x7f132c0b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.933+0000 7f132affd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f132c159300 0x7f132c0b2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59590/0 (socket says 172.21.15.153:59590) 2024-08-17T02:26:37.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.933+0000 7f132affd700 1 -- 172.21.15.153:0/1047159963 learned_addr learned my addr 172.21.15.153:0/1047159963 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:37.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.933+0000 7f132a7fc700 1 --2- 172.21.15.153:0/1047159963 >> v2:172.21.15.174:3300/0 conn(0x7f132c1596d0 0x7f132c066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.933+0000 7f132affd700 1 -- 172.21.15.153:0/1047159963 >> v2:172.21.15.174:3300/0 conn(0x7f132c1596d0 msgr2=0x7f132c066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:37.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.933+0000 7f132affd700 1 --2- 172.21.15.153:0/1047159963 >> v2:172.21.15.174:3300/0 conn(0x7f132c1596d0 0x7f132c066e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.933+0000 7f132affd700 1 -- 172.21.15.153:0/1047159963 >> v1:172.21.15.174:6789/0 conn(0x7f132c15dbc0 legacy=0x7f132c0afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.933+0000 7f132affd700 1 -- 172.21.15.153:0/1047159963 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f132c0cb440 con 0x7f132c159300 2024-08-17T02:26:37.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.933+0000 7f132affd700 1 --2- 172.21.15.153:0/1047159963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f132c159300 0x7f132c0b2230 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f132c0b2d20 tx=0x7f131c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7952334722022ddc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.933+0000 7f1329ffb700 1 -- 172.21.15.153:0/1047159963 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c00e070 con 0x7f132c159300 2024-08-17T02:26:37.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.933+0000 7f1329ffb700 1 -- 172.21.15.153:0/1047159963 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f131c00ba20 con 0x7f132c159300 2024-08-17T02:26:37.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.933+0000 7f1329ffb700 1 -- 172.21.15.153:0/1047159963 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c0092e0 con 0x7f132c159300 2024-08-17T02:26:37.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.933+0000 7f1331838700 1 -- 172.21.15.153:0/1047159963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f132c159300 msgr2=0x7f132c0b2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.933+0000 7f1331838700 1 --2- 172.21.15.153:0/1047159963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f132c159300 0x7f132c0b2230 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f132c0b2d20 tx=0x7f131c009840 comp rx=0 tx=0).stop 2024-08-17T02:26:37.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.933+0000 7f1331838700 1 -- 172.21.15.153:0/1047159963 shutdown_connections 2024-08-17T02:26:37.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.933+0000 7f1331838700 1 --2- 172.21.15.153:0/1047159963 >> v2:172.21.15.174:3300/0 conn(0x7f132c1596d0 0x7f132c066e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.933+0000 7f1331838700 1 --2- 172.21.15.153:0/1047159963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f132c159300 0x7f132c0b2230 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.933+0000 7f1331838700 1 -- 172.21.15.153:0/1047159963 >> 172.21.15.153:0/1047159963 conn(0x7f132c0682c0 msgr2=0x7f132c0686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:37.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.933+0000 7f1331838700 1 -- 172.21.15.153:0/1047159963 shutdown_connections 2024-08-17T02:26:37.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.933+0000 7f1331838700 1 -- 172.21.15.153:0/1047159963 wait complete. 2024-08-17T02:26:37.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.937+0000 7f1331838700 1 Processor -- start 2024-08-17T02:26:37.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.937+0000 7f1331838700 1 -- start start 2024-08-17T02:26:37.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.941+0000 7f1331838700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f132c159300 0x7f132c0ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.941+0000 7f1331838700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f132c1596d0 0x7f132c0c2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.941+0000 7f1331838700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f132c15dbc0 0x7f132c0c30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.941+0000 7f1331838700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132c14dc10 con 0x7f132c1596d0 2024-08-17T02:26:37.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.941+0000 7f1331838700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132c0c3610 con 0x7f132c15dbc0 2024-08-17T02:26:37.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.941+0000 7f1331838700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f132c1534e0 con 0x7f132c159300 2024-08-17T02:26:37.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.941+0000 7f132a7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f132c1596d0 0x7f132c0c2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.941+0000 7f132a7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f132c1596d0 0x7f132c0c2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59598/0 (socket says 172.21.15.153:59598) 2024-08-17T02:26:37.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.941+0000 7f132a7fc700 1 -- 172.21.15.153:0/927511446 learned_addr learned my addr 172.21.15.153:0/927511446 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:37.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.941+0000 7f132affd700 1 --2- 172.21.15.153:0/927511446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f132c159300 0x7f132c0ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.941+0000 7f132b7fe700 1 --2- 172.21.15.153:0/927511446 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f132c15dbc0 0x7f132c0c30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.941+0000 7f132a7fc700 1 -- 172.21.15.153:0/927511446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f132c159300 msgr2=0x7f132c0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.941+0000 7f132a7fc700 1 --2- 172.21.15.153:0/927511446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f132c159300 0x7f132c0ceb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.941+0000 7f132a7fc700 1 -- 172.21.15.153:0/927511446 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f132c15dbc0 msgr2=0x7f132c0c30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.941+0000 7f132a7fc700 1 --2- 172.21.15.153:0/927511446 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f132c15dbc0 0x7f132c0c30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.941+0000 7f132a7fc700 1 -- 172.21.15.153:0/927511446 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131c009ae0 con 0x7f132c1596d0 2024-08-17T02:26:37.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.941+0000 7f132a7fc700 1 --2- 172.21.15.153:0/927511446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f132c1596d0 0x7f132c0c2b90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f131400ec80 tx=0x7f13140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.941+0000 7f1322ffd700 1 -- 172.21.15.153:0/927511446 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131400c850 con 0x7f132c1596d0 2024-08-17T02:26:37.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.941+0000 7f1322ffd700 1 -- 172.21.15.153:0/927511446 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f131400c9b0 con 0x7f132c1596d0 2024-08-17T02:26:37.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.941+0000 7f1331838700 1 -- 172.21.15.153:0/927511446 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f132c153a20 con 0x7f132c1596d0 2024-08-17T02:26:37.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.941+0000 7f1322ffd700 1 -- 172.21.15.153:0/927511446 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131400cd50 con 0x7f132c1596d0 2024-08-17T02:26:37.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.941+0000 7f1331838700 1 -- 172.21.15.153:0/927511446 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f132c153fe0 con 0x7f132c1596d0 2024-08-17T02:26:37.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.945+0000 7f1322ffd700 1 -- 172.21.15.153:0/927511446 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1314013680 con 0x7f132c1596d0 2024-08-17T02:26:37.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.945+0000 7f1331838700 1 -- 172.21.15.153:0/927511446 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f132c0645c0 con 0x7f132c1596d0 2024-08-17T02:26:37.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.945+0000 7f1322ffd700 1 --2- 172.21.15.153:0/927511446 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f130c060890 0x7f130c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.945+0000 7f1322ffd700 1 -- 172.21.15.153:0/927511446 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f131407ced0 con 0x7f132c1596d0 2024-08-17T02:26:37.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.945+0000 7f132affd700 1 --2- 172.21.15.153:0/927511446 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f130c060890 0x7f130c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.945+0000 7f132affd700 1 --2- 172.21.15.153:0/927511446 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f130c060890 0x7f130c062d40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f131c009880 tx=0x7f131c018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:37.953+0000 7f1322ffd700 1 -- 172.21.15.153:0/927511446 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f131404d280 con 0x7f132c1596d0 2024-08-17T02:26:38.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.109+0000 7f1331838700 1 -- 172.21.15.153:0/927511446 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f132c0caac0 con 0x7f132c1596d0 2024-08-17T02:26:38.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.113+0000 7f1322ffd700 1 -- 172.21.15.153:0/927511446 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f13140508a0 con 0x7f132c1596d0 2024-08-17T02:26:38.115 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2024-08-17T02:26:38.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.113+0000 7f1331838700 1 -- 172.21.15.153:0/927511446 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f130c060890 msgr2=0x7f130c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.113+0000 7f1331838700 1 --2- 172.21.15.153:0/927511446 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f130c060890 0x7f130c062d40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f131c009880 tx=0x7f131c018000 comp rx=0 tx=0).stop 2024-08-17T02:26:38.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.113+0000 7f1331838700 1 -- 172.21.15.153:0/927511446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f132c1596d0 msgr2=0x7f132c0c2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.113+0000 7f1331838700 1 --2- 172.21.15.153:0/927511446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f132c1596d0 0x7f132c0c2b90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f131400ec80 tx=0x7f13140091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.113+0000 7f1331838700 1 -- 172.21.15.153:0/927511446 shutdown_connections 2024-08-17T02:26:38.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.113+0000 7f1331838700 1 --2- 172.21.15.153:0/927511446 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f130c060890 0x7f130c062d40 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.113+0000 7f1331838700 1 --2- 172.21.15.153:0/927511446 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f132c15dbc0 0x7f132c0c30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.113+0000 7f1331838700 1 --2- 172.21.15.153:0/927511446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f132c1596d0 0x7f132c0c2b90 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.113+0000 7f1331838700 1 --2- 172.21.15.153:0/927511446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f132c159300 0x7f132c0ceb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.113+0000 7f1331838700 1 -- 172.21.15.153:0/927511446 >> 172.21.15.153:0/927511446 conn(0x7f132c0682c0 msgr2=0x7f132c0b3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.113+0000 7f1331838700 1 -- 172.21.15.153:0/927511446 shutdown_connections 2024-08-17T02:26:38.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.113+0000 7f1331838700 1 -- 172.21.15.153:0/927511446 wait complete. 2024-08-17T02:26:38.129 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:26:38.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.229+0000 7f4057941700 1 Processor -- start 2024-08-17T02:26:38.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.229+0000 7f4057941700 1 -- start start 2024-08-17T02:26:38.236 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.233+0000 7f4057941700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4050142c40 0x7f4050067430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.236 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.233+0000 7f4057941700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4050067970 0x7f405015ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.233+0000 7f4057941700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4050067dd0 con 0x7f4050142870 2024-08-17T02:26:38.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.233+0000 7f4057941700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f405015cde0 con 0x7f4050142c40 2024-08-17T02:26:38.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.233+0000 7f4057941700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f405015d030 con 0x7f4050067970 2024-08-17T02:26:38.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.233+0000 7f40556dd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f4050142870 0x7f40500b05c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:60094/0 (socket says 172.21.15.153:60094) 2024-08-17T02:26:38.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.233+0000 7f40556dd700 1 -- 172.21.15.153:0/2842463861 learned_addr learned my addr 172.21.15.153:0/2842463861 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:38.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.233+0000 7f4054edc700 1 --2- 172.21.15.153:0/2842463861 >> v2:172.21.15.153:3300/0 conn(0x7f4050142c40 0x7f4050067430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.233+0000 7f4055ede700 1 --2- 172.21.15.153:0/2842463861 >> v2:172.21.15.174:3300/0 conn(0x7f4050067970 0x7f405015ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.233+0000 7f4047fff700 1 -- 172.21.15.153:0/2842463861 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1354452044 0 0) 0x7f404c001110 con 0x7f4050142870 2024-08-17T02:26:38.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.233+0000 7f4054edc700 1 -- 172.21.15.153:0/2842463861 >> v2:172.21.15.174:3300/0 conn(0x7f4050067970 msgr2=0x7f405015ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:38.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.233+0000 7f4054edc700 1 --2- 172.21.15.153:0/2842463861 >> v2:172.21.15.174:3300/0 conn(0x7f4050067970 0x7f405015ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.233+0000 7f4054edc700 1 -- 172.21.15.153:0/2842463861 >> v1:172.21.15.153:6789/0 conn(0x7f4050142870 legacy=0x7f40500b05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.233+0000 7f4054edc700 1 -- 172.21.15.153:0/2842463861 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405015d310 con 0x7f4050142c40 2024-08-17T02:26:38.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.233+0000 7f4054edc700 1 --2- 172.21.15.153:0/2842463861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4050142c40 0x7f4050067430 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f40500b1400 tx=0x7f40400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22bac17e1b000f58 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.233+0000 7f4047fff700 1 -- 172.21.15.153:0/2842463861 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4040011630 con 0x7f4050142c40 2024-08-17T02:26:38.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.233+0000 7f4047fff700 1 -- 172.21.15.153:0/2842463861 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4040011790 con 0x7f4050142c40 2024-08-17T02:26:38.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.233+0000 7f4047fff700 1 -- 172.21.15.153:0/2842463861 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4040011b30 con 0x7f4050142c40 2024-08-17T02:26:38.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.233+0000 7f4057941700 1 -- 172.21.15.153:0/2842463861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4050142c40 msgr2=0x7f4050067430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.233+0000 7f4057941700 1 --2- 172.21.15.153:0/2842463861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4050142c40 0x7f4050067430 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f40500b1400 tx=0x7f40400091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.233+0000 7f4057941700 1 -- 172.21.15.153:0/2842463861 shutdown_connections 2024-08-17T02:26:38.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.233+0000 7f4057941700 1 --2- 172.21.15.153:0/2842463861 >> v2:172.21.15.174:3300/0 conn(0x7f4050067970 0x7f405015ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.233+0000 7f4057941700 1 --2- 172.21.15.153:0/2842463861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4050142c40 0x7f4050067430 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.233+0000 7f4057941700 1 -- 172.21.15.153:0/2842463861 >> 172.21.15.153:0/2842463861 conn(0x7f40500687a0 msgr2=0x7f405006c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.233+0000 7f4057941700 1 -- 172.21.15.153:0/2842463861 shutdown_connections 2024-08-17T02:26:38.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.233+0000 7f4057941700 1 -- 172.21.15.153:0/2842463861 wait complete. 2024-08-17T02:26:38.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.237+0000 7f4057941700 1 Processor -- start 2024-08-17T02:26:38.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.237+0000 7f4057941700 1 -- start start 2024-08-17T02:26:38.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.237+0000 7f4057941700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4050067970 0x7f4050159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.237+0000 7f4057941700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4050142870 0x7f405016cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.237+0000 7f4057941700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4050142c40 0x7f405016d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.237+0000 7f4057941700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405016dce0 con 0x7f4050142870 2024-08-17T02:26:38.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.237+0000 7f4057941700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40500ae490 con 0x7f4050067970 2024-08-17T02:26:38.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.237+0000 7f4057941700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f405016da00 con 0x7f4050142c40 2024-08-17T02:26:38.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.237+0000 7f4054edc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4050142870 0x7f405016cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.237+0000 7f4054edc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4050142870 0x7f405016cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59612/0 (socket says 172.21.15.153:59612) 2024-08-17T02:26:38.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.237+0000 7f4054edc700 1 -- 172.21.15.153:0/1454683116 learned_addr learned my addr 172.21.15.153:0/1454683116 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:38.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.237+0000 7f40556dd700 1 --2- 172.21.15.153:0/1454683116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4050067970 0x7f4050159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.237+0000 7f4055ede700 1 --2- 172.21.15.153:0/1454683116 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4050142c40 0x7f405016d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.237+0000 7f4054edc700 1 -- 172.21.15.153:0/1454683116 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4050142c40 msgr2=0x7f405016d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.237+0000 7f4054edc700 1 --2- 172.21.15.153:0/1454683116 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4050142c40 0x7f405016d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.237+0000 7f4054edc700 1 -- 172.21.15.153:0/1454683116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4050067970 msgr2=0x7f4050159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.237+0000 7f4054edc700 1 --2- 172.21.15.153:0/1454683116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4050067970 0x7f4050159a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.241+0000 7f4054edc700 1 -- 172.21.15.153:0/1454683116 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4040009420 con 0x7f4050142870 2024-08-17T02:26:38.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.241+0000 7f40556dd700 1 --2- 172.21.15.153:0/1454683116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4050067970 0x7f4050159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:38.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.241+0000 7f4054edc700 1 --2- 172.21.15.153:0/1454683116 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4050142870 0x7f405016cdd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4050070120 tx=0x7f4040017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.241+0000 7f40457fa700 1 -- 172.21.15.153:0/1454683116 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4040011900 con 0x7f4050142870 2024-08-17T02:26:38.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.241+0000 7f40457fa700 1 -- 172.21.15.153:0/1454683116 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4040011a60 con 0x7f4050142870 2024-08-17T02:26:38.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.241+0000 7f4057941700 1 -- 172.21.15.153:0/1454683116 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40500ade40 con 0x7f4050142870 2024-08-17T02:26:38.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.241+0000 7f40457fa700 1 -- 172.21.15.153:0/1454683116 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4040025670 con 0x7f4050142870 2024-08-17T02:26:38.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.241+0000 7f4057941700 1 -- 172.21.15.153:0/1454683116 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4050131300 con 0x7f4050142870 2024-08-17T02:26:38.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.241+0000 7f4057941700 1 -- 172.21.15.153:0/1454683116 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40500ae600 con 0x7f4050142870 2024-08-17T02:26:38.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.241+0000 7f40457fa700 1 -- 172.21.15.153:0/1454683116 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4040023070 con 0x7f4050142870 2024-08-17T02:26:38.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.241+0000 7f40457fa700 1 --2- 172.21.15.153:0/1454683116 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4034060860 0x7f4034062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.241+0000 7f40457fa700 1 -- 172.21.15.153:0/1454683116 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f404007e090 con 0x7f4050142870 2024-08-17T02:26:38.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.241+0000 7f40556dd700 1 --2- 172.21.15.153:0/1454683116 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4034060860 0x7f4034062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.241+0000 7f40556dd700 1 --2- 172.21.15.153:0/1454683116 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4034060860 0x7f4034062d10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f404c0018c0 tx=0x7f404c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.249+0000 7f40457fa700 1 -- 172.21.15.153:0/1454683116 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f404004e560 con 0x7f4050142870 2024-08-17T02:26:38.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.413+0000 7f4057941700 1 -- 172.21.15.153:0/1454683116 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f40500645c0 con 0x7f4050142870 2024-08-17T02:26:38.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.417+0000 7f40457fa700 1 -- 172.21.15.153:0/1454683116 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4040057070 con 0x7f4050142870 2024-08-17T02:26:38.418 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2024-08-17T02:26:38.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.417+0000 7f4057941700 1 -- 172.21.15.153:0/1454683116 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4034060860 msgr2=0x7f4034062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.417+0000 7f4057941700 1 --2- 172.21.15.153:0/1454683116 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4034060860 0x7f4034062d10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f404c0018c0 tx=0x7f404c009040 comp rx=0 tx=0).stop 2024-08-17T02:26:38.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.417+0000 7f4057941700 1 -- 172.21.15.153:0/1454683116 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4050142870 msgr2=0x7f405016cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.417+0000 7f4057941700 1 --2- 172.21.15.153:0/1454683116 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4050142870 0x7f405016cdd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4050070120 tx=0x7f4040017000 comp rx=0 tx=0).stop 2024-08-17T02:26:38.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.417+0000 7f4057941700 1 -- 172.21.15.153:0/1454683116 shutdown_connections 2024-08-17T02:26:38.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.417+0000 7f4057941700 1 --2- 172.21.15.153:0/1454683116 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4034060860 0x7f4034062d10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.417+0000 7f4057941700 1 --2- 172.21.15.153:0/1454683116 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4050142c40 0x7f405016d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.417+0000 7f4057941700 1 --2- 172.21.15.153:0/1454683116 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4050142870 0x7f405016cdd0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.417+0000 7f4057941700 1 --2- 172.21.15.153:0/1454683116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4050067970 0x7f4050159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.417+0000 7f4057941700 1 -- 172.21.15.153:0/1454683116 >> 172.21.15.153:0/1454683116 conn(0x7f40500687a0 msgr2=0x7f405013fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.417+0000 7f4057941700 1 -- 172.21.15.153:0/1454683116 shutdown_connections 2024-08-17T02:26:38.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.417+0000 7f4057941700 1 -- 172.21.15.153:0/1454683116 wait complete. 2024-08-17T02:26:38.433 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:26:38.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.545+0000 7fa52e8dd700 1 Processor -- start 2024-08-17T02:26:38.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.545+0000 7fa52e8dd700 1 -- start start 2024-08-17T02:26:38.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.545+0000 7fa52e8dd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa5281514d0 0x7fa52806ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.545+0000 7fa52e8dd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa5280b14a0 0x7fa528157990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.545+0000 7fa52e8dd700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa52806e010 con 0x7fa5281574f0 2024-08-17T02:26:38.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.545+0000 7fa52e8dd700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa52806efa0 con 0x7fa5280b14a0 2024-08-17T02:26:38.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.545+0000 7fa52e8dd700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa528157fb0 con 0x7fa5281514d0 2024-08-17T02:26:38.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.545+0000 7fa52e0dc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa5280b14a0 0x7fa528157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.545+0000 7fa52e0dc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa5280b14a0 0x7fa528157990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59628/0 (socket says 172.21.15.153:59628) 2024-08-17T02:26:38.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.545+0000 7fa52e0dc700 1 -- 172.21.15.153:0/158174871 learned_addr learned my addr 172.21.15.153:0/158174871 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:38.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.545+0000 7fa52d8db700 1 --2- 172.21.15.153:0/158174871 >> v2:172.21.15.174:3300/0 conn(0x7fa5281514d0 0x7fa52806ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.545+0000 7fa52e0dc700 1 -- 172.21.15.153:0/158174871 >> v2:172.21.15.174:3300/0 conn(0x7fa5281514d0 msgr2=0x7fa52806ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:38.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.545+0000 7fa52e0dc700 1 --2- 172.21.15.153:0/158174871 >> v2:172.21.15.174:3300/0 conn(0x7fa5281514d0 0x7fa52806ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.545+0000 7fa52e0dc700 1 -- 172.21.15.153:0/158174871 >> v1:172.21.15.174:6789/0 conn(0x7fa5281574f0 legacy=0x7fa5280b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:38.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.545+0000 7fa52e0dc700 1 -- 172.21.15.153:0/158174871 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa528158290 con 0x7fa5280b14a0 2024-08-17T02:26:38.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.545+0000 7fa52d8db700 1 --2- 172.21.15.153:0/158174871 >> v2:172.21.15.174:3300/0 conn(0x7fa5281514d0 0x7fa52806ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:38.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.545+0000 7fa52e0dc700 1 --2- 172.21.15.153:0/158174871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5280b14a0 0x7fa528157990 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa52805f080 tx=0x7fa524009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c7cfd0db19faeec server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.545+0000 7fa52c8d9700 1 -- 172.21.15.153:0/158174871 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52400b820 con 0x7fa5280b14a0 2024-08-17T02:26:38.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.545+0000 7fa52c8d9700 1 -- 172.21.15.153:0/158174871 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa52400b980 con 0x7fa5280b14a0 2024-08-17T02:26:38.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.545+0000 7fa52c8d9700 1 -- 172.21.15.153:0/158174871 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52400bd20 con 0x7fa5280b14a0 2024-08-17T02:26:38.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.549+0000 7fa52e8dd700 1 -- 172.21.15.153:0/158174871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5280b14a0 msgr2=0x7fa528157990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.549+0000 7fa52e8dd700 1 --2- 172.21.15.153:0/158174871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5280b14a0 0x7fa528157990 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa52805f080 tx=0x7fa524009250 comp rx=0 tx=0).stop 2024-08-17T02:26:38.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.549+0000 7fa52e8dd700 1 -- 172.21.15.153:0/158174871 shutdown_connections 2024-08-17T02:26:38.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.549+0000 7fa52e8dd700 1 --2- 172.21.15.153:0/158174871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5280b14a0 0x7fa528157990 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.549+0000 7fa52e8dd700 1 --2- 172.21.15.153:0/158174871 >> v2:172.21.15.174:3300/0 conn(0x7fa5281514d0 0x7fa52806ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.549+0000 7fa52e8dd700 1 -- 172.21.15.153:0/158174871 >> 172.21.15.153:0/158174871 conn(0x7fa5280678a0 msgr2=0x7fa528067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.549+0000 7fa52e8dd700 1 -- 172.21.15.153:0/158174871 shutdown_connections 2024-08-17T02:26:38.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.549+0000 7fa52e8dd700 1 -- 172.21.15.153:0/158174871 wait complete. 2024-08-17T02:26:38.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.549+0000 7fa52e8dd700 1 Processor -- start 2024-08-17T02:26:38.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.549+0000 7fa52e8dd700 1 -- start start 2024-08-17T02:26:38.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.549+0000 7fa52e8dd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5280b14a0 0x7fa52815b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.549+0000 7fa52e8dd700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5281514d0 0x7fa5280aa390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.549+0000 7fa52e8dd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5281574f0 0x7fa5281502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.549+0000 7fa52e8dd700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5280aa8d0 con 0x7fa5280b14a0 2024-08-17T02:26:38.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.549+0000 7fa52e8dd700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52815b940 con 0x7fa5281514d0 2024-08-17T02:26:38.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.549+0000 7fa52e8dd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5280aed00 con 0x7fa5281574f0 2024-08-17T02:26:38.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.549+0000 7fa52d8db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5280b14a0 0x7fa52815b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.549+0000 7fa52d0da700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5281514d0 0x7fa5280aa390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.549+0000 7fa52e0dc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5281574f0 0x7fa5281502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.549+0000 7fa52d0da700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5281514d0 0x7fa5280aa390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.153:50530/0 (socket says 172.21.15.153:50530) 2024-08-17T02:26:38.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.549+0000 7fa52d0da700 1 -- 172.21.15.153:0/408573008 learned_addr learned my addr 172.21.15.153:0/408573008 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:38.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.553+0000 7fa52d0da700 1 -- 172.21.15.153:0/408573008 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5281574f0 msgr2=0x7fa5281502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.553+0000 7fa52d0da700 1 --2- 172.21.15.153:0/408573008 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5281574f0 0x7fa5281502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.553+0000 7fa52d0da700 1 -- 172.21.15.153:0/408573008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5280b14a0 msgr2=0x7fa52815b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.553+0000 7fa52d0da700 1 --2- 172.21.15.153:0/408573008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5280b14a0 0x7fa52815b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.553+0000 7fa52d0da700 1 -- 172.21.15.153:0/408573008 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5240094f0 con 0x7fa5281514d0 2024-08-17T02:26:38.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.553+0000 7fa52d0da700 1 --2- 172.21.15.153:0/408573008 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5281514d0 0x7fa5280aa390 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa51c00bc30 tx=0x7fa51c009820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.553+0000 7fa519ffb700 1 -- 172.21.15.153:0/408573008 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c00c840 con 0x7fa5281514d0 2024-08-17T02:26:38.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.553+0000 7fa519ffb700 1 -- 172.21.15.153:0/408573008 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa51c00c9e0 con 0x7fa5281514d0 2024-08-17T02:26:38.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.553+0000 7fa519ffb700 1 -- 172.21.15.153:0/408573008 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c00cda0 con 0x7fa5281514d0 2024-08-17T02:26:38.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.553+0000 7fa52e8dd700 1 -- 172.21.15.153:0/408573008 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5280aefe0 con 0x7fa5281514d0 2024-08-17T02:26:38.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.553+0000 7fa52e8dd700 1 -- 172.21.15.153:0/408573008 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa528150800 con 0x7fa5281514d0 2024-08-17T02:26:38.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.553+0000 7fa52e8dd700 1 -- 172.21.15.153:0/408573008 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5281509f0 con 0x7fa5281514d0 2024-08-17T02:26:38.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.553+0000 7fa519ffb700 1 -- 172.21.15.153:0/408573008 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa51c014620 con 0x7fa5281514d0 2024-08-17T02:26:38.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.553+0000 7fa519ffb700 1 --2- 172.21.15.153:0/408573008 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fa50c060860 0x7fa50c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.553+0000 7fa519ffb700 1 -- 172.21.15.153:0/408573008 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa51c07ccb0 con 0x7fa5281514d0 2024-08-17T02:26:38.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.553+0000 7fa52d8db700 1 --2- 172.21.15.153:0/408573008 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fa50c060860 0x7fa50c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.557+0000 7fa52d8db700 1 --2- 172.21.15.153:0/408573008 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fa50c060860 0x7fa50c062d10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa52000adc0 tx=0x7fa520006f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.565+0000 7fa519ffb700 1 -- 172.21.15.153:0/408573008 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa51c04d060 con 0x7fa5281514d0 2024-08-17T02:26:38.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.729+0000 7fa52e8dd700 1 -- 172.21.15.153:0/408573008 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa528064330 con 0x7fa5281514d0 2024-08-17T02:26:38.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.733+0000 7fa519ffb700 1 -- 172.21.15.153:0/408573008 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa51c050680 con 0x7fa5281514d0 2024-08-17T02:26:38.736 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2024-08-17T02:26:38.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.733+0000 7fa52e8dd700 1 -- 172.21.15.153:0/408573008 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fa50c060860 msgr2=0x7fa50c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.733+0000 7fa52e8dd700 1 --2- 172.21.15.153:0/408573008 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fa50c060860 0x7fa50c062d10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa52000adc0 tx=0x7fa520006f90 comp rx=0 tx=0).stop 2024-08-17T02:26:38.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.733+0000 7fa52e8dd700 1 -- 172.21.15.153:0/408573008 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5281514d0 msgr2=0x7fa5280aa390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.733+0000 7fa52e8dd700 1 --2- 172.21.15.153:0/408573008 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5281514d0 0x7fa5280aa390 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa51c00bc30 tx=0x7fa51c009820 comp rx=0 tx=0).stop 2024-08-17T02:26:38.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.733+0000 7fa52e8dd700 1 -- 172.21.15.153:0/408573008 shutdown_connections 2024-08-17T02:26:38.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.733+0000 7fa52e8dd700 1 --2- 172.21.15.153:0/408573008 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fa50c060860 0x7fa50c062d10 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.733+0000 7fa52e8dd700 1 --2- 172.21.15.153:0/408573008 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5281574f0 0x7fa5281502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.733+0000 7fa52e8dd700 1 --2- 172.21.15.153:0/408573008 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5281514d0 0x7fa5280aa390 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.733+0000 7fa52e8dd700 1 --2- 172.21.15.153:0/408573008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5280b14a0 0x7fa52815b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.733+0000 7fa52e8dd700 1 -- 172.21.15.153:0/408573008 >> 172.21.15.153:0/408573008 conn(0x7fa5280678a0 msgr2=0x7fa528156170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.733+0000 7fa52e8dd700 1 -- 172.21.15.153:0/408573008 shutdown_connections 2024-08-17T02:26:38.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.733+0000 7fa52e8dd700 1 -- 172.21.15.153:0/408573008 wait complete. 2024-08-17T02:26:38.749 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:38.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.853+0000 7f0c7f40d700 1 Processor -- start 2024-08-17T02:26:38.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.853+0000 7f0c7f40d700 1 -- start start 2024-08-17T02:26:38.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.853+0000 7f0c7f40d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0c7815d540 0x7f0c780af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.853+0000 7f0c7f40d700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c780b0270 con 0x7f0c780a9430 2024-08-17T02:26:38.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.853+0000 7f0c7f40d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c780af660 con 0x7f0c7806e830 2024-08-17T02:26:38.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.853+0000 7f0c7f40d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c780af940 con 0x7f0c7815d540 2024-08-17T02:26:38.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.853+0000 7f0c7d1a9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0c7815d540 0x7f0c780af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.853+0000 7f0c7d9aa700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f0c780a9430 0x7f0c780b0700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:60096/0 (socket says 172.21.15.153:60096) 2024-08-17T02:26:38.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.853+0000 7f0c7d9aa700 1 -- 172.21.15.153:0/2975406922 learned_addr learned my addr 172.21.15.153:0/2975406922 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:38.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.853+0000 7f0c6bfff700 1 -- 172.21.15.153:0/2975406922 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2783700707 0 0) 0x7f0c780b0270 con 0x7f0c780a9430 2024-08-17T02:26:38.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.853+0000 7f0c6bfff700 1 -- 172.21.15.153:0/2975406922 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c64003570 con 0x7f0c780a9430 2024-08-17T02:26:38.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.853+0000 7f0c7d1a9700 1 -- 172.21.15.153:0/2975406922 >> v1:172.21.15.174:6789/0 conn(0x7f0c7806e830 legacy=0x7f0c780a8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.853+0000 7f0c7d1a9700 1 -- 172.21.15.153:0/2975406922 >> v1:172.21.15.153:6789/0 conn(0x7f0c780a9430 legacy=0x7f0c780b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.853+0000 7f0c7d1a9700 1 -- 172.21.15.153:0/2975406922 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c780afc20 con 0x7f0c7815d540 2024-08-17T02:26:38.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.853+0000 7f0c7d1a9700 1 --2- 172.21.15.153:0/2975406922 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c7815d540 0x7f0c780af030 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0c740098e0 tx=0x7f0c740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c8428565eda5898 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.853+0000 7f0c6bfff700 1 -- 172.21.15.153:0/2975406922 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7400b640 con 0x7f0c7815d540 2024-08-17T02:26:38.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.853+0000 7f0c6bfff700 1 -- 172.21.15.153:0/2975406922 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7400b7a0 con 0x7f0c7815d540 2024-08-17T02:26:38.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.853+0000 7f0c6bfff700 1 -- 172.21.15.153:0/2975406922 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7400bb40 con 0x7f0c7815d540 2024-08-17T02:26:38.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.853+0000 7f0c7f40d700 1 -- 172.21.15.153:0/2975406922 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c7815d540 msgr2=0x7f0c780af030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.853+0000 7f0c7f40d700 1 --2- 172.21.15.153:0/2975406922 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c7815d540 0x7f0c780af030 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0c740098e0 tx=0x7f0c740091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.853+0000 7f0c7f40d700 1 -- 172.21.15.153:0/2975406922 shutdown_connections 2024-08-17T02:26:38.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.853+0000 7f0c7f40d700 1 --2- 172.21.15.153:0/2975406922 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c7815d540 0x7f0c780af030 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.853+0000 7f0c7f40d700 1 -- 172.21.15.153:0/2975406922 >> 172.21.15.153:0/2975406922 conn(0x7f0c78066e00 msgr2=0x7f0c78067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.853+0000 7f0c7f40d700 1 -- 172.21.15.153:0/2975406922 shutdown_connections 2024-08-17T02:26:38.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.853+0000 7f0c7f40d700 1 -- 172.21.15.153:0/2975406922 wait complete. 2024-08-17T02:26:38.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.857+0000 7f0c7f40d700 1 Processor -- start 2024-08-17T02:26:38.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.857+0000 7f0c7f40d700 1 -- start start 2024-08-17T02:26:38.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.857+0000 7f0c7f40d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c7806e830 0x7f0c78096b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.857+0000 7f0c7f40d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c780a9430 0x7f0c780ca370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.857+0000 7f0c7f40d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c7815d540 0x7f0c780ac8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.857+0000 7f0c7f40d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c780abbe0 con 0x7f0c7806e830 2024-08-17T02:26:38.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.857+0000 7f0c7f40d700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c780cad50 con 0x7f0c780a9430 2024-08-17T02:26:38.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.857+0000 7f0c7f40d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c780abe30 con 0x7f0c7815d540 2024-08-17T02:26:38.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.857+0000 7f0c7d1a9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c7806e830 0x7f0c78096b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.857+0000 7f0c7d1a9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c7806e830 0x7f0c78096b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59650/0 (socket says 172.21.15.153:59650) 2024-08-17T02:26:38.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.857+0000 7f0c7d1a9700 1 -- 172.21.15.153:0/2011592634 learned_addr learned my addr 172.21.15.153:0/2011592634 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:38.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.857+0000 7f0c7d9aa700 1 --2- 172.21.15.153:0/2011592634 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c7815d540 0x7f0c780ac8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.857+0000 7f0c7c9a8700 1 --2- 172.21.15.153:0/2011592634 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c780a9430 0x7f0c780ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.857+0000 7f0c7d1a9700 1 -- 172.21.15.153:0/2011592634 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c7815d540 msgr2=0x7f0c780ac8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.857+0000 7f0c7d1a9700 1 --2- 172.21.15.153:0/2011592634 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c7815d540 0x7f0c780ac8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.857+0000 7f0c7d1a9700 1 -- 172.21.15.153:0/2011592634 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c780a9430 msgr2=0x7f0c780ca370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.857+0000 7f0c7d1a9700 1 --2- 172.21.15.153:0/2011592634 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c780a9430 0x7f0c780ca370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.857+0000 7f0c7d1a9700 1 -- 172.21.15.153:0/2011592634 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c74009420 con 0x7f0c7806e830 2024-08-17T02:26:38.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.857+0000 7f0c7d1a9700 1 --2- 172.21.15.153:0/2011592634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c7806e830 0x7f0c78096b10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0c740093f0 tx=0x7f0c74017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.857+0000 7f0c697fa700 1 -- 172.21.15.153:0/2011592634 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c74000d10 con 0x7f0c7806e830 2024-08-17T02:26:38.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.857+0000 7f0c697fa700 1 -- 172.21.15.153:0/2011592634 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7400bb20 con 0x7f0c7806e830 2024-08-17T02:26:38.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.857+0000 7f0c7f40d700 1 -- 172.21.15.153:0/2011592634 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c780ac110 con 0x7f0c7806e830 2024-08-17T02:26:38.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.857+0000 7f0c697fa700 1 -- 172.21.15.153:0/2011592634 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c74011670 con 0x7f0c7806e830 2024-08-17T02:26:38.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.857+0000 7f0c7f40d700 1 -- 172.21.15.153:0/2011592634 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c78157500 con 0x7f0c7806e830 2024-08-17T02:26:38.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.861+0000 7f0c7f40d700 1 -- 172.21.15.153:0/2011592634 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c780645c0 con 0x7f0c7806e830 2024-08-17T02:26:38.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.861+0000 7f0c697fa700 1 -- 172.21.15.153:0/2011592634 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0c74011aa0 con 0x7f0c7806e830 2024-08-17T02:26:38.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.861+0000 7f0c697fa700 1 --2- 172.21.15.153:0/2011592634 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f0c5c060860 0x7f0c5c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.861+0000 7f0c697fa700 1 -- 172.21.15.153:0/2011592634 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0c7407e320 con 0x7f0c7806e830 2024-08-17T02:26:38.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.861+0000 7f0c7c9a8700 1 --2- 172.21.15.153:0/2011592634 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f0c5c060860 0x7f0c5c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.861+0000 7f0c7c9a8700 1 --2- 172.21.15.153:0/2011592634 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f0c5c060860 0x7f0c5c062d10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0c70007fd0 tx=0x7f0c70001650 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:38.865+0000 7f0c697fa700 1 -- 172.21.15.153:0/2011592634 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f0c7404e770 con 0x7f0c7806e830 2024-08-17T02:26:39.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.029+0000 7f0c7f40d700 1 -- 172.21.15.153:0/2011592634 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c7806f100 con 0x7f0c7806e830 2024-08-17T02:26:39.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.033+0000 7f0c697fa700 1 -- 172.21.15.153:0/2011592634 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f0c74051d90 con 0x7f0c7806e830 2024-08-17T02:26:39.035 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:39.035 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":21,"fsid":"56d41c33-b929-456d-96be-2aac4ecd299d","created":"2024-08-17T02:25:47.756085+0000","modified":"2024-08-17T02:26:13.759246+0000","last_up_change":"2024-08-17T02:25:58.643690+0000","last_in_change":"2024-08-17T02:25:49.809186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:58.093273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:09.856520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:11.080706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0736f8e6-818e-42e6-a0dc-8aaf813315d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":24234},{"type":"v1","addr":"172.21.15.153:6817","nonce":24234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":24234},{"type":"v1","addr":"172.21.15.153:6819","nonce":24234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":24234},{"type":"v1","addr":"172.21.15.153:6823","nonce":24234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":24234},{"type":"v1","addr":"172.21.15.153:6821","nonce":24234}]},"public_addr":"172.21.15.153:6817/24234","cluster_addr":"172.21.15.153:6819/24234","heartbeat_back_addr":"172.21.15.153:6823/24234","heartbeat_front_addr":"172.21.15.153:6821/24234","state":["exists","up"]},{"osd":1,"uuid":"011762e9-6c2d-441a-aa56-68474639d72f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":24232},{"type":"v1","addr":"172.21.15.153:6801","nonce":24232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":24232},{"type":"v1","addr":"172.21.15.153:6803","nonce":24232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":24232},{"type":"v1","addr":"172.21.15.153:6809","nonce":24232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":24232},{"type":"v1","addr":"172.21.15.153:6806","nonce":24232}]},"public_addr":"172.21.15.153:6801/24232","cluster_addr":"172.21.15.153:6803/24232","heartbeat_back_addr":"172.21.15.153:6809/24232","heartbeat_front_addr":"172.21.15.153:6806/24232","state":["exists","up"]},{"osd":2,"uuid":"b562cd97-aa12-455e-b46a-e720a2ec9d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":24235},{"type":"v1","addr":"172.21.15.153:6808","nonce":24235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":24235},{"type":"v1","addr":"172.21.15.153:6811","nonce":24235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":24235},{"type":"v1","addr":"172.21.15.153:6815","nonce":24235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":24235},{"type":"v1","addr":"172.21.15.153:6813","nonce":24235}]},"public_addr":"172.21.15.153:6808/24235","cluster_addr":"172.21.15.153:6811/24235","heartbeat_back_addr":"172.21.15.153:6815/24235","heartbeat_front_addr":"172.21.15.153:6813/24235","state":["exists","up"]},{"osd":3,"uuid":"222da52f-90c2-4132-a5d2-6f6cf83d4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":24236},{"type":"v1","addr":"172.21.15.153:6825","nonce":24236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":24236},{"type":"v1","addr":"172.21.15.153:6827","nonce":24236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":24236},{"type":"v1","addr":"172.21.15.153:6831","nonce":24236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":24236},{"type":"v1","addr":"172.21.15.153:6829","nonce":24236}]},"public_addr":"172.21.15.153:6825/24236","cluster_addr":"172.21.15.153:6827/24236","heartbeat_back_addr":"172.21.15.153:6831/24236","heartbeat_front_addr":"172.21.15.153:6829/24236","state":["exists","up"]},{"osd":4,"uuid":"a38a04cd-032b-4977-a260-1ef3567d0c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24456},{"type":"v1","addr":"172.21.15.174:6809","nonce":24456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24456},{"type":"v1","addr":"172.21.15.174:6811","nonce":24456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24456},{"type":"v1","addr":"172.21.15.174:6815","nonce":24456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24456},{"type":"v1","addr":"172.21.15.174:6813","nonce":24456}]},"public_addr":"172.21.15.174:6809/24456","cluster_addr":"172.21.15.174:6811/24456","heartbeat_back_addr":"172.21.15.174:6815/24456","heartbeat_front_addr":"172.21.15.174:6813/24456","state":["exists","up"]},{"osd":5,"uuid":"c7778084-e751-48da-87a1-ab8bbe85aa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24457},{"type":"v1","addr":"172.21.15.174:6825","nonce":24457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24457},{"type":"v1","addr":"172.21.15.174:6827","nonce":24457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24457},{"type":"v1","addr":"172.21.15.174:6831","nonce":24457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24457},{"type":"v1","addr":"172.21.15.174:6829","nonce":24457}]},"public_addr":"172.21.15.174:6825/24457","cluster_addr":"172.21.15.174:6827/24457","heartbeat_back_addr":"172.21.15.174:6831/24457","heartbeat_front_addr":"172.21.15.174:6829/24457","state":["exists","up"]},{"osd":6,"uuid":"2d8e0715-254f-442c-9625-50721d0bc858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24477},{"type":"v1","addr":"172.21.15.174:6801","nonce":24477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24477},{"type":"v1","addr":"172.21.15.174:6803","nonce":24477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24477},{"type":"v1","addr":"172.21.15.174:6807","nonce":24477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24477},{"type":"v1","addr":"172.21.15.174:6805","nonce":24477}]},"public_addr":"172.21.15.174:6801/24477","cluster_addr":"172.21.15.174:6803/24477","heartbeat_back_addr":"172.21.15.174:6807/24477","heartbeat_front_addr":"172.21.15.174:6805/24477","state":["exists","up"]},{"osd":7,"uuid":"dffda25a-4601-4ddb-9a27-b0be1cadde27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24455},{"type":"v1","addr":"172.21.15.174:6817","nonce":24455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24455},{"type":"v1","addr":"172.21.15.174:6819","nonce":24455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24455},{"type":"v1","addr":"172.21.15.174:6823","nonce":24455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24455},{"type":"v1","addr":"172.21.15.174:6821","nonce":24455}]},"public_addr":"172.21.15.174:6817/24455","cluster_addr":"172.21.15.174:6819/24455","heartbeat_back_addr":"172.21.15.174:6823/24455","heartbeat_front_addr":"172.21.15.174:6821/24455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.990117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.033862+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.748087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.112877+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.070448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.360961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.110940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.226377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:39.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.033+0000 7f0c7f40d700 1 -- 172.21.15.153:0/2011592634 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f0c5c060860 msgr2=0x7f0c5c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.033+0000 7f0c7f40d700 1 --2- 172.21.15.153:0/2011592634 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f0c5c060860 0x7f0c5c062d10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0c70007fd0 tx=0x7f0c70001650 comp rx=0 tx=0).stop 2024-08-17T02:26:39.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.033+0000 7f0c7f40d700 1 -- 172.21.15.153:0/2011592634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c7806e830 msgr2=0x7f0c78096b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.033+0000 7f0c7f40d700 1 --2- 172.21.15.153:0/2011592634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c7806e830 0x7f0c78096b10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0c740093f0 tx=0x7f0c74017000 comp rx=0 tx=0).stop 2024-08-17T02:26:39.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.033+0000 7f0c7f40d700 1 -- 172.21.15.153:0/2011592634 shutdown_connections 2024-08-17T02:26:39.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.033+0000 7f0c7f40d700 1 --2- 172.21.15.153:0/2011592634 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f0c5c060860 0x7f0c5c062d10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.033+0000 7f0c7f40d700 1 --2- 172.21.15.153:0/2011592634 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c7815d540 0x7f0c780ac8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.033+0000 7f0c7f40d700 1 --2- 172.21.15.153:0/2011592634 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c780a9430 0x7f0c780ca370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.033+0000 7f0c7f40d700 1 --2- 172.21.15.153:0/2011592634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c7806e830 0x7f0c78096b10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.033+0000 7f0c7f40d700 1 -- 172.21.15.153:0/2011592634 >> 172.21.15.153:0/2011592634 conn(0x7f0c78066e00 msgr2=0x7f0c78161b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:39.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.033+0000 7f0c7f40d700 1 -- 172.21.15.153:0/2011592634 shutdown_connections 2024-08-17T02:26:39.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.033+0000 7f0c7f40d700 1 -- 172.21.15.153:0/2011592634 wait complete. 2024-08-17T02:26:39.051 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:58.093273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:26:09.856520+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:26:11.080706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:26:39.051 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:39.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.157+0000 7ff433fff700 1 Processor -- start 2024-08-17T02:26:39.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.157+0000 7ff433fff700 1 -- start start 2024-08-17T02:26:39.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.161+0000 7ff433fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff434067030 0x7ff434067400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.161+0000 7ff433fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff4340cfb00 0x7ff4340cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.161+0000 7ff433fff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4340cf670 con 0x7ff4340cb5c0 2024-08-17T02:26:39.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.161+0000 7ff433fff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4340cea60 con 0x7ff4340cfb00 2024-08-17T02:26:39.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.161+0000 7ff433fff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4340ced40 con 0x7ff434067030 2024-08-17T02:26:39.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.161+0000 7ff42bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff4340cfb00 0x7ff4340cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.161+0000 7ff42bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff4340cfb00 0x7ff4340cb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59666/0 (socket says 172.21.15.153:59666) 2024-08-17T02:26:39.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.161+0000 7ff42bfff700 1 -- 172.21.15.153:0/3536666114 learned_addr learned my addr 172.21.15.153:0/3536666114 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:39.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.161+0000 7ff432ffd700 1 --2- 172.21.15.153:0/3536666114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff434067030 0x7ff434067400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.161+0000 7ff42bfff700 1 -- 172.21.15.153:0/3536666114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff434067030 msgr2=0x7ff434067400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:39.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.161+0000 7ff42bfff700 1 --2- 172.21.15.153:0/3536666114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff434067030 0x7ff434067400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.161+0000 7ff42bfff700 1 -- 172.21.15.153:0/3536666114 >> v1:172.21.15.174:6789/0 conn(0x7ff4340cb5c0 legacy=0x7ff434158cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.161+0000 7ff42bfff700 1 -- 172.21.15.153:0/3536666114 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4340cf020 con 0x7ff4340cfb00 2024-08-17T02:26:39.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.161+0000 7ff42bfff700 1 --2- 172.21.15.153:0/3536666114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4340cfb00 0x7ff4340cb080 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff41c0099b0 tx=0x7ff41c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaef517edfe4483d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.161+0000 7ff4327fc700 1 -- 172.21.15.153:0/3536666114 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c009ea0 con 0x7ff4340cfb00 2024-08-17T02:26:39.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.161+0000 7ff4327fc700 1 -- 172.21.15.153:0/3536666114 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41c00b860 con 0x7ff4340cfb00 2024-08-17T02:26:39.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.161+0000 7ff4327fc700 1 -- 172.21.15.153:0/3536666114 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c00bc00 con 0x7ff4340cfb00 2024-08-17T02:26:39.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.161+0000 7ff433fff700 1 -- 172.21.15.153:0/3536666114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4340cfb00 msgr2=0x7ff4340cb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.161+0000 7ff433fff700 1 --2- 172.21.15.153:0/3536666114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4340cfb00 0x7ff4340cb080 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff41c0099b0 tx=0x7ff41c009250 comp rx=0 tx=0).stop 2024-08-17T02:26:39.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.161+0000 7ff433fff700 1 -- 172.21.15.153:0/3536666114 shutdown_connections 2024-08-17T02:26:39.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.161+0000 7ff433fff700 1 --2- 172.21.15.153:0/3536666114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4340cfb00 0x7ff4340cb080 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.161+0000 7ff433fff700 1 --2- 172.21.15.153:0/3536666114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff434067030 0x7ff434067400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.161+0000 7ff433fff700 1 -- 172.21.15.153:0/3536666114 >> 172.21.15.153:0/3536666114 conn(0x7ff4340d0b50 msgr2=0x7ff4340ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:39.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.161+0000 7ff433fff700 1 -- 172.21.15.153:0/3536666114 shutdown_connections 2024-08-17T02:26:39.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.161+0000 7ff433fff700 1 -- 172.21.15.153:0/3536666114 wait complete. 2024-08-17T02:26:39.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.165+0000 7ff433fff700 1 Processor -- start 2024-08-17T02:26:39.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.165+0000 7ff433fff700 1 -- start start 2024-08-17T02:26:39.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.165+0000 7ff433fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff434067030 0x7ff434149810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.165+0000 7ff433fff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4340cb5c0 0x7ff434158070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.165+0000 7ff433fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4340cfb00 0x7ff43414c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.165+0000 7ff433fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff434155390 con 0x7ff4340cfb00 2024-08-17T02:26:39.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.165+0000 7ff433fff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43414b270 con 0x7ff4340cb5c0 2024-08-17T02:26:39.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.165+0000 7ff433fff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff43414b510 con 0x7ff434067030 2024-08-17T02:26:39.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.165+0000 7ff4337fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4340cfb00 0x7ff43414c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.165+0000 7ff4337fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4340cfb00 0x7ff43414c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59668/0 (socket says 172.21.15.153:59668) 2024-08-17T02:26:39.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.165+0000 7ff4337fe700 1 -- 172.21.15.153:0/458495002 learned_addr learned my addr 172.21.15.153:0/458495002 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:39.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.165+0000 7ff42bfff700 1 --2- 172.21.15.153:0/458495002 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4340cb5c0 0x7ff434158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.165+0000 7ff432ffd700 1 --2- 172.21.15.153:0/458495002 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff434067030 0x7ff434149810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.165+0000 7ff4337fe700 1 -- 172.21.15.153:0/458495002 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff434067030 msgr2=0x7ff434149810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.165+0000 7ff4337fe700 1 --2- 172.21.15.153:0/458495002 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff434067030 0x7ff434149810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.165+0000 7ff4337fe700 1 -- 172.21.15.153:0/458495002 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4340cb5c0 msgr2=0x7ff434158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.165+0000 7ff4337fe700 1 --2- 172.21.15.153:0/458495002 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4340cb5c0 0x7ff434158070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.165+0000 7ff4337fe700 1 -- 172.21.15.153:0/458495002 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff41c0094f0 con 0x7ff4340cfb00 2024-08-17T02:26:39.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.169+0000 7ff4337fe700 1 --2- 172.21.15.153:0/458495002 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4340cfb00 0x7ff43414c2d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff42c00c8e0 tx=0x7ff42c001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.169+0000 7ff42affd700 1 -- 172.21.15.153:0/458495002 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c012630 con 0x7ff4340cfb00 2024-08-17T02:26:39.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.169+0000 7ff42affd700 1 -- 172.21.15.153:0/458495002 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42c0127b0 con 0x7ff4340cfb00 2024-08-17T02:26:39.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.169+0000 7ff433fff700 1 -- 172.21.15.153:0/458495002 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff43414b7f0 con 0x7ff4340cfb00 2024-08-17T02:26:39.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.169+0000 7ff42affd700 1 -- 172.21.15.153:0/458495002 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c012b70 con 0x7ff4340cfb00 2024-08-17T02:26:39.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.169+0000 7ff433fff700 1 -- 172.21.15.153:0/458495002 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff43414bdb0 con 0x7ff4340cfb00 2024-08-17T02:26:39.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.169+0000 7ff433fff700 1 -- 172.21.15.153:0/458495002 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4340638f0 con 0x7ff4340cfb00 2024-08-17T02:26:39.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.169+0000 7ff42affd700 1 -- 172.21.15.153:0/458495002 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff42c003030 con 0x7ff4340cfb00 2024-08-17T02:26:39.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.173+0000 7ff42affd700 1 --2- 172.21.15.153:0/458495002 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff414060860 0x7ff414062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.173+0000 7ff42affd700 1 -- 172.21.15.153:0/458495002 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff42c07ca90 con 0x7ff4340cfb00 2024-08-17T02:26:39.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.173+0000 7ff432ffd700 1 --2- 172.21.15.153:0/458495002 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff414060860 0x7ff414062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.173+0000 7ff432ffd700 1 --2- 172.21.15.153:0/458495002 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff414060860 0x7ff414062d10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff424009db0 tx=0x7ff4240091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.177+0000 7ff42affd700 1 -- 172.21.15.153:0/458495002 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff42c04ce40 con 0x7ff4340cfb00 2024-08-17T02:26:39.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.349+0000 7ff433fff700 1 -- 172.21.15.153:0/458495002 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff4340cdd70 con 0x7ff4340cfb00 2024-08-17T02:26:39.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.349+0000 7ff42affd700 1 -- 172.21.15.153:0/458495002 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff42c050460 con 0x7ff4340cfb00 2024-08-17T02:26:39.351 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2024-08-17T02:26:39.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.349+0000 7ff433fff700 1 -- 172.21.15.153:0/458495002 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff414060860 msgr2=0x7ff414062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.349+0000 7ff433fff700 1 --2- 172.21.15.153:0/458495002 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff414060860 0x7ff414062d10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff424009db0 tx=0x7ff4240091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.349+0000 7ff433fff700 1 -- 172.21.15.153:0/458495002 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4340cfb00 msgr2=0x7ff43414c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.349+0000 7ff433fff700 1 --2- 172.21.15.153:0/458495002 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4340cfb00 0x7ff43414c2d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff42c00c8e0 tx=0x7ff42c001710 comp rx=0 tx=0).stop 2024-08-17T02:26:39.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.349+0000 7ff433fff700 1 -- 172.21.15.153:0/458495002 shutdown_connections 2024-08-17T02:26:39.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.349+0000 7ff433fff700 1 --2- 172.21.15.153:0/458495002 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff414060860 0x7ff414062d10 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.349+0000 7ff433fff700 1 --2- 172.21.15.153:0/458495002 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4340cfb00 0x7ff43414c2d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.349+0000 7ff433fff700 1 --2- 172.21.15.153:0/458495002 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4340cb5c0 0x7ff434158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.349+0000 7ff433fff700 1 --2- 172.21.15.153:0/458495002 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff434067030 0x7ff434149810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.349+0000 7ff433fff700 1 -- 172.21.15.153:0/458495002 >> 172.21.15.153:0/458495002 conn(0x7ff4340d0b50 msgr2=0x7ff43414a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:39.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.349+0000 7ff433fff700 1 -- 172.21.15.153:0/458495002 shutdown_connections 2024-08-17T02:26:39.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.349+0000 7ff433fff700 1 -- 172.21.15.153:0/458495002 wait complete. 2024-08-17T02:26:39.365 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:26:39.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.469+0000 7f4abde84700 1 Processor -- start 2024-08-17T02:26:39.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.469+0000 7f4abde84700 1 -- start start 2024-08-17T02:26:39.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.473+0000 7f4abde84700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ab8067510 0x7f4ab80ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.473+0000 7f4abde84700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4ab8159480 0x7f4ab80cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.473+0000 7f4abde84700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab80ce210 con 0x7f4ab81590b0 2024-08-17T02:26:39.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.473+0000 7f4abde84700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ab80cba00 con 0x7f4ab8159480 2024-08-17T02:26:39.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.473+0000 7f4abde84700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab80cdc90 con 0x7f4ab8067510 2024-08-17T02:26:39.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.473+0000 7f4abd683700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4ab8159480 0x7f4ab80cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.473+0000 7f4abd683700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4ab8159480 0x7f4ab80cebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59680/0 (socket says 172.21.15.153:59680) 2024-08-17T02:26:39.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.473+0000 7f4abd683700 1 -- 172.21.15.153:0/745249397 learned_addr learned my addr 172.21.15.153:0/745249397 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:39.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.473+0000 7f4ab7fff700 1 --2- 172.21.15.153:0/745249397 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ab8067510 0x7f4ab80ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.473+0000 7f4abd683700 1 -- 172.21.15.153:0/745249397 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ab8067510 msgr2=0x7f4ab80ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:39.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.473+0000 7f4abd683700 1 --2- 172.21.15.153:0/745249397 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ab8067510 0x7f4ab80ce6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.473+0000 7f4abd683700 1 -- 172.21.15.153:0/745249397 >> v1:172.21.15.174:6789/0 conn(0x7f4ab81590b0 legacy=0x7f4ab8066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.473+0000 7f4abd683700 1 -- 172.21.15.153:0/745249397 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab80cb440 con 0x7f4ab8159480 2024-08-17T02:26:39.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.473+0000 7f4abd683700 1 --2- 172.21.15.153:0/745249397 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ab8159480 0x7f4ab80cebe0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4ab00099b0 tx=0x7f4ab0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22d2e629fcf9a85 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.473+0000 7f4ab77fe700 1 -- 172.21.15.153:0/745249397 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0009ea0 con 0x7f4ab8159480 2024-08-17T02:26:39.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.473+0000 7f4ab77fe700 1 -- 172.21.15.153:0/745249397 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab000b860 con 0x7f4ab8159480 2024-08-17T02:26:39.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.473+0000 7f4ab77fe700 1 -- 172.21.15.153:0/745249397 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab000bc00 con 0x7f4ab8159480 2024-08-17T02:26:39.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.473+0000 7f4abde84700 1 -- 172.21.15.153:0/745249397 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ab8159480 msgr2=0x7f4ab80cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.473+0000 7f4abde84700 1 --2- 172.21.15.153:0/745249397 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ab8159480 0x7f4ab80cebe0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4ab00099b0 tx=0x7f4ab0009250 comp rx=0 tx=0).stop 2024-08-17T02:26:39.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.473+0000 7f4abde84700 1 -- 172.21.15.153:0/745249397 shutdown_connections 2024-08-17T02:26:39.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.473+0000 7f4abde84700 1 --2- 172.21.15.153:0/745249397 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ab8159480 0x7f4ab80cebe0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.473+0000 7f4abde84700 1 --2- 172.21.15.153:0/745249397 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ab8067510 0x7f4ab80ce6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.473+0000 7f4abde84700 1 -- 172.21.15.153:0/745249397 >> 172.21.15.153:0/745249397 conn(0x7f4ab80d0b90 msgr2=0x7f4ab80ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:39.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.473+0000 7f4abde84700 1 -- 172.21.15.153:0/745249397 shutdown_connections 2024-08-17T02:26:39.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.473+0000 7f4abde84700 1 -- 172.21.15.153:0/745249397 wait complete. 2024-08-17T02:26:39.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.477+0000 7f4abde84700 1 Processor -- start 2024-08-17T02:26:39.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.477+0000 7f4abde84700 1 -- start start 2024-08-17T02:26:39.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.477+0000 7f4abde84700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ab8067510 0x7f4ab80c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.477+0000 7f4abde84700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ab81590b0 0x7f4ab8156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.481+0000 7f4abde84700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ab8159480 0x7f4ab8143a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.481+0000 7f4abde84700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab8157c40 con 0x7f4ab8159480 2024-08-17T02:26:39.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.481+0000 7f4abde84700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab81568d0 con 0x7f4ab81590b0 2024-08-17T02:26:39.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.481+0000 7f4abde84700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab8156ba0 con 0x7f4ab8067510 2024-08-17T02:26:39.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.481+0000 7f4abd683700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ab8159480 0x7f4ab8143a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.481+0000 7f4ab7fff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ab81590b0 0x7f4ab8156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.481+0000 7f4ab7fff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ab81590b0 0x7f4ab8156390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.153:50556/0 (socket says 172.21.15.153:50556) 2024-08-17T02:26:39.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.481+0000 7f4abce82700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ab8067510 0x7f4ab80c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.481+0000 7f4abd683700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ab8159480 0x7f4ab8143a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59696/0 (socket says 172.21.15.153:59696) 2024-08-17T02:26:39.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.481+0000 7f4ab7fff700 1 -- 172.21.15.153:0/482386218 learned_addr learned my addr 172.21.15.153:0/482386218 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:39.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.481+0000 7f4abd683700 1 -- 172.21.15.153:0/482386218 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ab8067510 msgr2=0x7f4ab80c8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.481+0000 7f4abd683700 1 --2- 172.21.15.153:0/482386218 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ab8067510 0x7f4ab80c8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.481+0000 7f4abd683700 1 -- 172.21.15.153:0/482386218 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ab81590b0 msgr2=0x7f4ab8156390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.481+0000 7f4abd683700 1 --2- 172.21.15.153:0/482386218 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ab81590b0 0x7f4ab8156390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.481+0000 7f4abd683700 1 -- 172.21.15.153:0/482386218 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab00094f0 con 0x7f4ab8159480 2024-08-17T02:26:39.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.481+0000 7f4abd683700 1 --2- 172.21.15.153:0/482386218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ab8159480 0x7f4ab8143a90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8071780 tx=0x7f4ab0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.481+0000 7f4ab4ff9700 1 -- 172.21.15.153:0/482386218 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab000baa0 con 0x7f4ab8159480 2024-08-17T02:26:39.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.481+0000 7f4ab4ff9700 1 -- 172.21.15.153:0/482386218 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab0025420 con 0x7f4ab8159480 2024-08-17T02:26:39.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.481+0000 7f4abde84700 1 -- 172.21.15.153:0/482386218 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ab8156e80 con 0x7f4ab8159480 2024-08-17T02:26:39.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.481+0000 7f4ab4ff9700 1 -- 172.21.15.153:0/482386218 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab00257e0 con 0x7f4ab8159480 2024-08-17T02:26:39.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.481+0000 7f4abde84700 1 -- 172.21.15.153:0/482386218 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ab8157440 con 0x7f4ab8159480 2024-08-17T02:26:39.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.481+0000 7f4abde84700 1 -- 172.21.15.153:0/482386218 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ab8064330 con 0x7f4ab8159480 2024-08-17T02:26:39.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.481+0000 7f4ab4ff9700 1 -- 172.21.15.153:0/482386218 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4ab0023070 con 0x7f4ab8159480 2024-08-17T02:26:39.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.481+0000 7f4ab4ff9700 1 --2- 172.21.15.153:0/482386218 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4a98060860 0x7f4a98062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.481+0000 7f4ab4ff9700 1 -- 172.21.15.153:0/482386218 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4ab007e0d0 con 0x7f4ab8159480 2024-08-17T02:26:39.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.481+0000 7f4abce82700 1 --2- 172.21.15.153:0/482386218 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4a98060860 0x7f4a98062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.485+0000 7f4abce82700 1 --2- 172.21.15.153:0/482386218 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4a98060860 0x7f4a98062d10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8007fd0 tx=0x7f4aa80016f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.489+0000 7f4ab4ff9700 1 -- 172.21.15.153:0/482386218 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f4ab004e520 con 0x7f4ab8159480 2024-08-17T02:26:39.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.649+0000 7f4abde84700 1 -- 172.21.15.153:0/482386218 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4ab8070cf0 con 0x7f4ab8159480 2024-08-17T02:26:39.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.649+0000 7f4ab4ff9700 1 -- 172.21.15.153:0/482386218 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4ab002a020 con 0x7f4ab8159480 2024-08-17T02:26:39.654 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2024-08-17T02:26:39.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.653+0000 7f4abde84700 1 -- 172.21.15.153:0/482386218 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4a98060860 msgr2=0x7f4a98062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.653+0000 7f4abde84700 1 --2- 172.21.15.153:0/482386218 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4a98060860 0x7f4a98062d10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8007fd0 tx=0x7f4aa80016f0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.653+0000 7f4abde84700 1 -- 172.21.15.153:0/482386218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ab8159480 msgr2=0x7f4ab8143a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.653+0000 7f4abde84700 1 --2- 172.21.15.153:0/482386218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ab8159480 0x7f4ab8143a90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8071780 tx=0x7f4ab0017000 comp rx=0 tx=0).stop 2024-08-17T02:26:39.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.653+0000 7f4abde84700 1 -- 172.21.15.153:0/482386218 shutdown_connections 2024-08-17T02:26:39.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.653+0000 7f4abde84700 1 --2- 172.21.15.153:0/482386218 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4a98060860 0x7f4a98062d10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.653+0000 7f4abde84700 1 --2- 172.21.15.153:0/482386218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ab8159480 0x7f4ab8143a90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.653+0000 7f4abde84700 1 --2- 172.21.15.153:0/482386218 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ab81590b0 0x7f4ab8156390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.653+0000 7f4abde84700 1 --2- 172.21.15.153:0/482386218 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ab8067510 0x7f4ab80c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.653+0000 7f4abde84700 1 -- 172.21.15.153:0/482386218 >> 172.21.15.153:0/482386218 conn(0x7f4ab80d0b90 msgr2=0x7f4ab8066e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:39.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.653+0000 7f4abde84700 1 -- 172.21.15.153:0/482386218 shutdown_connections 2024-08-17T02:26:39.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.653+0000 7f4abde84700 1 -- 172.21.15.153:0/482386218 wait complete. 2024-08-17T02:26:39.668 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:26:39.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.777+0000 7f3e45ef1700 1 Processor -- start 2024-08-17T02:26:39.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.777+0000 7f3e45ef1700 1 -- start start 2024-08-17T02:26:39.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.777+0000 7f3e45ef1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3e40140910 0x7f3e400c8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.777+0000 7f3e45ef1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3e400ae6f0 0x7f3e400cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.777+0000 7f3e45ef1700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e400cc440 con 0x7f3e400cbab0 2024-08-17T02:26:39.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.777+0000 7f3e45ef1700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e400c3e30 con 0x7f3e400ae6f0 2024-08-17T02:26:39.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.777+0000 7f3e45ef1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e400c4110 con 0x7f3e40140910 2024-08-17T02:26:39.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.777+0000 7f3e456f0700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3e400ae6f0 0x7f3e400cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.777+0000 7f3e456f0700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3e400ae6f0 0x7f3e400cbf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59712/0 (socket says 172.21.15.153:59712) 2024-08-17T02:26:39.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.777+0000 7f3e3ffff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f3e400cbab0 0x7f3e400c2c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:60104/0 (socket says 172.21.15.153:60104) 2024-08-17T02:26:39.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.777+0000 7f3e456f0700 1 -- 172.21.15.153:0/3611124367 learned_addr learned my addr 172.21.15.153:0/3611124367 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:39.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.777+0000 7f3e44eef700 1 --2- 172.21.15.153:0/3611124367 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3e40140910 0x7f3e400c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.777+0000 7f3e456f0700 1 -- 172.21.15.153:0/3611124367 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3e40140910 msgr2=0x7f3e400c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:39.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.777+0000 7f3e456f0700 1 --2- 172.21.15.153:0/3611124367 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3e40140910 0x7f3e400c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.777+0000 7f3e456f0700 1 -- 172.21.15.153:0/3611124367 >> v1:172.21.15.153:6789/0 conn(0x7f3e400cbab0 legacy=0x7f3e400c2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.777+0000 7f3e456f0700 1 -- 172.21.15.153:0/3611124367 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e400c43f0 con 0x7f3e400ae6f0 2024-08-17T02:26:39.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.777+0000 7f3e456f0700 1 --2- 172.21.15.153:0/3611124367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e400ae6f0 0x7f3e400cbf00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3e38009f20 tx=0x7f3e38009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6e91a2147c3cd0f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.777+0000 7f3e3f7fe700 1 -- 172.21.15.153:0/3611124367 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3800e070 con 0x7f3e400ae6f0 2024-08-17T02:26:39.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.777+0000 7f3e3f7fe700 1 -- 172.21.15.153:0/3611124367 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3800ba80 con 0x7f3e400ae6f0 2024-08-17T02:26:39.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.781+0000 7f3e3f7fe700 1 -- 172.21.15.153:0/3611124367 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e380092e0 con 0x7f3e400ae6f0 2024-08-17T02:26:39.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.781+0000 7f3e45ef1700 1 -- 172.21.15.153:0/3611124367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e400ae6f0 msgr2=0x7f3e400cbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.781+0000 7f3e45ef1700 1 --2- 172.21.15.153:0/3611124367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e400ae6f0 0x7f3e400cbf00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3e38009f20 tx=0x7f3e38009840 comp rx=0 tx=0).stop 2024-08-17T02:26:39.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.781+0000 7f3e45ef1700 1 -- 172.21.15.153:0/3611124367 shutdown_connections 2024-08-17T02:26:39.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.781+0000 7f3e45ef1700 1 --2- 172.21.15.153:0/3611124367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e400ae6f0 0x7f3e400cbf00 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.781+0000 7f3e45ef1700 1 --2- 172.21.15.153:0/3611124367 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3e40140910 0x7f3e400c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.781+0000 7f3e45ef1700 1 -- 172.21.15.153:0/3611124367 >> 172.21.15.153:0/3611124367 conn(0x7f3e400cdee0 msgr2=0x7f3e400ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:39.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.781+0000 7f3e45ef1700 1 -- 172.21.15.153:0/3611124367 shutdown_connections 2024-08-17T02:26:39.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.781+0000 7f3e45ef1700 1 -- 172.21.15.153:0/3611124367 wait complete. 2024-08-17T02:26:39.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.781+0000 7f3e45ef1700 1 Processor -- start 2024-08-17T02:26:39.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.781+0000 7f3e45ef1700 1 -- start start 2024-08-17T02:26:39.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.781+0000 7f3e45ef1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3e400ae6f0 0x7f3e400aa3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.781+0000 7f3e45ef1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e400cbab0 0x7f3e401565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.781+0000 7f3e45ef1700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3e40140910 0x7f3e4013f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.781+0000 7f3e45ef1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e40069370 con 0x7f3e400cbab0 2024-08-17T02:26:39.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.781+0000 7f3e45ef1700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e400687a0 con 0x7f3e40140910 2024-08-17T02:26:39.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.781+0000 7f3e45ef1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e40068a40 con 0x7f3e400ae6f0 2024-08-17T02:26:39.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.785+0000 7f3e3ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e400cbab0 0x7f3e401565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.785+0000 7f3e3ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e400cbab0 0x7f3e401565c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59722/0 (socket says 172.21.15.153:59722) 2024-08-17T02:26:39.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.785+0000 7f3e3ffff700 1 -- 172.21.15.153:0/3779819657 learned_addr learned my addr 172.21.15.153:0/3779819657 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:39.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.785+0000 7f3e456f0700 1 --2- 172.21.15.153:0/3779819657 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3e40140910 0x7f3e4013f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.785+0000 7f3e44eef700 1 --2- 172.21.15.153:0/3779819657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3e400ae6f0 0x7f3e400aa3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.785+0000 7f3e3ffff700 1 -- 172.21.15.153:0/3779819657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3e400ae6f0 msgr2=0x7f3e400aa3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.785+0000 7f3e3ffff700 1 --2- 172.21.15.153:0/3779819657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3e400ae6f0 0x7f3e400aa3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.785+0000 7f3e3ffff700 1 -- 172.21.15.153:0/3779819657 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3e40140910 msgr2=0x7f3e4013f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.785+0000 7f3e3ffff700 1 --2- 172.21.15.153:0/3779819657 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3e40140910 0x7f3e4013f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.785+0000 7f3e3ffff700 1 -- 172.21.15.153:0/3779819657 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e38009ae0 con 0x7f3e400cbab0 2024-08-17T02:26:39.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.785+0000 7f3e3ffff700 1 --2- 172.21.15.153:0/3779819657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e400cbab0 0x7f3e401565c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3e2800c7c0 tx=0x7f3e28007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.785+0000 7f3e3cff9700 1 -- 172.21.15.153:0/3779819657 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e28005a70 con 0x7f3e400cbab0 2024-08-17T02:26:39.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.785+0000 7f3e3cff9700 1 -- 172.21.15.153:0/3779819657 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e28005bd0 con 0x7f3e400cbab0 2024-08-17T02:26:39.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.785+0000 7f3e45ef1700 1 -- 172.21.15.153:0/3779819657 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e40068d20 con 0x7f3e400cbab0 2024-08-17T02:26:39.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.785+0000 7f3e3cff9700 1 -- 172.21.15.153:0/3779819657 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e280070d0 con 0x7f3e400cbab0 2024-08-17T02:26:39.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.785+0000 7f3e45ef1700 1 -- 172.21.15.153:0/3779819657 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e400aa920 con 0x7f3e400cbab0 2024-08-17T02:26:39.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.785+0000 7f3e45ef1700 1 -- 172.21.15.153:0/3779819657 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e400694e0 con 0x7f3e400cbab0 2024-08-17T02:26:39.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.789+0000 7f3e3cff9700 1 -- 172.21.15.153:0/3779819657 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f3e28007440 con 0x7f3e400cbab0 2024-08-17T02:26:39.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.789+0000 7f3e3cff9700 1 --2- 172.21.15.153:0/3779819657 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3e20060860 0x7f3e20062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.789+0000 7f3e3cff9700 1 -- 172.21.15.153:0/3779819657 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3e2807c070 con 0x7f3e400cbab0 2024-08-17T02:26:39.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.789+0000 7f3e44eef700 1 --2- 172.21.15.153:0/3779819657 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3e20060860 0x7f3e20062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.789+0000 7f3e44eef700 1 --2- 172.21.15.153:0/3779819657 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3e20060860 0x7f3e20062d10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3e30006fd0 tx=0x7f3e30008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.797+0000 7f3e3cff9700 1 -- 172.21.15.153:0/3779819657 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f3e2804c420 con 0x7f3e400cbab0 2024-08-17T02:26:39.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.961+0000 7f3e45ef1700 1 -- 172.21.15.153:0/3779819657 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3e400638f0 con 0x7f3e400cbab0 2024-08-17T02:26:39.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.961+0000 7f3e3cff9700 1 -- 172.21.15.153:0/3779819657 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3e280170a0 con 0x7f3e400cbab0 2024-08-17T02:26:39.963 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2024-08-17T02:26:39.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.961+0000 7f3e45ef1700 1 -- 172.21.15.153:0/3779819657 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3e20060860 msgr2=0x7f3e20062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.961+0000 7f3e45ef1700 1 --2- 172.21.15.153:0/3779819657 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3e20060860 0x7f3e20062d10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3e30006fd0 tx=0x7f3e30008040 comp rx=0 tx=0).stop 2024-08-17T02:26:39.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.961+0000 7f3e45ef1700 1 -- 172.21.15.153:0/3779819657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e400cbab0 msgr2=0x7f3e401565c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.961+0000 7f3e45ef1700 1 --2- 172.21.15.153:0/3779819657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e400cbab0 0x7f3e401565c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3e2800c7c0 tx=0x7f3e28007f30 comp rx=0 tx=0).stop 2024-08-17T02:26:39.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.961+0000 7f3e45ef1700 1 -- 172.21.15.153:0/3779819657 shutdown_connections 2024-08-17T02:26:39.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.961+0000 7f3e45ef1700 1 --2- 172.21.15.153:0/3779819657 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3e20060860 0x7f3e20062d10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.961+0000 7f3e45ef1700 1 --2- 172.21.15.153:0/3779819657 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3e40140910 0x7f3e4013f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.961+0000 7f3e45ef1700 1 --2- 172.21.15.153:0/3779819657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e400cbab0 0x7f3e401565c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.961+0000 7f3e45ef1700 1 --2- 172.21.15.153:0/3779819657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3e400ae6f0 0x7f3e400aa3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.961+0000 7f3e45ef1700 1 -- 172.21.15.153:0/3779819657 >> 172.21.15.153:0/3779819657 conn(0x7f3e400cdee0 msgr2=0x7f3e400aeae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:39.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.961+0000 7f3e45ef1700 1 -- 172.21.15.153:0/3779819657 shutdown_connections 2024-08-17T02:26:39.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:39.961+0000 7f3e45ef1700 1 -- 172.21.15.153:0/3779819657 wait complete. 2024-08-17T02:26:40.045 INFO:tasks.cephfs_test_runner:Starting test: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) That the volume can be created and then cleans up 2024-08-17T02:26:40.046 INFO:tasks.cephfs_test_runner:test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:26:40.046 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:40.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.153+0000 7f1b5759e700 1 Processor -- start 2024-08-17T02:26:40.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.153+0000 7f1b5759e700 1 -- start start 2024-08-17T02:26:40.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.153+0000 7f1b5759e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1b58158eb0 0x7f1b580aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.153+0000 7f1b5759e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b580aecc0 0x7f1b5806df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.153+0000 7f1b5759e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b580ac000 con 0x7f1b58159280 2024-08-17T02:26:40.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.153+0000 7f1b5759e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b580ad4a0 con 0x7f1b58158eb0 2024-08-17T02:26:40.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.153+0000 7f1b5759e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b580ab3f0 con 0x7f1b580aecc0 2024-08-17T02:26:40.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.153+0000 7f1b56d9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f1b58159280 0x7f1b580a9860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:60120/0 (socket says 172.21.15.153:60120) 2024-08-17T02:26:40.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.153+0000 7f1b5659c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1b58158eb0 0x7f1b580aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.153+0000 7f1b56d9d700 1 -- 172.21.15.153:0/143897769 learned_addr learned my addr 172.21.15.153:0/143897769 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:40.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.153+0000 7f1b55d9b700 1 --2- 172.21.15.153:0/143897769 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b580aecc0 0x7f1b5806df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.153+0000 7f1b5559a700 1 -- 172.21.15.153:0/143897769 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2127905714 0 0) 0x7f1b580ac000 con 0x7f1b58159280 2024-08-17T02:26:40.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.153+0000 7f1b5559a700 1 -- 172.21.15.153:0/143897769 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b40003570 con 0x7f1b58159280 2024-08-17T02:26:40.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.153+0000 7f1b5559a700 1 -- 172.21.15.153:0/143897769 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1989186355 0 0) 0x7f1b40003570 con 0x7f1b58159280 2024-08-17T02:26:40.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.153+0000 7f1b5559a700 1 -- 172.21.15.153:0/143897769 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b580aecc0 msgr2=0x7f1b5806df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:40.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.153+0000 7f1b5559a700 1 --2- 172.21.15.153:0/143897769 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b580aecc0 0x7f1b5806df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.153+0000 7f1b5559a700 1 -- 172.21.15.153:0/143897769 >> v2:172.21.15.153:3300/0 conn(0x7f1b58158eb0 msgr2=0x7f1b580aaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:40.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.153+0000 7f1b5559a700 1 --2- 172.21.15.153:0/143897769 >> v2:172.21.15.153:3300/0 conn(0x7f1b58158eb0 0x7f1b580aaa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.153+0000 7f1b5559a700 1 -- 172.21.15.153:0/143897769 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b580ab6d0 con 0x7f1b58159280 2024-08-17T02:26:40.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.153+0000 7f1b5559a700 1 -- 172.21.15.153:0/143897769 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3701463666 0 0) 0x7f1b48001470 con 0x7f1b58159280 2024-08-17T02:26:40.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.153+0000 7f1b5659c700 1 --2- 172.21.15.153:0/143897769 >> v2:172.21.15.153:3300/0 conn(0x7f1b58158eb0 0x7f1b580aaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:40.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.153+0000 7f1b5559a700 1 -- 172.21.15.153:0/143897769 >> v1:172.21.15.153:6789/0 conn(0x7f1b58159280 legacy=0x7f1b580a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.153+0000 7f1b5559a700 1 --2- 172.21.15.153:0/143897769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b40003a60 0x7f1b40003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.153+0000 7f1b5559a700 1 --2- 172.21.15.153:0/143897769 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b580aecc0 0x7f1b40004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.153+0000 7f1b5559a700 1 --2- 172.21.15.153:0/143897769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b40004d50 0x7f1b400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.153+0000 7f1b5559a700 1 -- 172.21.15.153:0/143897769 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b580ad4a0 con 0x7f1b40004d50 2024-08-17T02:26:40.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.153+0000 7f1b5559a700 1 -- 172.21.15.153:0/143897769 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b580ab3f0 con 0x7f1b40003a60 2024-08-17T02:26:40.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.153+0000 7f1b5559a700 1 -- 172.21.15.153:0/143897769 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4000ba60 con 0x7f1b580aecc0 2024-08-17T02:26:40.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.153+0000 7f1b56d9d700 1 --2- 172.21.15.153:0/143897769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b40004d50 0x7f1b400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.157+0000 7f1b5659c700 1 --2- 172.21.15.153:0/143897769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b40003a60 0x7f1b40003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.157+0000 7f1b55d9b700 1 --2- 172.21.15.153:0/143897769 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b580aecc0 0x7f1b40004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.157+0000 7f1b56d9d700 1 -- 172.21.15.153:0/143897769 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b580aecc0 msgr2=0x7f1b40004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:40.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.157+0000 7f1b56d9d700 1 --2- 172.21.15.153:0/143897769 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b580aecc0 0x7f1b40004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.157+0000 7f1b56d9d700 1 -- 172.21.15.153:0/143897769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b40003a60 msgr2=0x7f1b40003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:40.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.157+0000 7f1b56d9d700 1 --2- 172.21.15.153:0/143897769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b40003a60 0x7f1b40003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.157+0000 7f1b56d9d700 1 -- 172.21.15.153:0/143897769 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b40003570 con 0x7f1b40004d50 2024-08-17T02:26:40.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.157+0000 7f1b5659c700 1 --2- 172.21.15.153:0/143897769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b40003a60 0x7f1b40003e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:40.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.157+0000 7f1b56d9d700 1 --2- 172.21.15.153:0/143897769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b40004d50 0x7f1b400051c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1b4800c710 tx=0x7f1b48007c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=246ddeeac0d517f3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.157+0000 7f1b5559a700 1 -- 172.21.15.153:0/143897769 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b48005920 con 0x7f1b40004d50 2024-08-17T02:26:40.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.157+0000 7f1b5559a700 1 -- 172.21.15.153:0/143897769 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b48005ac0 con 0x7f1b40004d50 2024-08-17T02:26:40.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.157+0000 7f1b5559a700 1 -- 172.21.15.153:0/143897769 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b48005e80 con 0x7f1b40004d50 2024-08-17T02:26:40.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.157+0000 7f1b5759e700 1 -- 172.21.15.153:0/143897769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b40004d50 msgr2=0x7f1b400051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.157+0000 7f1b5759e700 1 --2- 172.21.15.153:0/143897769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b40004d50 0x7f1b400051c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1b4800c710 tx=0x7f1b48007c20 comp rx=0 tx=0).stop 2024-08-17T02:26:40.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.157+0000 7f1b56d9d700 1 -- 172.21.15.153:0/143897769 reap_dead start 2024-08-17T02:26:40.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.157+0000 7f1b5759e700 1 -- 172.21.15.153:0/143897769 shutdown_connections 2024-08-17T02:26:40.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.157+0000 7f1b5759e700 1 -- 172.21.15.153:0/143897769 >> 172.21.15.153:0/143897769 conn(0x7f1b580678d0 msgr2=0x7f1b58067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.157+0000 7f1b5759e700 1 -- 172.21.15.153:0/143897769 shutdown_connections 2024-08-17T02:26:40.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.157+0000 7f1b5759e700 1 -- 172.21.15.153:0/143897769 wait complete. 2024-08-17T02:26:40.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.157+0000 7f1b5759e700 1 Processor -- start 2024-08-17T02:26:40.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.161+0000 7f1b5759e700 1 -- start start 2024-08-17T02:26:40.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.161+0000 7f1b5759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b40004d50 0x7f1b5814ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.161+0000 7f1b5759e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b580c98a0 0x7f1b580b0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.161+0000 7f1b5759e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b5815ee10 0x7f1b5815f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.161+0000 7f1b5759e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5814bf60 con 0x7f1b40004d50 2024-08-17T02:26:40.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.161+0000 7f1b5759e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b580b07a0 con 0x7f1b5815ee10 2024-08-17T02:26:40.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.161+0000 7f1b5759e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5815f7c0 con 0x7f1b580c98a0 2024-08-17T02:26:40.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.161+0000 7f1b5659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b40004d50 0x7f1b5814ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.161+0000 7f1b5659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b40004d50 0x7f1b5814ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59746/0 (socket says 172.21.15.153:59746) 2024-08-17T02:26:40.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.161+0000 7f1b5659c700 1 -- 172.21.15.153:0/3381770352 learned_addr learned my addr 172.21.15.153:0/3381770352 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:40.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.161+0000 7f1b56d9d700 1 --2- 172.21.15.153:0/3381770352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b5815ee10 0x7f1b5815f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.161+0000 7f1b55d9b700 1 --2- 172.21.15.153:0/3381770352 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b580c98a0 0x7f1b580b0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.161+0000 7f1b5659c700 1 -- 172.21.15.153:0/3381770352 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b580c98a0 msgr2=0x7f1b580b0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.161+0000 7f1b5659c700 1 --2- 172.21.15.153:0/3381770352 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b580c98a0 0x7f1b580b0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.161+0000 7f1b5659c700 1 -- 172.21.15.153:0/3381770352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b5815ee10 msgr2=0x7f1b5815f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.161+0000 7f1b5659c700 1 --2- 172.21.15.153:0/3381770352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b5815ee10 0x7f1b5815f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.161+0000 7f1b5659c700 1 -- 172.21.15.153:0/3381770352 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b580c9e60 con 0x7f1b40004d50 2024-08-17T02:26:40.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.161+0000 7f1b5659c700 1 --2- 172.21.15.153:0/3381770352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b40004d50 0x7f1b5814ba20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1b5000f530 tx=0x7f1b5000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.161+0000 7f1b467fc700 1 -- 172.21.15.153:0/3381770352 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5000e040 con 0x7f1b40004d50 2024-08-17T02:26:40.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.161+0000 7f1b467fc700 1 -- 172.21.15.153:0/3381770352 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5000f040 con 0x7f1b40004d50 2024-08-17T02:26:40.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.161+0000 7f1b467fc700 1 -- 172.21.15.153:0/3381770352 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b50015640 con 0x7f1b40004d50 2024-08-17T02:26:40.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.161+0000 7f1b5759e700 1 -- 172.21.15.153:0/3381770352 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b580ca140 con 0x7f1b40004d50 2024-08-17T02:26:40.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.161+0000 7f1b5759e700 1 -- 172.21.15.153:0/3381770352 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b580ca700 con 0x7f1b40004d50 2024-08-17T02:26:40.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.165+0000 7f1b5759e700 1 -- 172.21.15.153:0/3381770352 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b580643a0 con 0x7f1b40004d50 2024-08-17T02:26:40.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.165+0000 7f1b467fc700 1 -- 172.21.15.153:0/3381770352 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1b50015a70 con 0x7f1b40004d50 2024-08-17T02:26:40.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.165+0000 7f1b467fc700 1 --2- 172.21.15.153:0/3381770352 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1b38060890 0x7f1b38062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.165+0000 7f1b55d9b700 1 --2- 172.21.15.153:0/3381770352 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1b38060890 0x7f1b38062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.165+0000 7f1b467fc700 1 -- 172.21.15.153:0/3381770352 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1b5007da20 con 0x7f1b40004d50 2024-08-17T02:26:40.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.165+0000 7f1b55d9b700 1 --2- 172.21.15.153:0/3381770352 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1b38060890 0x7f1b38062d40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1b58150870 tx=0x7f1b4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.169+0000 7f1b467fc700 1 -- 172.21.15.153:0/3381770352 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1b5004de70 con 0x7f1b40004d50 2024-08-17T02:26:40.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.333+0000 7f1b5759e700 1 -- 172.21.15.153:0/3381770352 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b5806f5f0 con 0x7f1b40004d50 2024-08-17T02:26:40.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.337+0000 7f1b467fc700 1 -- 172.21.15.153:0/3381770352 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f1b50022090 con 0x7f1b40004d50 2024-08-17T02:26:40.338 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:40.339 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":21,"fsid":"56d41c33-b929-456d-96be-2aac4ecd299d","created":"2024-08-17T02:25:47.756085+0000","modified":"2024-08-17T02:26:13.759246+0000","last_up_change":"2024-08-17T02:25:58.643690+0000","last_in_change":"2024-08-17T02:25:49.809186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:58.093273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:09.856520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:11.080706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0736f8e6-818e-42e6-a0dc-8aaf813315d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":24234},{"type":"v1","addr":"172.21.15.153:6817","nonce":24234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":24234},{"type":"v1","addr":"172.21.15.153:6819","nonce":24234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":24234},{"type":"v1","addr":"172.21.15.153:6823","nonce":24234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":24234},{"type":"v1","addr":"172.21.15.153:6821","nonce":24234}]},"public_addr":"172.21.15.153:6817/24234","cluster_addr":"172.21.15.153:6819/24234","heartbeat_back_addr":"172.21.15.153:6823/24234","heartbeat_front_addr":"172.21.15.153:6821/24234","state":["exists","up"]},{"osd":1,"uuid":"011762e9-6c2d-441a-aa56-68474639d72f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":24232},{"type":"v1","addr":"172.21.15.153:6801","nonce":24232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":24232},{"type":"v1","addr":"172.21.15.153:6803","nonce":24232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":24232},{"type":"v1","addr":"172.21.15.153:6809","nonce":24232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":24232},{"type":"v1","addr":"172.21.15.153:6806","nonce":24232}]},"public_addr":"172.21.15.153:6801/24232","cluster_addr":"172.21.15.153:6803/24232","heartbeat_back_addr":"172.21.15.153:6809/24232","heartbeat_front_addr":"172.21.15.153:6806/24232","state":["exists","up"]},{"osd":2,"uuid":"b562cd97-aa12-455e-b46a-e720a2ec9d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":24235},{"type":"v1","addr":"172.21.15.153:6808","nonce":24235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":24235},{"type":"v1","addr":"172.21.15.153:6811","nonce":24235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":24235},{"type":"v1","addr":"172.21.15.153:6815","nonce":24235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":24235},{"type":"v1","addr":"172.21.15.153:6813","nonce":24235}]},"public_addr":"172.21.15.153:6808/24235","cluster_addr":"172.21.15.153:6811/24235","heartbeat_back_addr":"172.21.15.153:6815/24235","heartbeat_front_addr":"172.21.15.153:6813/24235","state":["exists","up"]},{"osd":3,"uuid":"222da52f-90c2-4132-a5d2-6f6cf83d4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":24236},{"type":"v1","addr":"172.21.15.153:6825","nonce":24236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":24236},{"type":"v1","addr":"172.21.15.153:6827","nonce":24236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":24236},{"type":"v1","addr":"172.21.15.153:6831","nonce":24236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":24236},{"type":"v1","addr":"172.21.15.153:6829","nonce":24236}]},"public_addr":"172.21.15.153:6825/24236","cluster_addr":"172.21.15.153:6827/24236","heartbeat_back_addr":"172.21.15.153:6831/24236","heartbeat_front_addr":"172.21.15.153:6829/24236","state":["exists","up"]},{"osd":4,"uuid":"a38a04cd-032b-4977-a260-1ef3567d0c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24456},{"type":"v1","addr":"172.21.15.174:6809","nonce":24456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24456},{"type":"v1","addr":"172.21.15.174:6811","nonce":24456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24456},{"type":"v1","addr":"172.21.15.174:6815","nonce":24456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24456},{"type":"v1","addr":"172.21.15.174:6813","nonce":24456}]},"public_addr":"172.21.15.174:6809/24456","cluster_addr":"172.21.15.174:6811/24456","heartbeat_back_addr":"172.21.15.174:6815/24456","heartbeat_front_addr":"172.21.15.174:6813/24456","state":["exists","up"]},{"osd":5,"uuid":"c7778084-e751-48da-87a1-ab8bbe85aa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24457},{"type":"v1","addr":"172.21.15.174:6825","nonce":24457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24457},{"type":"v1","addr":"172.21.15.174:6827","nonce":24457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24457},{"type":"v1","addr":"172.21.15.174:6831","nonce":24457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24457},{"type":"v1","addr":"172.21.15.174:6829","nonce":24457}]},"public_addr":"172.21.15.174:6825/24457","cluster_addr":"172.21.15.174:6827/24457","heartbeat_back_addr":"172.21.15.174:6831/24457","heartbeat_front_addr":"172.21.15.174:6829/24457","state":["exists","up"]},{"osd":6,"uuid":"2d8e0715-254f-442c-9625-50721d0bc858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24477},{"type":"v1","addr":"172.21.15.174:6801","nonce":24477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24477},{"type":"v1","addr":"172.21.15.174:6803","nonce":24477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24477},{"type":"v1","addr":"172.21.15.174:6807","nonce":24477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24477},{"type":"v1","addr":"172.21.15.174:6805","nonce":24477}]},"public_addr":"172.21.15.174:6801/24477","cluster_addr":"172.21.15.174:6803/24477","heartbeat_back_addr":"172.21.15.174:6807/24477","heartbeat_front_addr":"172.21.15.174:6805/24477","state":["exists","up"]},{"osd":7,"uuid":"dffda25a-4601-4ddb-9a27-b0be1cadde27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24455},{"type":"v1","addr":"172.21.15.174:6817","nonce":24455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24455},{"type":"v1","addr":"172.21.15.174:6819","nonce":24455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24455},{"type":"v1","addr":"172.21.15.174:6823","nonce":24455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24455},{"type":"v1","addr":"172.21.15.174:6821","nonce":24455}]},"public_addr":"172.21.15.174:6817/24455","cluster_addr":"172.21.15.174:6819/24455","heartbeat_back_addr":"172.21.15.174:6823/24455","heartbeat_front_addr":"172.21.15.174:6821/24455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.990117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.033862+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.748087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.112877+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.070448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.360961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.110940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.226377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:40.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.337+0000 7f1b5759e700 1 -- 172.21.15.153:0/3381770352 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1b38060890 msgr2=0x7f1b38062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.337+0000 7f1b5759e700 1 --2- 172.21.15.153:0/3381770352 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1b38060890 0x7f1b38062d40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1b58150870 tx=0x7f1b4c008040 comp rx=0 tx=0).stop 2024-08-17T02:26:40.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.337+0000 7f1b5759e700 1 -- 172.21.15.153:0/3381770352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b40004d50 msgr2=0x7f1b5814ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.337+0000 7f1b5759e700 1 --2- 172.21.15.153:0/3381770352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b40004d50 0x7f1b5814ba20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1b5000f530 tx=0x7f1b5000b040 comp rx=0 tx=0).stop 2024-08-17T02:26:40.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.337+0000 7f1b5759e700 1 -- 172.21.15.153:0/3381770352 shutdown_connections 2024-08-17T02:26:40.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.337+0000 7f1b5759e700 1 --2- 172.21.15.153:0/3381770352 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1b38060890 0x7f1b38062d40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.337+0000 7f1b5759e700 1 --2- 172.21.15.153:0/3381770352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b5815ee10 0x7f1b5815f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.337+0000 7f1b5759e700 1 --2- 172.21.15.153:0/3381770352 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b580c98a0 0x7f1b580b0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.337+0000 7f1b5759e700 1 --2- 172.21.15.153:0/3381770352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b40004d50 0x7f1b5814ba20 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.337+0000 7f1b5759e700 1 -- 172.21.15.153:0/3381770352 >> 172.21.15.153:0/3381770352 conn(0x7f1b580678d0 msgr2=0x7f1b58063060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.337+0000 7f1b5759e700 1 -- 172.21.15.153:0/3381770352 shutdown_connections 2024-08-17T02:26:40.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.337+0000 7f1b5759e700 1 -- 172.21.15.153:0/3381770352 wait complete. 2024-08-17T02:26:40.353 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:58.093273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:26:09.856520+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:26:11.080706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:26:40.353 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:40.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.457+0000 7ff7b1639700 1 Processor -- start 2024-08-17T02:26:40.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.457+0000 7ff7b1639700 1 -- start start 2024-08-17T02:26:40.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.457+0000 7ff7b1639700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7ac06e470 0x7ff7ac0aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.457+0000 7ff7b1639700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff7ac06e840 0x7ff7ac0aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.457+0000 7ff7b1639700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7ac140f70 con 0x7ff7ac0b0ef0 2024-08-17T02:26:40.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.457+0000 7ff7b1639700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7ac0b1a80 con 0x7ff7ac06e840 2024-08-17T02:26:40.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.457+0000 7ff7b1639700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ac141250 con 0x7ff7ac06e470 2024-08-17T02:26:40.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.457+0000 7ff7ab7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff7ac06e840 0x7ff7ac0aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.457+0000 7ff7ab7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff7ac06e840 0x7ff7ac0aefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59762/0 (socket says 172.21.15.153:59762) 2024-08-17T02:26:40.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.457+0000 7ff7ab7fe700 1 -- 172.21.15.153:0/2469335823 learned_addr learned my addr 172.21.15.153:0/2469335823 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:40.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.457+0000 7ff7abfff700 1 --2- 172.21.15.153:0/2469335823 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7ac06e470 0x7ff7ac0aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.457+0000 7ff7ab7fe700 1 -- 172.21.15.153:0/2469335823 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7ac06e470 msgr2=0x7ff7ac0aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:40.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.457+0000 7ff7ab7fe700 1 --2- 172.21.15.153:0/2469335823 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7ac06e470 0x7ff7ac0aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.457+0000 7ff7ab7fe700 1 -- 172.21.15.153:0/2469335823 >> v1:172.21.15.174:6789/0 conn(0x7ff7ac0b0ef0 legacy=0x7ff7ac0b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.457+0000 7ff7ab7fe700 1 -- 172.21.15.153:0/2469335823 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7ac141530 con 0x7ff7ac06e840 2024-08-17T02:26:40.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.457+0000 7ff7abfff700 1 --2- 172.21.15.153:0/2469335823 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7ac06e470 0x7ff7ac0aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:40.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.457+0000 7ff7ab7fe700 1 --2- 172.21.15.153:0/2469335823 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7ac06e840 0x7ff7ac0aefc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff794009f20 tx=0x7ff794009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66d0c2a68bf52956 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.457+0000 7ff7aaffd700 1 -- 172.21.15.153:0/2469335823 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79400e070 con 0x7ff7ac06e840 2024-08-17T02:26:40.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.457+0000 7ff7aaffd700 1 -- 172.21.15.153:0/2469335823 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79400ba80 con 0x7ff7ac06e840 2024-08-17T02:26:40.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.457+0000 7ff7aaffd700 1 -- 172.21.15.153:0/2469335823 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7940092e0 con 0x7ff7ac06e840 2024-08-17T02:26:40.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.461+0000 7ff7b1639700 1 -- 172.21.15.153:0/2469335823 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7ac06e840 msgr2=0x7ff7ac0aefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.461+0000 7ff7b1639700 1 --2- 172.21.15.153:0/2469335823 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7ac06e840 0x7ff7ac0aefc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff794009f20 tx=0x7ff794009840 comp rx=0 tx=0).stop 2024-08-17T02:26:40.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.461+0000 7ff7b1639700 1 -- 172.21.15.153:0/2469335823 shutdown_connections 2024-08-17T02:26:40.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.461+0000 7ff7b1639700 1 --2- 172.21.15.153:0/2469335823 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7ac06e840 0x7ff7ac0aefc0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.461+0000 7ff7b1639700 1 --2- 172.21.15.153:0/2469335823 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7ac06e470 0x7ff7ac0aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.461+0000 7ff7b1639700 1 -- 172.21.15.153:0/2469335823 >> 172.21.15.153:0/2469335823 conn(0x7ff7ac0678a0 msgr2=0x7ff7ac067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.461+0000 7ff7b1639700 1 -- 172.21.15.153:0/2469335823 shutdown_connections 2024-08-17T02:26:40.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.461+0000 7ff7b1639700 1 -- 172.21.15.153:0/2469335823 wait complete. 2024-08-17T02:26:40.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.461+0000 7ff7b1639700 1 Processor -- start 2024-08-17T02:26:40.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.461+0000 7ff7b1639700 1 -- start start 2024-08-17T02:26:40.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.461+0000 7ff7b1639700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7ac06e470 0x7ff7ac15c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.461+0000 7ff7b1639700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff7ac06e840 0x7ff7ac0c0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.461+0000 7ff7b1639700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7ac0b0ef0 0x7ff7ac15bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.461+0000 7ff7b1639700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ac0c84e0 con 0x7ff7ac06e470 2024-08-17T02:26:40.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.461+0000 7ff7b1639700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ac0c9060 con 0x7ff7ac06e840 2024-08-17T02:26:40.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.461+0000 7ff7b1639700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ac0c0fa0 con 0x7ff7ac0b0ef0 2024-08-17T02:26:40.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.461+0000 7ff7abfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7ac06e470 0x7ff7ac15c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.465+0000 7ff7abfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7ac06e470 0x7ff7ac15c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59766/0 (socket says 172.21.15.153:59766) 2024-08-17T02:26:40.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.465+0000 7ff7abfff700 1 -- 172.21.15.153:0/1839137827 learned_addr learned my addr 172.21.15.153:0/1839137827 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:40.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.465+0000 7ff7ab7fe700 1 --2- 172.21.15.153:0/1839137827 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff7ac06e840 0x7ff7ac0c0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.465+0000 7ff7b0e38700 1 --2- 172.21.15.153:0/1839137827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7ac0b0ef0 0x7ff7ac15bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.465+0000 7ff7abfff700 1 -- 172.21.15.153:0/1839137827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7ac0b0ef0 msgr2=0x7ff7ac15bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.465+0000 7ff7abfff700 1 --2- 172.21.15.153:0/1839137827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7ac0b0ef0 0x7ff7ac15bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.465+0000 7ff7abfff700 1 -- 172.21.15.153:0/1839137827 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff7ac06e840 msgr2=0x7ff7ac0c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.465+0000 7ff7abfff700 1 --2- 172.21.15.153:0/1839137827 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff7ac06e840 0x7ff7ac0c0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.465+0000 7ff7abfff700 1 -- 172.21.15.153:0/1839137827 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff794009ae0 con 0x7ff7ac06e470 2024-08-17T02:26:40.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.465+0000 7ff7ab7fe700 1 --2- 172.21.15.153:0/1839137827 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff7ac06e840 0x7ff7ac0c0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:40.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.465+0000 7ff7abfff700 1 --2- 172.21.15.153:0/1839137827 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7ac06e470 0x7ff7ac15c2d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff79c00d890 tx=0x7ff79c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.465+0000 7ff7a3fff700 1 -- 172.21.15.153:0/1839137827 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79c00b600 con 0x7ff7ac06e470 2024-08-17T02:26:40.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.465+0000 7ff7a3fff700 1 -- 172.21.15.153:0/1839137827 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79c00b760 con 0x7ff7ac06e470 2024-08-17T02:26:40.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.465+0000 7ff7b1639700 1 -- 172.21.15.153:0/1839137827 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7ac0c8730 con 0x7ff7ac06e470 2024-08-17T02:26:40.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.465+0000 7ff7a3fff700 1 -- 172.21.15.153:0/1839137827 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79c00bb00 con 0x7ff7ac06e470 2024-08-17T02:26:40.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.465+0000 7ff7b1639700 1 -- 172.21.15.153:0/1839137827 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7ac0c8cf0 con 0x7ff7ac06e470 2024-08-17T02:26:40.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.465+0000 7ff7a3fff700 1 -- 172.21.15.153:0/1839137827 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff79c014430 con 0x7ff7ac06e470 2024-08-17T02:26:40.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.465+0000 7ff7b1639700 1 -- 172.21.15.153:0/1839137827 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7ac064330 con 0x7ff7ac06e470 2024-08-17T02:26:40.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.465+0000 7ff7a3fff700 1 --2- 172.21.15.153:0/1839137827 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff78c060860 0x7ff78c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.465+0000 7ff7a3fff700 1 -- 172.21.15.153:0/1839137827 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff79c07d020 con 0x7ff7ac06e470 2024-08-17T02:26:40.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.465+0000 7ff7ab7fe700 1 --2- 172.21.15.153:0/1839137827 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff78c060860 0x7ff78c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.469+0000 7ff7ab7fe700 1 --2- 172.21.15.153:0/1839137827 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff78c060860 0x7ff78c062d10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff794009880 tx=0x7ff794018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.469+0000 7ff7a3fff700 1 -- 172.21.15.153:0/1839137827 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff79c04d470 con 0x7ff7ac06e470 2024-08-17T02:26:40.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.629+0000 7ff7b1639700 1 -- 172.21.15.153:0/1839137827 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff7ac15e980 con 0x7ff7ac06e470 2024-08-17T02:26:40.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.633+0000 7ff7a3fff700 1 -- 172.21.15.153:0/1839137827 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff79c050a90 con 0x7ff7ac06e470 2024-08-17T02:26:40.635 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2024-08-17T02:26:40.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.633+0000 7ff7b1639700 1 -- 172.21.15.153:0/1839137827 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff78c060860 msgr2=0x7ff78c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.633+0000 7ff7b1639700 1 --2- 172.21.15.153:0/1839137827 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff78c060860 0x7ff78c062d10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff794009880 tx=0x7ff794018000 comp rx=0 tx=0).stop 2024-08-17T02:26:40.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.633+0000 7ff7b1639700 1 -- 172.21.15.153:0/1839137827 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7ac06e470 msgr2=0x7ff7ac15c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.633+0000 7ff7b1639700 1 --2- 172.21.15.153:0/1839137827 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7ac06e470 0x7ff7ac15c2d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff79c00d890 tx=0x7ff79c008040 comp rx=0 tx=0).stop 2024-08-17T02:26:40.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.633+0000 7ff7b1639700 1 -- 172.21.15.153:0/1839137827 shutdown_connections 2024-08-17T02:26:40.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.633+0000 7ff7b1639700 1 --2- 172.21.15.153:0/1839137827 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff78c060860 0x7ff78c062d10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.633+0000 7ff7b1639700 1 --2- 172.21.15.153:0/1839137827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7ac0b0ef0 0x7ff7ac15bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.633+0000 7ff7b1639700 1 --2- 172.21.15.153:0/1839137827 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff7ac06e840 0x7ff7ac0c0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.633+0000 7ff7b1639700 1 --2- 172.21.15.153:0/1839137827 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7ac06e470 0x7ff7ac15c2d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.633+0000 7ff7b1639700 1 -- 172.21.15.153:0/1839137827 >> 172.21.15.153:0/1839137827 conn(0x7ff7ac0678a0 msgr2=0x7ff7ac142120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.633+0000 7ff7b1639700 1 -- 172.21.15.153:0/1839137827 shutdown_connections 2024-08-17T02:26:40.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.633+0000 7ff7b1639700 1 -- 172.21.15.153:0/1839137827 wait complete. 2024-08-17T02:26:40.649 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:26:40.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.761+0000 7f18ee1bb700 1 Processor -- start 2024-08-17T02:26:40.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.761+0000 7f18ee1bb700 1 -- start start 2024-08-17T02:26:40.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.761+0000 7f18ee1bb700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f18e81554c0 0x7f18e80699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.761+0000 7f18ee1bb700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e806b000 con 0x7f18e8068db0 2024-08-17T02:26:40.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.761+0000 7f18ee1bb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e806a3f0 con 0x7f18e8069ee0 2024-08-17T02:26:40.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.761+0000 7f18ee1bb700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e806a6d0 con 0x7f18e81554c0 2024-08-17T02:26:40.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.761+0000 7f18e77fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f18e81554c0 0x7f18e80699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.761+0000 7f18e7fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f18e8068db0 0x7f18e806b490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:60128/0 (socket says 172.21.15.153:60128) 2024-08-17T02:26:40.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.761+0000 7f18e77fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f18e81554c0 0x7f18e80699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59778/0 (socket says 172.21.15.153:59778) 2024-08-17T02:26:40.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.761+0000 7f18e7fff700 1 -- 172.21.15.153:0/1731582077 learned_addr learned my addr 172.21.15.153:0/1731582077 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:40.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.761+0000 7f18e67fc700 1 -- 172.21.15.153:0/1731582077 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2147652555 0 0) 0x7f18e806b000 con 0x7f18e8068db0 2024-08-17T02:26:40.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.761+0000 7f18e67fc700 1 -- 172.21.15.153:0/1731582077 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18d0003570 con 0x7f18e8068db0 2024-08-17T02:26:40.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.761+0000 7f18e77fe700 1 -- 172.21.15.153:0/1731582077 >> v1:172.21.15.174:6789/0 conn(0x7f18e8069ee0 legacy=0x7f18e80686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.761+0000 7f18e77fe700 1 -- 172.21.15.153:0/1731582077 >> v1:172.21.15.153:6789/0 conn(0x7f18e8068db0 legacy=0x7f18e806b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.761+0000 7f18e77fe700 1 -- 172.21.15.153:0/1731582077 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e806a9b0 con 0x7f18e81554c0 2024-08-17T02:26:40.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.765+0000 7f18e77fe700 1 --2- 172.21.15.153:0/1731582077 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18e81554c0 0x7f18e80699a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f18d800aa90 tx=0x7f18d800a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c5d4ddff1d38817 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.765+0000 7f18e67fc700 1 -- 172.21.15.153:0/1731582077 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d800c970 con 0x7f18e81554c0 2024-08-17T02:26:40.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.765+0000 7f18e67fc700 1 -- 172.21.15.153:0/1731582077 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d800cad0 con 0x7f18e81554c0 2024-08-17T02:26:40.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.765+0000 7f18e67fc700 1 -- 172.21.15.153:0/1731582077 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d800ce70 con 0x7f18e81554c0 2024-08-17T02:26:40.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.765+0000 7f18ee1bb700 1 -- 172.21.15.153:0/1731582077 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18e81554c0 msgr2=0x7f18e80699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.765+0000 7f18ee1bb700 1 --2- 172.21.15.153:0/1731582077 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18e81554c0 0x7f18e80699a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f18d800aa90 tx=0x7f18d800a330 comp rx=0 tx=0).stop 2024-08-17T02:26:40.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.765+0000 7f18ee1bb700 1 -- 172.21.15.153:0/1731582077 shutdown_connections 2024-08-17T02:26:40.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.765+0000 7f18ee1bb700 1 --2- 172.21.15.153:0/1731582077 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18e81554c0 0x7f18e80699a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.765+0000 7f18ee1bb700 1 -- 172.21.15.153:0/1731582077 >> 172.21.15.153:0/1731582077 conn(0x7f18e80c9bf0 msgr2=0x7f18e806d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.765+0000 7f18ee1bb700 1 -- 172.21.15.153:0/1731582077 shutdown_connections 2024-08-17T02:26:40.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.765+0000 7f18ee1bb700 1 -- 172.21.15.153:0/1731582077 wait complete. 2024-08-17T02:26:40.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.765+0000 7f18ee1bb700 1 Processor -- start 2024-08-17T02:26:40.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.765+0000 7f18ee1bb700 1 -- start start 2024-08-17T02:26:40.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.769+0000 7f18ee1bb700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18e8068db0 0x7f18e80a5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.769+0000 7f18ee1bb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18e8069ee0 0x7f18e81562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.769+0000 7f18ee1bb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18e81554c0 0x7f18e80ab9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.769+0000 7f18ee1bb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e8157b90 con 0x7f18e8069ee0 2024-08-17T02:26:40.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.769+0000 7f18ee1bb700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e81567e0 con 0x7f18e8068db0 2024-08-17T02:26:40.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.769+0000 7f18ee1bb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e8156f80 con 0x7f18e81554c0 2024-08-17T02:26:40.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.769+0000 7f18e6ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18e8069ee0 0x7f18e81562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.769+0000 7f18e6ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18e8069ee0 0x7f18e81562a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59786/0 (socket says 172.21.15.153:59786) 2024-08-17T02:26:40.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.769+0000 7f18e6ffd700 1 -- 172.21.15.153:0/2551304449 learned_addr learned my addr 172.21.15.153:0/2551304449 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:40.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.769+0000 7f18e77fe700 1 --2- 172.21.15.153:0/2551304449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18e8068db0 0x7f18e80a5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.769+0000 7f18e7fff700 1 --2- 172.21.15.153:0/2551304449 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18e81554c0 0x7f18e80ab9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.769+0000 7f18e6ffd700 1 -- 172.21.15.153:0/2551304449 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18e81554c0 msgr2=0x7f18e80ab9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.769+0000 7f18e6ffd700 1 --2- 172.21.15.153:0/2551304449 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18e81554c0 0x7f18e80ab9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.769+0000 7f18e6ffd700 1 -- 172.21.15.153:0/2551304449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18e8068db0 msgr2=0x7f18e80a5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.769+0000 7f18e6ffd700 1 --2- 172.21.15.153:0/2551304449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18e8068db0 0x7f18e80a5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.769+0000 7f18e6ffd700 1 -- 172.21.15.153:0/2551304449 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d800a5d0 con 0x7f18e8069ee0 2024-08-17T02:26:40.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.769+0000 7f18e6ffd700 1 --2- 172.21.15.153:0/2551304449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18e8069ee0 0x7f18e81562a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f18dc00c590 tx=0x7f18dc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.769+0000 7f18cf7fe700 1 -- 172.21.15.153:0/2551304449 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18dc011590 con 0x7f18e8069ee0 2024-08-17T02:26:40.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.769+0000 7f18cf7fe700 1 -- 172.21.15.153:0/2551304449 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18dc011710 con 0x7f18e8069ee0 2024-08-17T02:26:40.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.769+0000 7f18ee1bb700 1 -- 172.21.15.153:0/2551304449 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e8157260 con 0x7f18e8069ee0 2024-08-17T02:26:40.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.769+0000 7f18cf7fe700 1 -- 172.21.15.153:0/2551304449 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18dc011ad0 con 0x7f18e8069ee0 2024-08-17T02:26:40.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.769+0000 7f18ee1bb700 1 -- 172.21.15.153:0/2551304449 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e8157820 con 0x7f18e8069ee0 2024-08-17T02:26:40.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.773+0000 7f18ee1bb700 1 -- 172.21.15.153:0/2551304449 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e8157d40 con 0x7f18e8069ee0 2024-08-17T02:26:40.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.773+0000 7f18cf7fe700 1 -- 172.21.15.153:0/2551304449 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f18dc01b3b0 con 0x7f18e8069ee0 2024-08-17T02:26:40.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.773+0000 7f18cf7fe700 1 --2- 172.21.15.153:0/2551304449 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f18d4060890 0x7f18d4062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.773+0000 7f18cf7fe700 1 -- 172.21.15.153:0/2551304449 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f18dc07c030 con 0x7f18e8069ee0 2024-08-17T02:26:40.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.773+0000 7f18e77fe700 1 --2- 172.21.15.153:0/2551304449 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f18d4060890 0x7f18d4062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.773+0000 7f18e77fe700 1 --2- 172.21.15.153:0/2551304449 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f18d4060890 0x7f18d4062d40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f18d800a5a0 tx=0x7f18d801a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.777+0000 7f18cf7fe700 1 -- 172.21.15.153:0/2551304449 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f18e8157d40 con 0x7f18e8069ee0 2024-08-17T02:26:40.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.941+0000 7f18ee1bb700 1 -- 172.21.15.153:0/2551304449 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f18e8157d40 con 0x7f18e8069ee0 2024-08-17T02:26:40.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.941+0000 7f18cf7fe700 1 -- 172.21.15.153:0/2551304449 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f18dc017020 con 0x7f18e8069ee0 2024-08-17T02:26:40.946 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2024-08-17T02:26:40.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.945+0000 7f18ee1bb700 1 -- 172.21.15.153:0/2551304449 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f18d4060890 msgr2=0x7f18d4062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.945+0000 7f18ee1bb700 1 --2- 172.21.15.153:0/2551304449 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f18d4060890 0x7f18d4062d40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f18d800a5a0 tx=0x7f18d801a000 comp rx=0 tx=0).stop 2024-08-17T02:26:40.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.945+0000 7f18ee1bb700 1 -- 172.21.15.153:0/2551304449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18e8069ee0 msgr2=0x7f18e81562a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.945+0000 7f18ee1bb700 1 --2- 172.21.15.153:0/2551304449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18e8069ee0 0x7f18e81562a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f18dc00c590 tx=0x7f18dc00c8a0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.945+0000 7f18ee1bb700 1 -- 172.21.15.153:0/2551304449 shutdown_connections 2024-08-17T02:26:40.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.945+0000 7f18ee1bb700 1 --2- 172.21.15.153:0/2551304449 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f18d4060890 0x7f18d4062d40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.945+0000 7f18ee1bb700 1 --2- 172.21.15.153:0/2551304449 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18e81554c0 0x7f18e80ab9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.945+0000 7f18ee1bb700 1 --2- 172.21.15.153:0/2551304449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18e8069ee0 0x7f18e81562a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.945+0000 7f18ee1bb700 1 --2- 172.21.15.153:0/2551304449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18e8068db0 0x7f18e80a5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.945+0000 7f18ee1bb700 1 -- 172.21.15.153:0/2551304449 >> 172.21.15.153:0/2551304449 conn(0x7f18e80c9bf0 msgr2=0x7f18e815d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.945+0000 7f18ee1bb700 1 -- 172.21.15.153:0/2551304449 shutdown_connections 2024-08-17T02:26:40.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:40.945+0000 7f18ee1bb700 1 -- 172.21.15.153:0/2551304449 wait complete. 2024-08-17T02:26:40.961 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:26:41.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.069+0000 7ffabd7b9700 1 Processor -- start 2024-08-17T02:26:41.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.069+0000 7ffabd7b9700 1 -- start start 2024-08-17T02:26:41.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.069+0000 7ffabd7b9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffab813f680 0x7ffab80aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.069+0000 7ffabd7b9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffab813fa50 0x7ffab80ad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.069+0000 7ffabd7b9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab80afc70 con 0x7ffab80b0100 2024-08-17T02:26:41.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.069+0000 7ffabd7b9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab80adc00 con 0x7ffab813fa50 2024-08-17T02:26:41.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.069+0000 7ffabd7b9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab80af060 con 0x7ffab813f680 2024-08-17T02:26:41.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.069+0000 7ffab77fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffab813fa50 0x7ffab80ad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.069+0000 7ffab77fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffab813fa50 0x7ffab80ad6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59800/0 (socket says 172.21.15.153:59800) 2024-08-17T02:26:41.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.069+0000 7ffab77fe700 1 -- 172.21.15.153:0/926099000 learned_addr learned my addr 172.21.15.153:0/926099000 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:41.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.069+0000 7ffabcfb8700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ffab80b0100 0x7ffab806e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:60140/0 (socket says 172.21.15.153:60140) 2024-08-17T02:26:41.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.069+0000 7ffab7fff700 1 --2- 172.21.15.153:0/926099000 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffab813f680 0x7ffab80aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.069+0000 7ffab77fe700 1 -- 172.21.15.153:0/926099000 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffab813f680 msgr2=0x7ffab80aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:41.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.069+0000 7ffab77fe700 1 --2- 172.21.15.153:0/926099000 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffab813f680 0x7ffab80aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.069+0000 7ffab77fe700 1 -- 172.21.15.153:0/926099000 >> v1:172.21.15.153:6789/0 conn(0x7ffab80b0100 legacy=0x7ffab806e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.069+0000 7ffab77fe700 1 -- 172.21.15.153:0/926099000 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab80af340 con 0x7ffab813fa50 2024-08-17T02:26:41.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.069+0000 7ffab77fe700 1 --2- 172.21.15.153:0/926099000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffab813fa50 0x7ffab80ad6c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0009f20 tx=0x7ffaa0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4c96722b2023449 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.069+0000 7ffab6ffd700 1 -- 172.21.15.153:0/926099000 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa00092e0 con 0x7ffab813fa50 2024-08-17T02:26:41.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.069+0000 7ffab6ffd700 1 -- 172.21.15.153:0/926099000 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa000b9d0 con 0x7ffab813fa50 2024-08-17T02:26:41.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.069+0000 7ffab6ffd700 1 -- 172.21.15.153:0/926099000 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa000bd90 con 0x7ffab813fa50 2024-08-17T02:26:41.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.073+0000 7ffabd7b9700 1 -- 172.21.15.153:0/926099000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffab813fa50 msgr2=0x7ffab80ad6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.073+0000 7ffabd7b9700 1 --2- 172.21.15.153:0/926099000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffab813fa50 0x7ffab80ad6c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0009f20 tx=0x7ffaa0009840 comp rx=0 tx=0).stop 2024-08-17T02:26:41.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.073+0000 7ffabd7b9700 1 -- 172.21.15.153:0/926099000 shutdown_connections 2024-08-17T02:26:41.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.073+0000 7ffabd7b9700 1 --2- 172.21.15.153:0/926099000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffab813fa50 0x7ffab80ad6c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.073+0000 7ffabd7b9700 1 --2- 172.21.15.153:0/926099000 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffab813f680 0x7ffab80aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.073+0000 7ffabd7b9700 1 -- 172.21.15.153:0/926099000 >> 172.21.15.153:0/926099000 conn(0x7ffab80678a0 msgr2=0x7ffab8067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:41.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.073+0000 7ffabd7b9700 1 -- 172.21.15.153:0/926099000 shutdown_connections 2024-08-17T02:26:41.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.073+0000 7ffabd7b9700 1 -- 172.21.15.153:0/926099000 wait complete. 2024-08-17T02:26:41.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.073+0000 7ffabd7b9700 1 Processor -- start 2024-08-17T02:26:41.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.073+0000 7ffabd7b9700 1 -- start start 2024-08-17T02:26:41.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.073+0000 7ffabd7b9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffab80b0100 0x7ffab812fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.073+0000 7ffabd7b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffab813f680 0x7ffab81304d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.073+0000 7ffabd7b9700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffab813fa50 0x7ffab8130a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.073+0000 7ffabd7b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab8137700 con 0x7ffab813f680 2024-08-17T02:26:41.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.073+0000 7ffabd7b9700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab8130290 con 0x7ffab813fa50 2024-08-17T02:26:41.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.073+0000 7ffabd7b9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab8132b00 con 0x7ffab80b0100 2024-08-17T02:26:41.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.077+0000 7ffab77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffab813f680 0x7ffab81304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.077+0000 7ffab7fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffab80b0100 0x7ffab812fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.077+0000 7ffab7fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffab80b0100 0x7ffab812fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.153:51544/0 (socket says 172.21.15.153:51544) 2024-08-17T02:26:41.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.077+0000 7ffabcfb8700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffab813fa50 0x7ffab8130a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.077+0000 7ffab7fff700 1 -- 172.21.15.153:0/1505436659 learned_addr learned my addr 172.21.15.153:0/1505436659 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:41.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.077+0000 7ffab7fff700 1 -- 172.21.15.153:0/1505436659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffab813fa50 msgr2=0x7ffab8130a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.077+0000 7ffab7fff700 1 --2- 172.21.15.153:0/1505436659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffab813fa50 0x7ffab8130a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.077+0000 7ffab7fff700 1 -- 172.21.15.153:0/1505436659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffab813f680 msgr2=0x7ffab81304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.077+0000 7ffab7fff700 1 --2- 172.21.15.153:0/1505436659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffab813f680 0x7ffab81304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.077+0000 7ffab7fff700 1 -- 172.21.15.153:0/1505436659 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa0009ae0 con 0x7ffab80b0100 2024-08-17T02:26:41.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.077+0000 7ffab7fff700 1 --2- 172.21.15.153:0/1505436659 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffab80b0100 0x7ffab812fd50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800ec80 tx=0x7ffaa80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.077+0000 7ffaaffff700 1 -- 172.21.15.153:0/1505436659 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa800c850 con 0x7ffab80b0100 2024-08-17T02:26:41.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.077+0000 7ffaaffff700 1 -- 172.21.15.153:0/1505436659 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa800c9b0 con 0x7ffab80b0100 2024-08-17T02:26:41.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.077+0000 7ffabd7b9700 1 -- 172.21.15.153:0/1505436659 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab8136dd0 con 0x7ffab80b0100 2024-08-17T02:26:41.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.077+0000 7ffaaffff700 1 -- 172.21.15.153:0/1505436659 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa800cd50 con 0x7ffab80b0100 2024-08-17T02:26:41.082 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.077+0000 7ffabd7b9700 1 -- 172.21.15.153:0/1505436659 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab8137390 con 0x7ffab80b0100 2024-08-17T02:26:41.082 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.077+0000 7ffabd7b9700 1 -- 172.21.15.153:0/1505436659 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab8064330 con 0x7ffab80b0100 2024-08-17T02:26:41.082 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.081+0000 7ffaaffff700 1 -- 172.21.15.153:0/1505436659 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ffaa8013680 con 0x7ffab80b0100 2024-08-17T02:26:41.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.081+0000 7ffaaffff700 1 --2- 172.21.15.153:0/1505436659 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ffa9c060860 0x7ffa9c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.081+0000 7ffaaffff700 1 -- 172.21.15.153:0/1505436659 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffaa807d5d0 con 0x7ffab80b0100 2024-08-17T02:26:41.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.081+0000 7ffab77fe700 1 --2- 172.21.15.153:0/1505436659 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ffa9c060860 0x7ffa9c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.081+0000 7ffab77fe700 1 --2- 172.21.15.153:0/1505436659 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ffa9c060860 0x7ffa9c062d10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ffab813fe20 tx=0x7ffaa001a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.089+0000 7ffaaffff700 1 -- 172.21.15.153:0/1505436659 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ffaa804da20 con 0x7ffab80b0100 2024-08-17T02:26:41.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.253+0000 7ffabd7b9700 1 -- 172.21.15.153:0/1505436659 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffab815a230 con 0x7ffab80b0100 2024-08-17T02:26:41.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.253+0000 7ffaaffff700 1 -- 172.21.15.153:0/1505436659 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffaa8051040 con 0x7ffab80b0100 2024-08-17T02:26:41.257 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2024-08-17T02:26:41.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.257+0000 7ffabd7b9700 1 -- 172.21.15.153:0/1505436659 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ffa9c060860 msgr2=0x7ffa9c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.257+0000 7ffabd7b9700 1 --2- 172.21.15.153:0/1505436659 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ffa9c060860 0x7ffa9c062d10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ffab813fe20 tx=0x7ffaa001a000 comp rx=0 tx=0).stop 2024-08-17T02:26:41.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.257+0000 7ffabd7b9700 1 -- 172.21.15.153:0/1505436659 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffab80b0100 msgr2=0x7ffab812fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.257+0000 7ffabd7b9700 1 --2- 172.21.15.153:0/1505436659 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffab80b0100 0x7ffab812fd50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800ec80 tx=0x7ffaa80091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.257+0000 7ffabd7b9700 1 -- 172.21.15.153:0/1505436659 shutdown_connections 2024-08-17T02:26:41.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.257+0000 7ffabd7b9700 1 --2- 172.21.15.153:0/1505436659 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ffa9c060860 0x7ffa9c062d10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.257+0000 7ffabd7b9700 1 --2- 172.21.15.153:0/1505436659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffab813fa50 0x7ffab8130a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.257+0000 7ffabd7b9700 1 --2- 172.21.15.153:0/1505436659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffab813f680 0x7ffab81304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.257+0000 7ffabd7b9700 1 --2- 172.21.15.153:0/1505436659 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffab80b0100 0x7ffab812fd50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.257+0000 7ffabd7b9700 1 -- 172.21.15.153:0/1505436659 >> 172.21.15.153:0/1505436659 conn(0x7ffab80678a0 msgr2=0x7ffab806d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:41.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.257+0000 7ffabd7b9700 1 -- 172.21.15.153:0/1505436659 shutdown_connections 2024-08-17T02:26:41.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.257+0000 7ffabd7b9700 1 -- 172.21.15.153:0/1505436659 wait complete. 2024-08-17T02:26:41.277 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:26:41.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.381+0000 7f77393c2700 1 Processor -- start 2024-08-17T02:26:41.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.381+0000 7f77393c2700 1 -- start start 2024-08-17T02:26:41.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.381+0000 7f77393c2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f773406e620 0x7f77340b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.381+0000 7f77393c2700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7734141a00 con 0x7f77340b1630 2024-08-17T02:26:41.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.381+0000 7f77393c2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7734140b10 con 0x7f77340b0d20 2024-08-17T02:26:41.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.381+0000 7f77393c2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7734140df0 con 0x7f773406e620 2024-08-17T02:26:41.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.381+0000 7f7738bc1700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f77340b1630 0x7f7734141e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:60156/0 (socket says 172.21.15.153:60156) 2024-08-17T02:26:41.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.381+0000 7f7738bc1700 1 -- 172.21.15.153:0/4126008590 learned_addr learned my addr 172.21.15.153:0/4126008590 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:41.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.381+0000 7f77337fe700 1 --2- 172.21.15.153:0/4126008590 >> v2:172.21.15.174:3300/0 conn(0x7f773406e620 0x7f77340b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.381+0000 7f7732ffd700 1 -- 172.21.15.153:0/4126008590 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2552646307 0 0) 0x7f7734141a00 con 0x7f77340b1630 2024-08-17T02:26:41.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.381+0000 7f7732ffd700 1 -- 172.21.15.153:0/4126008590 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7720003570 con 0x7f77340b1630 2024-08-17T02:26:41.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.381+0000 7f7732ffd700 1 -- 172.21.15.153:0/4126008590 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2449381791 0 0) 0x7f7720003570 con 0x7f77340b1630 2024-08-17T02:26:41.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.381+0000 7f7732ffd700 1 -- 172.21.15.153:0/4126008590 >> v2:172.21.15.174:3300/0 conn(0x7f773406e620 msgr2=0x7f77340b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:41.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.381+0000 7f7732ffd700 1 --2- 172.21.15.153:0/4126008590 >> v2:172.21.15.174:3300/0 conn(0x7f773406e620 0x7f77340b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.381+0000 7f7732ffd700 1 -- 172.21.15.153:0/4126008590 >> v1:172.21.15.174:6789/0 conn(0x7f77340b0d20 legacy=0x7f773406df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.381+0000 7f7732ffd700 1 -- 172.21.15.153:0/4126008590 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77341410d0 con 0x7f77340b1630 2024-08-17T02:26:41.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.381+0000 7f7732ffd700 1 -- 172.21.15.153:0/4126008590 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3701463666 0 0) 0x7f772c0017f0 con 0x7f77340b1630 2024-08-17T02:26:41.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.381+0000 7f7732ffd700 1 -- 172.21.15.153:0/4126008590 >> v1:172.21.15.153:6789/0 conn(0x7f77340b1630 legacy=0x7f7734141e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.381+0000 7f7732ffd700 1 --2- 172.21.15.153:0/4126008590 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7720003a60 0x7f7720003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.381+0000 7f7732ffd700 1 --2- 172.21.15.153:0/4126008590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7720004810 0x7f7720004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.381+0000 7f7732ffd700 1 --2- 172.21.15.153:0/4126008590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77200051c0 0x7f772000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.381+0000 7f7732ffd700 1 -- 172.21.15.153:0/4126008590 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7734140df0 con 0x7f7720004810 2024-08-17T02:26:41.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.381+0000 7f7732ffd700 1 -- 172.21.15.153:0/4126008590 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772000c0d0 con 0x7f77200051c0 2024-08-17T02:26:41.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.381+0000 7f7732ffd700 1 -- 172.21.15.153:0/4126008590 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f772000c290 con 0x7f7720003a60 2024-08-17T02:26:41.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.381+0000 7f77337fe700 1 --2- 172.21.15.153:0/4126008590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7720004810 0x7f7720004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.381+0000 7f7738bc1700 1 --2- 172.21.15.153:0/4126008590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77200051c0 0x7f772000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.381+0000 7f7733fff700 1 --2- 172.21.15.153:0/4126008590 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7720003a60 0x7f7720003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.381+0000 7f77337fe700 1 -- 172.21.15.153:0/4126008590 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7720003a60 msgr2=0x7f7720003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:41.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.381+0000 7f77337fe700 1 --2- 172.21.15.153:0/4126008590 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7720003a60 0x7f7720003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.381+0000 7f77337fe700 1 -- 172.21.15.153:0/4126008590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77200051c0 msgr2=0x7f772000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:41.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.381+0000 7f77337fe700 1 --2- 172.21.15.153:0/4126008590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77200051c0 0x7f772000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.381+0000 7f77337fe700 1 -- 172.21.15.153:0/4126008590 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7720003570 con 0x7f7720004810 2024-08-17T02:26:41.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.381+0000 7f7738bc1700 1 --2- 172.21.15.153:0/4126008590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77200051c0 0x7f772000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:41.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.381+0000 7f7738bc1700 1 -- 172.21.15.153:0/4126008590 reap_dead start 2024-08-17T02:26:41.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.381+0000 7f77337fe700 1 --2- 172.21.15.153:0/4126008590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7720004810 0x7f7720004c80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7724009c00 tx=0x7f77240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a71fff9bafbabd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.381+0000 7f7732ffd700 1 -- 172.21.15.153:0/4126008590 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772400e710 con 0x7f7720004810 2024-08-17T02:26:41.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.381+0000 7f7732ffd700 1 -- 172.21.15.153:0/4126008590 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772400e870 con 0x7f7720004810 2024-08-17T02:26:41.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.381+0000 7f7732ffd700 1 -- 172.21.15.153:0/4126008590 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772400ec30 con 0x7f7720004810 2024-08-17T02:26:41.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.385+0000 7f77393c2700 1 -- 172.21.15.153:0/4126008590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7720004810 msgr2=0x7f7720004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.385+0000 7f77393c2700 1 --2- 172.21.15.153:0/4126008590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7720004810 0x7f7720004c80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7724009c00 tx=0x7f77240091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.385+0000 7f77393c2700 1 -- 172.21.15.153:0/4126008590 shutdown_connections 2024-08-17T02:26:41.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.385+0000 7f77393c2700 1 --2- 172.21.15.153:0/4126008590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7720004810 0x7f7720004c80 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.385+0000 7f77393c2700 1 -- 172.21.15.153:0/4126008590 >> 172.21.15.153:0/4126008590 conn(0x7f77340678d0 msgr2=0x7f7734067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:41.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.385+0000 7f77393c2700 1 -- 172.21.15.153:0/4126008590 shutdown_connections 2024-08-17T02:26:41.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.385+0000 7f77393c2700 1 -- 172.21.15.153:0/4126008590 wait complete. 2024-08-17T02:26:41.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.385+0000 7f77393c2700 1 Processor -- start 2024-08-17T02:26:41.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.385+0000 7f77393c2700 1 -- start start 2024-08-17T02:26:41.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.385+0000 7f77393c2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7720004810 0x7f7734171080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.385+0000 7f77393c2700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7734146c80 0x7f773413fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.385+0000 7f77393c2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7734143ca0 0x7f77340a6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.385+0000 7f77393c2700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77340a5860 con 0x7f7720004810 2024-08-17T02:26:41.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.385+0000 7f77393c2700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7734171940 con 0x7f7734146c80 2024-08-17T02:26:41.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.385+0000 7f77393c2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7734171c20 con 0x7f7734143ca0 2024-08-17T02:26:41.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.389+0000 7f7733fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7720004810 0x7f7734171080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.389+0000 7f7733fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7720004810 0x7f7734171080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59838/0 (socket says 172.21.15.153:59838) 2024-08-17T02:26:41.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.389+0000 7f7733fff700 1 -- 172.21.15.153:0/89487821 learned_addr learned my addr 172.21.15.153:0/89487821 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:41.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.389+0000 7f7738bc1700 1 --2- 172.21.15.153:0/89487821 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7734143ca0 0x7f77340a6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.389+0000 7f77337fe700 1 --2- 172.21.15.153:0/89487821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7734146c80 0x7f773413fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.389+0000 7f7733fff700 1 -- 172.21.15.153:0/89487821 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7734143ca0 msgr2=0x7f77340a6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.389+0000 7f7733fff700 1 --2- 172.21.15.153:0/89487821 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7734143ca0 0x7f77340a6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.389+0000 7f7733fff700 1 -- 172.21.15.153:0/89487821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7734146c80 msgr2=0x7f773413fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.389+0000 7f7733fff700 1 --2- 172.21.15.153:0/89487821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7734146c80 0x7f773413fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.389+0000 7f7733fff700 1 -- 172.21.15.153:0/89487821 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7734171f00 con 0x7f7720004810 2024-08-17T02:26:41.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.389+0000 7f7733fff700 1 --2- 172.21.15.153:0/89487821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7720004810 0x7f7734171080 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f771c00e5f0 tx=0x7f771c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.389+0000 7f772bfff700 1 -- 172.21.15.153:0/89487821 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771c0115c0 con 0x7f7720004810 2024-08-17T02:26:41.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.389+0000 7f772bfff700 1 -- 172.21.15.153:0/89487821 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f771c011740 con 0x7f7720004810 2024-08-17T02:26:41.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.389+0000 7f77393c2700 1 -- 172.21.15.153:0/89487821 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77340a54f0 con 0x7f7720004810 2024-08-17T02:26:41.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.389+0000 7f772bfff700 1 -- 172.21.15.153:0/89487821 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771c011b00 con 0x7f7720004810 2024-08-17T02:26:41.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.389+0000 7f77393c2700 1 -- 172.21.15.153:0/89487821 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7734140400 con 0x7f7720004810 2024-08-17T02:26:41.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.393+0000 7f77393c2700 1 -- 172.21.15.153:0/89487821 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77340643a0 con 0x7f7720004810 2024-08-17T02:26:41.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.393+0000 7f772bfff700 1 -- 172.21.15.153:0/89487821 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f771c014480 con 0x7f7720004810 2024-08-17T02:26:41.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.393+0000 7f772bfff700 1 --2- 172.21.15.153:0/89487821 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7714060860 0x7f7714062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.393+0000 7f772bfff700 1 -- 172.21.15.153:0/89487821 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f771c07c810 con 0x7f7720004810 2024-08-17T02:26:41.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.393+0000 7f77337fe700 1 --2- 172.21.15.153:0/89487821 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7714060860 0x7f7714062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.393+0000 7f77337fe700 1 --2- 172.21.15.153:0/89487821 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7714060860 0x7f7714062d10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f77240091e0 tx=0x7f772401a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.401+0000 7f772bfff700 1 -- 172.21.15.153:0/89487821 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f771c04cdd0 con 0x7f7720004810 2024-08-17T02:26:41.633 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:41.629+0000 7f77393c2700 1 -- 172.21.15.153:0/89487821 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7f773406f5f0 con 0x7f7720004810 2024-08-17T02:26:42.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.149+0000 7f772bfff700 1 -- 172.21.15.153:0/89487821 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v50) v1 ==== 138+0+0 (secure 0 0 0) 0x7f771c019070 con 0x7f7720004810 2024-08-17T02:26:42.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.153+0000 7f77393c2700 1 -- 172.21.15.153:0/89487821 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7714060860 msgr2=0x7f7714062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.153+0000 7f77393c2700 1 --2- 172.21.15.153:0/89487821 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7714060860 0x7f7714062d10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f77240091e0 tx=0x7f772401a000 comp rx=0 tx=0).stop 2024-08-17T02:26:42.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.153+0000 7f77393c2700 1 -- 172.21.15.153:0/89487821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7720004810 msgr2=0x7f7734171080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.153+0000 7f77393c2700 1 --2- 172.21.15.153:0/89487821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7720004810 0x7f7734171080 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f771c00e5f0 tx=0x7f771c009040 comp rx=0 tx=0).stop 2024-08-17T02:26:42.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.153+0000 7f77393c2700 1 -- 172.21.15.153:0/89487821 shutdown_connections 2024-08-17T02:26:42.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.153+0000 7f77393c2700 1 --2- 172.21.15.153:0/89487821 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7714060860 0x7f7714062d10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.153+0000 7f77393c2700 1 --2- 172.21.15.153:0/89487821 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7734143ca0 0x7f77340a6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.153+0000 7f77393c2700 1 --2- 172.21.15.153:0/89487821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7734146c80 0x7f773413fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.153+0000 7f77393c2700 1 --2- 172.21.15.153:0/89487821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7720004810 0x7f7734171080 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.153+0000 7f77393c2700 1 -- 172.21.15.153:0/89487821 >> 172.21.15.153:0/89487821 conn(0x7f77340678d0 msgr2=0x7f773415ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:42.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.153+0000 7f77393c2700 1 -- 172.21.15.153:0/89487821 shutdown_connections 2024-08-17T02:26:42.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.153+0000 7f77393c2700 1 -- 172.21.15.153:0/89487821 wait complete. 2024-08-17T02:26:42.172 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:26:42.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.293+0000 7faabce24700 1 Processor -- start 2024-08-17T02:26:42.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.293+0000 7faabce24700 1 -- start start 2024-08-17T02:26:42.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.293+0000 7faabce24700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faab8067510 0x7faab80ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.293+0000 7faabce24700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7faab8159480 0x7faab80cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.293+0000 7faabce24700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faab80ce210 con 0x7faab81590b0 2024-08-17T02:26:42.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.293+0000 7faabce24700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faab80cba00 con 0x7faab8159480 2024-08-17T02:26:42.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.293+0000 7faabce24700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faab80cdc90 con 0x7faab8067510 2024-08-17T02:26:42.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.297+0000 7faab7fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7faab8159480 0x7faab80cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.297+0000 7faab7fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7faab8159480 0x7faab80cebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54854/0 (socket says 172.21.15.153:54854) 2024-08-17T02:26:42.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.297+0000 7faab7fff700 1 -- 172.21.15.153:0/3317791273 learned_addr learned my addr 172.21.15.153:0/3317791273 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:42.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.297+0000 7faab6ffd700 1 --2- 172.21.15.153:0/3317791273 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faab8067510 0x7faab80ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.297+0000 7faab7fff700 1 -- 172.21.15.153:0/3317791273 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faab8067510 msgr2=0x7faab80ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:42.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.297+0000 7faab7fff700 1 --2- 172.21.15.153:0/3317791273 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faab8067510 0x7faab80ce6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.297+0000 7faab7fff700 1 -- 172.21.15.153:0/3317791273 >> v1:172.21.15.174:6789/0 conn(0x7faab81590b0 legacy=0x7faab8066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.297+0000 7faab7fff700 1 -- 172.21.15.153:0/3317791273 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab80cb440 con 0x7faab8159480 2024-08-17T02:26:42.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.297+0000 7faab7fff700 1 --2- 172.21.15.153:0/3317791273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faab8159480 0x7faab80cebe0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7faab0009f20 tx=0x7faab0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3282651953a3124 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:42.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.297+0000 7faab67fc700 1 -- 172.21.15.153:0/3317791273 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab000e070 con 0x7faab8159480 2024-08-17T02:26:42.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.297+0000 7faab67fc700 1 -- 172.21.15.153:0/3317791273 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab000b9d0 con 0x7faab8159480 2024-08-17T02:26:42.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.297+0000 7faab67fc700 1 -- 172.21.15.153:0/3317791273 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab00092e0 con 0x7faab8159480 2024-08-17T02:26:42.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.297+0000 7faabce24700 1 -- 172.21.15.153:0/3317791273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faab8159480 msgr2=0x7faab80cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.297+0000 7faabce24700 1 --2- 172.21.15.153:0/3317791273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faab8159480 0x7faab80cebe0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7faab0009f20 tx=0x7faab0009840 comp rx=0 tx=0).stop 2024-08-17T02:26:42.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.297+0000 7faabce24700 1 -- 172.21.15.153:0/3317791273 shutdown_connections 2024-08-17T02:26:42.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.297+0000 7faabce24700 1 --2- 172.21.15.153:0/3317791273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faab8159480 0x7faab80cebe0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.297+0000 7faabce24700 1 --2- 172.21.15.153:0/3317791273 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faab8067510 0x7faab80ce6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.297+0000 7faabce24700 1 -- 172.21.15.153:0/3317791273 >> 172.21.15.153:0/3317791273 conn(0x7faab80d0b90 msgr2=0x7faab80ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:42.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.297+0000 7faabce24700 1 -- 172.21.15.153:0/3317791273 shutdown_connections 2024-08-17T02:26:42.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.297+0000 7faabce24700 1 -- 172.21.15.153:0/3317791273 wait complete. 2024-08-17T02:26:42.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.301+0000 7faabce24700 1 Processor -- start 2024-08-17T02:26:42.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.301+0000 7faabce24700 1 -- start start 2024-08-17T02:26:42.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.301+0000 7faabce24700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faab8067510 0x7faab80c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.301+0000 7faabce24700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faab81590b0 0x7faab8156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.301+0000 7faabce24700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faab8159480 0x7faab8143a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.301+0000 7faabce24700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab8157c40 con 0x7faab81590b0 2024-08-17T02:26:42.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.301+0000 7faabce24700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab81568d0 con 0x7faab8067510 2024-08-17T02:26:42.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.301+0000 7faabce24700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faab8156ba0 con 0x7faab8159480 2024-08-17T02:26:42.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.301+0000 7faab6ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faab81590b0 0x7faab8156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.301+0000 7faab77fe700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faab8067510 0x7faab80c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.301+0000 7faab7fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faab8159480 0x7faab8143a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.301+0000 7faab77fe700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faab8067510 0x7faab80c8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.153:43480/0 (socket says 172.21.15.153:43480) 2024-08-17T02:26:42.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.301+0000 7faab6ffd700 1 --2- 172.21.15.153:0/1024252240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faab81590b0 0x7faab8156390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54870/0 (socket says 172.21.15.153:54870) 2024-08-17T02:26:42.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.301+0000 7faab77fe700 1 -- 172.21.15.153:0/1024252240 learned_addr learned my addr 172.21.15.153:0/1024252240 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:42.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.301+0000 7faab6ffd700 1 -- 172.21.15.153:0/1024252240 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faab8159480 msgr2=0x7faab8143a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.301+0000 7faab6ffd700 1 --2- 172.21.15.153:0/1024252240 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faab8159480 0x7faab8143a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.301+0000 7faab6ffd700 1 -- 172.21.15.153:0/1024252240 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faab8067510 msgr2=0x7faab80c8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.301+0000 7faab6ffd700 1 --2- 172.21.15.153:0/1024252240 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faab8067510 0x7faab80c8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.301+0000 7faab6ffd700 1 -- 172.21.15.153:0/1024252240 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab0009ae0 con 0x7faab81590b0 2024-08-17T02:26:42.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.301+0000 7faab77fe700 1 --2- 172.21.15.153:0/1024252240 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faab8067510 0x7faab80c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:42.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.301+0000 7faab6ffd700 1 --2- 172.21.15.153:0/1024252240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faab81590b0 0x7faab8156390 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7faaa800ea50 tx=0x7faaa80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:42.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.301+0000 7faa9f7fe700 1 -- 172.21.15.153:0/1024252240 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa800ee90 con 0x7faab81590b0 2024-08-17T02:26:42.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.301+0000 7faa9f7fe700 1 -- 172.21.15.153:0/1024252240 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa800c7f0 con 0x7faab81590b0 2024-08-17T02:26:42.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.301+0000 7faabce24700 1 -- 172.21.15.153:0/1024252240 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faab8156e80 con 0x7faab81590b0 2024-08-17T02:26:42.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.301+0000 7faa9f7fe700 1 -- 172.21.15.153:0/1024252240 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa800cb90 con 0x7faab81590b0 2024-08-17T02:26:42.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.301+0000 7faabce24700 1 -- 172.21.15.153:0/1024252240 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faab8157440 con 0x7faab81590b0 2024-08-17T02:26:42.308 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.305+0000 7faabce24700 1 -- 172.21.15.153:0/1024252240 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faab8064330 con 0x7faab81590b0 2024-08-17T02:26:42.308 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.305+0000 7faa9f7fe700 1 -- 172.21.15.153:0/1024252240 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7faaa8013470 con 0x7faab81590b0 2024-08-17T02:26:42.309 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.305+0000 7faa9f7fe700 1 --2- 172.21.15.153:0/1024252240 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7faaa4060860 0x7faaa4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.309 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.305+0000 7faa9f7fe700 1 -- 172.21.15.153:0/1024252240 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faaa807cd60 con 0x7faab81590b0 2024-08-17T02:26:42.309 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.305+0000 7faab77fe700 1 --2- 172.21.15.153:0/1024252240 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7faaa4060860 0x7faaa4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.309 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.305+0000 7faab77fe700 1 --2- 172.21.15.153:0/1024252240 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7faaa4060860 0x7faaa4062d10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7faaac001e90 tx=0x7faaac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:42.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.313+0000 7faa9f7fe700 1 -- 172.21.15.153:0/1024252240 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7faaa804d1b0 con 0x7faab81590b0 2024-08-17T02:26:42.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.473+0000 7faabce24700 1 -- 172.21.15.153:0/1024252240 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7faab8070cf0 con 0x7faab81590b0 2024-08-17T02:26:42.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.481+0000 7faa9f7fe700 1 -- 172.21.15.153:0/1024252240 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7faaa80507d0 con 0x7faab81590b0 2024-08-17T02:26:42.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.481+0000 7faabce24700 1 -- 172.21.15.153:0/1024252240 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7faaa4060860 msgr2=0x7faaa4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.481+0000 7faabce24700 1 --2- 172.21.15.153:0/1024252240 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7faaa4060860 0x7faaa4062d10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7faaac001e90 tx=0x7faaac009040 comp rx=0 tx=0).stop 2024-08-17T02:26:42.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.481+0000 7faabce24700 1 -- 172.21.15.153:0/1024252240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faab81590b0 msgr2=0x7faab8156390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.481+0000 7faabce24700 1 --2- 172.21.15.153:0/1024252240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faab81590b0 0x7faab8156390 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7faaa800ea50 tx=0x7faaa80091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.481+0000 7faabce24700 1 -- 172.21.15.153:0/1024252240 shutdown_connections 2024-08-17T02:26:42.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.481+0000 7faabce24700 1 --2- 172.21.15.153:0/1024252240 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7faaa4060860 0x7faaa4062d10 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.481+0000 7faabce24700 1 --2- 172.21.15.153:0/1024252240 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faab8159480 0x7faab8143a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.481+0000 7faabce24700 1 --2- 172.21.15.153:0/1024252240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faab81590b0 0x7faab8156390 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.481+0000 7faabce24700 1 --2- 172.21.15.153:0/1024252240 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faab8067510 0x7faab80c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.481+0000 7faabce24700 1 -- 172.21.15.153:0/1024252240 >> 172.21.15.153:0/1024252240 conn(0x7faab80d0b90 msgr2=0x7faab8066e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:42.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.481+0000 7faabce24700 1 -- 172.21.15.153:0/1024252240 shutdown_connections 2024-08-17T02:26:42.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.485+0000 7faabce24700 1 -- 172.21.15.153:0/1024252240 wait complete. 2024-08-17T02:26:42.500 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:26:42.501 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:26:42.520 DEBUG:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:26:42.541 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:26:42.541 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi153.front.sepia.ceph.com... 2024-08-17T02:26:42.542 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:26:42.542 DEBUG:teuthology.orchestra.run.smithi153:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:42.588 INFO:teuthology.orchestra.run:waiting for 900 2024-08-17T02:26:42.588 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2024-08-17T02:26:42.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:42.588 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:26:42.627 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi174.front.sepia.ceph.com... 2024-08-17T02:26:42.627 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:26:42.628 DEBUG:teuthology.orchestra.run.smithi174:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:42.660 INFO:teuthology.orchestra.run:waiting for 900 2024-08-17T02:26:42.660 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi174.front.sepia.ceph.com 2024-08-17T02:26:42.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:42.660 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:26:42.726 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi153.front.sepia.ceph.com... 2024-08-17T02:26:42.726 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:26:42.727 DEBUG:teuthology.orchestra.run.smithi153:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-08-17T02:26:42.742 INFO:teuthology.orchestra.run:waiting for 900 2024-08-17T02:26:42.743 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2024-08-17T02:26:42.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:42.743 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-08-17T02:26:42.797 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi174.front.sepia.ceph.com... 2024-08-17T02:26:42.798 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:26:42.798 DEBUG:teuthology.orchestra.run.smithi174:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-08-17T02:26:42.814 INFO:teuthology.orchestra.run:waiting for 900 2024-08-17T02:26:42.815 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi174.front.sepia.ceph.com 2024-08-17T02:26:42.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:42.815 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-08-17T02:26:42.867 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-17T02:26:42.867 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:42.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.981+0000 7f1b32f32700 1 Processor -- start 2024-08-17T02:26:42.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.981+0000 7f1b32f32700 1 -- start start 2024-08-17T02:26:42.986 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.981+0000 7f1b32f32700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b2c154900 0x7f1b2c0b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.986 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.981+0000 7f1b32f32700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b2c0cbaa0 con 0x7f1b2c0b12d0 2024-08-17T02:26:42.986 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.981+0000 7f1b32f32700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b2c0b1700 con 0x7f1b2c0cb560 2024-08-17T02:26:42.986 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.981+0000 7f1b32f32700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c068790 con 0x7f1b2c154900 2024-08-17T02:26:42.986 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.985+0000 7f1b3172f700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f1b2c0b12d0 0x7f1b2c0cae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:55486/0 (socket says 172.21.15.153:55486) 2024-08-17T02:26:42.987 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.985+0000 7f1b3172f700 1 -- 172.21.15.153:0/1863858979 learned_addr learned my addr 172.21.15.153:0/1863858979 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:42.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.985+0000 7f1b31f30700 1 --2- 172.21.15.153:0/1863858979 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b2c154900 0x7f1b2c0b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.985+0000 7f1b30f2e700 1 -- 172.21.15.153:0/1863858979 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2535778695 0 0) 0x7f1b2c0cbaa0 con 0x7f1b2c0b12d0 2024-08-17T02:26:42.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.985+0000 7f1b30f2e700 1 -- 172.21.15.153:0/1863858979 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b14003570 con 0x7f1b2c0b12d0 2024-08-17T02:26:42.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.985+0000 7f1b30f2e700 1 -- 172.21.15.153:0/1863858979 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1847996815 0 0) 0x7f1b14003570 con 0x7f1b2c0b12d0 2024-08-17T02:26:42.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.985+0000 7f1b30f2e700 1 -- 172.21.15.153:0/1863858979 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b2c154900 msgr2=0x7f1b2c0b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:42.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.985+0000 7f1b30f2e700 1 --2- 172.21.15.153:0/1863858979 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b2c154900 0x7f1b2c0b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.985+0000 7f1b30f2e700 1 -- 172.21.15.153:0/1863858979 >> v1:172.21.15.174:6789/0 conn(0x7f1b2c0cb560 legacy=0x7f1b2c160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.985+0000 7f1b30f2e700 1 -- 172.21.15.153:0/1863858979 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b2c157630 con 0x7f1b2c0b12d0 2024-08-17T02:26:42.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.985+0000 7f1b30f2e700 1 -- 172.21.15.153:0/1863858979 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3701463666 0 0) 0x7f1b200017f0 con 0x7f1b2c0b12d0 2024-08-17T02:26:42.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.985+0000 7f1b30f2e700 1 -- 172.21.15.153:0/1863858979 >> v1:172.21.15.153:6789/0 conn(0x7f1b2c0b12d0 legacy=0x7f1b2c0cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.985+0000 7f1b30f2e700 1 --2- 172.21.15.153:0/1863858979 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b14003a90 0x7f1b14003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.985+0000 7f1b30f2e700 1 --2- 172.21.15.153:0/1863858979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b14004810 0x7f1b14004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.985+0000 7f1b30f2e700 1 --2- 172.21.15.153:0/1863858979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b140051c0 0x7f1b1400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.985+0000 7f1b30f2e700 1 -- 172.21.15.153:0/1863858979 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c068790 con 0x7f1b140051c0 2024-08-17T02:26:42.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.985+0000 7f1b30f2e700 1 -- 172.21.15.153:0/1863858979 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1400c050 con 0x7f1b14004810 2024-08-17T02:26:42.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.985+0000 7f1b30f2e700 1 -- 172.21.15.153:0/1863858979 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1400c210 con 0x7f1b14003a90 2024-08-17T02:26:42.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.985+0000 7f1b31f30700 1 --2- 172.21.15.153:0/1863858979 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b14003a90 0x7f1b14003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.985+0000 7f1b3172f700 1 --2- 172.21.15.153:0/1863858979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b14004810 0x7f1b14004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.985+0000 7f1b32731700 1 --2- 172.21.15.153:0/1863858979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b140051c0 0x7f1b1400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.985+0000 7f1b31f30700 1 -- 172.21.15.153:0/1863858979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b14004810 msgr2=0x7f1b14004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:42.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.985+0000 7f1b31f30700 1 --2- 172.21.15.153:0/1863858979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b14004810 0x7f1b14004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.985+0000 7f1b31f30700 1 -- 172.21.15.153:0/1863858979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b140051c0 msgr2=0x7f1b1400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:42.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.985+0000 7f1b31f30700 1 --2- 172.21.15.153:0/1863858979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b140051c0 0x7f1b1400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.985+0000 7f1b31f30700 1 -- 172.21.15.153:0/1863858979 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b14003570 con 0x7f1b14003a90 2024-08-17T02:26:42.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.985+0000 7f1b3172f700 1 --2- 172.21.15.153:0/1863858979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b14004810 0x7f1b14004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:42.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.985+0000 7f1b32731700 1 --2- 172.21.15.153:0/1863858979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b140051c0 0x7f1b1400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:42.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.985+0000 7f1b31f30700 1 --2- 172.21.15.153:0/1863858979 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b14003a90 0x7f1b14003ea0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c009ad0 tx=0x7f1b1c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=670f7adcb65a0b32 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:42.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.985+0000 7f1b30f2e700 1 -- 172.21.15.153:0/1863858979 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c00e640 con 0x7f1b14003a90 2024-08-17T02:26:42.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.985+0000 7f1b30f2e700 1 -- 172.21.15.153:0/1863858979 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b1c00e7a0 con 0x7f1b14003a90 2024-08-17T02:26:42.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.985+0000 7f1b30f2e700 1 -- 172.21.15.153:0/1863858979 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c00eb40 con 0x7f1b14003a90 2024-08-17T02:26:42.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.989+0000 7f1b32f32700 1 -- 172.21.15.153:0/1863858979 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b14003a90 msgr2=0x7f1b14003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.989+0000 7f1b32f32700 1 --2- 172.21.15.153:0/1863858979 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b14003a90 0x7f1b14003ea0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c009ad0 tx=0x7f1b1c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.989+0000 7f1b32731700 1 -- 172.21.15.153:0/1863858979 reap_dead start 2024-08-17T02:26:42.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.989+0000 7f1b32f32700 1 -- 172.21.15.153:0/1863858979 shutdown_connections 2024-08-17T02:26:42.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.989+0000 7f1b32f32700 1 -- 172.21.15.153:0/1863858979 >> 172.21.15.153:0/1863858979 conn(0x7f1b2c0678d0 msgr2=0x7f1b2c067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:42.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.989+0000 7f1b32f32700 1 -- 172.21.15.153:0/1863858979 shutdown_connections 2024-08-17T02:26:42.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.989+0000 7f1b32f32700 1 -- 172.21.15.153:0/1863858979 wait complete. 2024-08-17T02:26:42.996 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.989+0000 7f1b32f32700 1 Processor -- start 2024-08-17T02:26:42.996 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.989+0000 7f1b32f32700 1 -- start start 2024-08-17T02:26:42.996 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.993+0000 7f1b32f32700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b14003a90 0x7f1b2c0a9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.996 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.993+0000 7f1b32f32700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b2c0a8970 0x7f1b2c0a7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.996 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.993+0000 7f1b32f32700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b2c06a140 0x7f1b2c1452c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.996 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.993+0000 7f1b32f32700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c0a7670 con 0x7f1b2c0a8970 2024-08-17T02:26:42.996 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.993+0000 7f1b32f32700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c0a78d0 con 0x7f1b2c06a140 2024-08-17T02:26:42.997 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.993+0000 7f1b32f32700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c0a7bb0 con 0x7f1b14003a90 2024-08-17T02:26:42.997 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.993+0000 7f1b3172f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b2c0a8970 0x7f1b2c0a7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.997 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.993+0000 7f1b3172f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b2c0a8970 0x7f1b2c0a7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54882/0 (socket says 172.21.15.153:54882) 2024-08-17T02:26:42.997 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.993+0000 7f1b3172f700 1 -- 172.21.15.153:0/3951421361 learned_addr learned my addr 172.21.15.153:0/3951421361 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:42.997 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.993+0000 7f1b31f30700 1 --2- 172.21.15.153:0/3951421361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b14003a90 0x7f1b2c0a9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.997 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.993+0000 7f1b32731700 1 --2- 172.21.15.153:0/3951421361 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b2c06a140 0x7f1b2c1452c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.997 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.993+0000 7f1b3172f700 1 -- 172.21.15.153:0/3951421361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b14003a90 msgr2=0x7f1b2c0a9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.997 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.993+0000 7f1b3172f700 1 --2- 172.21.15.153:0/3951421361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b14003a90 0x7f1b2c0a9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.997 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.993+0000 7f1b3172f700 1 -- 172.21.15.153:0/3951421361 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b2c06a140 msgr2=0x7f1b2c1452c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.997 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.993+0000 7f1b3172f700 1 --2- 172.21.15.153:0/3951421361 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b2c06a140 0x7f1b2c1452c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.997 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.993+0000 7f1b3172f700 1 -- 172.21.15.153:0/3951421361 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b2c0a7e90 con 0x7f1b2c0a8970 2024-08-17T02:26:42.997 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.993+0000 7f1b31f30700 1 --2- 172.21.15.153:0/3951421361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b14003a90 0x7f1b2c0a9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:42.998 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.993+0000 7f1b3172f700 1 --2- 172.21.15.153:0/3951421361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b2c0a8970 0x7f1b2c0a7130 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1b20001920 tx=0x7f1b200021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:42.998 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.993+0000 7f1b29ffb700 1 -- 172.21.15.153:0/3951421361 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b200133f0 con 0x7f1b2c0a8970 2024-08-17T02:26:42.998 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.993+0000 7f1b29ffb700 1 -- 172.21.15.153:0/3951421361 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b20013550 con 0x7f1b2c0a8970 2024-08-17T02:26:42.998 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.993+0000 7f1b32f32700 1 -- 172.21.15.153:0/3951421361 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b2c0a8170 con 0x7f1b2c0a8970 2024-08-17T02:26:42.998 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.993+0000 7f1b29ffb700 1 -- 172.21.15.153:0/3951421361 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b200138d0 con 0x7f1b2c0a8970 2024-08-17T02:26:42.998 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.993+0000 7f1b32f32700 1 -- 172.21.15.153:0/3951421361 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b2c06a5c0 con 0x7f1b2c0a8970 2024-08-17T02:26:42.999 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.993+0000 7f1b32f32700 1 -- 172.21.15.153:0/3951421361 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b2c0a8670 con 0x7f1b2c0a8970 2024-08-17T02:26:42.999 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.993+0000 7f1b29ffb700 1 -- 172.21.15.153:0/3951421361 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1b20013c80 con 0x7f1b2c0a8970 2024-08-17T02:26:42.999 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.997+0000 7f1b29ffb700 1 --2- 172.21.15.153:0/3951421361 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1b18060860 0x7f1b18062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.999 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.997+0000 7f1b29ffb700 1 -- 172.21.15.153:0/3951421361 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1b2007dc80 con 0x7f1b2c0a8970 2024-08-17T02:26:42.999 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.997+0000 7f1b31f30700 1 --2- 172.21.15.153:0/3951421361 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1b18060860 0x7f1b18062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.000 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:42.997+0000 7f1b31f30700 1 --2- 172.21.15.153:0/3951421361 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1b18060860 0x7f1b18062d10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c0091e0 tx=0x7f1b1c01a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:43.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.005+0000 7f1b29ffb700 1 -- 172.21.15.153:0/3951421361 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1b2004e030 con 0x7f1b2c0a8970 2024-08-17T02:26:43.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.205+0000 7f1b32f32700 1 -- 172.21.15.153:0/3951421361 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b2c0643a0 con 0x7f1b2c0a8970 2024-08-17T02:26:43.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.205+0000 7f1b29ffb700 1 -- 172.21.15.153:0/3951421361 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f1b20051650 con 0x7f1b2c0a8970 2024-08-17T02:26:43.208 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:43.208 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/610991976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":610991976},{"type":"v1","addr":"172.21.15.153:6835","nonce":610991976}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/3521472122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3521472122},{"type":"v1","addr":"172.21.15.153:6837","nonce":3521472122}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1184225885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1184225885},{"type":"v1","addr":"172.21.15.174:6833","nonce":1184225885}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:12.082812+0000","modified":"2024-08-17T02:26:14.770527+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/477398839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":477398839},{"type":"v1","addr":"172.21.15.174:6835","nonce":477398839}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:26:43.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.209+0000 7f1b32f32700 1 -- 172.21.15.153:0/3951421361 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1b18060860 msgr2=0x7f1b18062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.209+0000 7f1b32f32700 1 --2- 172.21.15.153:0/3951421361 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1b18060860 0x7f1b18062d10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c0091e0 tx=0x7f1b1c01a000 comp rx=0 tx=0).stop 2024-08-17T02:26:43.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.209+0000 7f1b32f32700 1 -- 172.21.15.153:0/3951421361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b2c0a8970 msgr2=0x7f1b2c0a7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.209+0000 7f1b32f32700 1 --2- 172.21.15.153:0/3951421361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b2c0a8970 0x7f1b2c0a7130 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1b20001920 tx=0x7f1b200021d0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.209+0000 7f1b32f32700 1 -- 172.21.15.153:0/3951421361 shutdown_connections 2024-08-17T02:26:43.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.209+0000 7f1b32f32700 1 --2- 172.21.15.153:0/3951421361 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1b18060860 0x7f1b18062d10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.209+0000 7f1b32f32700 1 --2- 172.21.15.153:0/3951421361 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b2c06a140 0x7f1b2c1452c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.209+0000 7f1b32f32700 1 --2- 172.21.15.153:0/3951421361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b2c0a8970 0x7f1b2c0a7130 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.209+0000 7f1b32f32700 1 --2- 172.21.15.153:0/3951421361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b14003a90 0x7f1b2c0a9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.209+0000 7f1b32f32700 1 -- 172.21.15.153:0/3951421361 >> 172.21.15.153:0/3951421361 conn(0x7f1b2c0678d0 msgr2=0x7f1b2c1539e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:43.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.209+0000 7f1b32f32700 1 -- 172.21.15.153:0/3951421361 shutdown_connections 2024-08-17T02:26:43.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.209+0000 7f1b32f32700 1 -- 172.21.15.153:0/3951421361 wait complete. 2024-08-17T02:26:43.213 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 6 2024-08-17T02:26:43.228 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:43.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.329+0000 7f1be72c6700 1 Processor -- start 2024-08-17T02:26:43.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.329+0000 7f1be72c6700 1 -- start start 2024-08-17T02:26:43.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.329+0000 7f1be72c6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1be0155d20 0x7f1be00b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.329+0000 7f1be72c6700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1be006df10 0x7f1be006e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.329+0000 7f1be72c6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1be006e870 con 0x7f1be00ad7c0 2024-08-17T02:26:43.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.329+0000 7f1be72c6700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1be00adc10 con 0x7f1be006df10 2024-08-17T02:26:43.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.329+0000 7f1be72c6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1be00af2b0 con 0x7f1be0155d20 2024-08-17T02:26:43.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.329+0000 7f1be6ac5700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1be006df10 0x7f1be006e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.329+0000 7f1be6ac5700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1be006df10 0x7f1be006e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54892/0 (socket says 172.21.15.153:54892) 2024-08-17T02:26:43.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.329+0000 7f1be6ac5700 1 -- 172.21.15.153:0/3236602836 learned_addr learned my addr 172.21.15.153:0/3236602836 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:43.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.329+0000 7f1be62c4700 1 --2- 172.21.15.153:0/3236602836 >> v2:172.21.15.174:3300/0 conn(0x7f1be0155d20 0x7f1be00b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.329+0000 7f1be6ac5700 1 -- 172.21.15.153:0/3236602836 >> v2:172.21.15.174:3300/0 conn(0x7f1be0155d20 msgr2=0x7f1be00b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:43.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.329+0000 7f1be6ac5700 1 --2- 172.21.15.153:0/3236602836 >> v2:172.21.15.174:3300/0 conn(0x7f1be0155d20 0x7f1be00b0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.329+0000 7f1be6ac5700 1 -- 172.21.15.153:0/3236602836 >> v1:172.21.15.174:6789/0 conn(0x7f1be00ad7c0 legacy=0x7f1be00aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:43.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.329+0000 7f1be6ac5700 1 -- 172.21.15.153:0/3236602836 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be00af590 con 0x7f1be006df10 2024-08-17T02:26:43.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.329+0000 7f1be62c4700 1 --2- 172.21.15.153:0/3236602836 >> v2:172.21.15.174:3300/0 conn(0x7f1be0155d20 0x7f1be00b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:43.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.329+0000 7f1be6ac5700 1 --2- 172.21.15.153:0/3236602836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1be006df10 0x7f1be006e330 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1be00b1d50 tx=0x7f1bd0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2196358012cc9cc0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:43.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.329+0000 7f1be52c2700 1 -- 172.21.15.153:0/3236602836 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd000b820 con 0x7f1be006df10 2024-08-17T02:26:43.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.329+0000 7f1be52c2700 1 -- 172.21.15.153:0/3236602836 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd000b980 con 0x7f1be006df10 2024-08-17T02:26:43.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.329+0000 7f1be52c2700 1 -- 172.21.15.153:0/3236602836 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd000bd20 con 0x7f1be006df10 2024-08-17T02:26:43.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.333+0000 7f1be72c6700 1 -- 172.21.15.153:0/3236602836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1be006df10 msgr2=0x7f1be006e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.333+0000 7f1be72c6700 1 --2- 172.21.15.153:0/3236602836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1be006df10 0x7f1be006e330 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1be00b1d50 tx=0x7f1bd0009250 comp rx=0 tx=0).stop 2024-08-17T02:26:43.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.333+0000 7f1be72c6700 1 -- 172.21.15.153:0/3236602836 shutdown_connections 2024-08-17T02:26:43.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.333+0000 7f1be72c6700 1 --2- 172.21.15.153:0/3236602836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1be006df10 0x7f1be006e330 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.333+0000 7f1be72c6700 1 --2- 172.21.15.153:0/3236602836 >> v2:172.21.15.174:3300/0 conn(0x7f1be0155d20 0x7f1be00b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.333+0000 7f1be72c6700 1 -- 172.21.15.153:0/3236602836 >> 172.21.15.153:0/3236602836 conn(0x7f1be00678d0 msgr2=0x7f1be0067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:43.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.333+0000 7f1be72c6700 1 -- 172.21.15.153:0/3236602836 shutdown_connections 2024-08-17T02:26:43.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.333+0000 7f1be72c6700 1 -- 172.21.15.153:0/3236602836 wait complete. 2024-08-17T02:26:43.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.333+0000 7f1be72c6700 1 Processor -- start 2024-08-17T02:26:43.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.333+0000 7f1be72c6700 1 -- start start 2024-08-17T02:26:43.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.333+0000 7f1be72c6700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1be006df10 0x7f1be014a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.333+0000 7f1be72c6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1be00ad7c0 0x7f1be0146960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.333+0000 7f1be72c6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1be0155d20 0x7f1be0146f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.333+0000 7f1be72c6700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be015c070 con 0x7f1be00ad7c0 2024-08-17T02:26:43.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.333+0000 7f1be72c6700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be0149f80 con 0x7f1be006df10 2024-08-17T02:26:43.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.333+0000 7f1be72c6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be014a260 con 0x7f1be0155d20 2024-08-17T02:26:43.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.333+0000 7f1be5ac3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1be00ad7c0 0x7f1be0146960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.333+0000 7f1be5ac3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1be00ad7c0 0x7f1be0146960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54906/0 (socket says 172.21.15.153:54906) 2024-08-17T02:26:43.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.333+0000 7f1be5ac3700 1 -- 172.21.15.153:0/1435154124 learned_addr learned my addr 172.21.15.153:0/1435154124 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:43.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.333+0000 7f1be6ac5700 1 --2- 172.21.15.153:0/1435154124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1be0155d20 0x7f1be0146f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.333+0000 7f1be62c4700 1 --2- 172.21.15.153:0/1435154124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1be006df10 0x7f1be014a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.337+0000 7f1be5ac3700 1 -- 172.21.15.153:0/1435154124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1be0155d20 msgr2=0x7f1be0146f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.337+0000 7f1be5ac3700 1 --2- 172.21.15.153:0/1435154124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1be0155d20 0x7f1be0146f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.337+0000 7f1be5ac3700 1 -- 172.21.15.153:0/1435154124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1be006df10 msgr2=0x7f1be014a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.337+0000 7f1be5ac3700 1 --2- 172.21.15.153:0/1435154124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1be006df10 0x7f1be014a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.337+0000 7f1be5ac3700 1 -- 172.21.15.153:0/1435154124 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd00094f0 con 0x7f1be00ad7c0 2024-08-17T02:26:43.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.337+0000 7f1be5ac3700 1 --2- 172.21.15.153:0/1435154124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1be00ad7c0 0x7f1be0146960 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc00c950 tx=0x7f1bdc002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:43.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.337+0000 7f1bd67fc700 1 -- 172.21.15.153:0/1435154124 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc012630 con 0x7f1be00ad7c0 2024-08-17T02:26:43.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.337+0000 7f1bd67fc700 1 -- 172.21.15.153:0/1435154124 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bdc012790 con 0x7f1be00ad7c0 2024-08-17T02:26:43.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.337+0000 7f1bd67fc700 1 -- 172.21.15.153:0/1435154124 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc012b50 con 0x7f1be00ad7c0 2024-08-17T02:26:43.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.337+0000 7f1be72c6700 1 -- 172.21.15.153:0/1435154124 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1be014a540 con 0x7f1be00ad7c0 2024-08-17T02:26:43.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.337+0000 7f1be72c6700 1 -- 172.21.15.153:0/1435154124 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be0147460 con 0x7f1be00ad7c0 2024-08-17T02:26:43.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.337+0000 7f1be72c6700 1 -- 172.21.15.153:0/1435154124 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1be015bb60 con 0x7f1be00ad7c0 2024-08-17T02:26:43.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.341+0000 7f1bd67fc700 1 -- 172.21.15.153:0/1435154124 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1bdc01b400 con 0x7f1be00ad7c0 2024-08-17T02:26:43.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.341+0000 7f1bd67fc700 1 --2- 172.21.15.153:0/1435154124 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1bcc060860 0x7f1bcc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.341+0000 7f1bd67fc700 1 -- 172.21.15.153:0/1435154124 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1bdc07cf40 con 0x7f1be00ad7c0 2024-08-17T02:26:43.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.341+0000 7f1be62c4700 1 --2- 172.21.15.153:0/1435154124 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1bcc060860 0x7f1bcc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.341+0000 7f1be62c4700 1 --2- 172.21.15.153:0/1435154124 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1bcc060860 0x7f1bcc062d10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1bd800adc0 tx=0x7f1bd8006f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:43.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.345+0000 7f1bd67fc700 1 -- 172.21.15.153:0/1435154124 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1be015bb60 con 0x7f1be00ad7c0 2024-08-17T02:26:43.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.509+0000 7f1be72c6700 1 -- 172.21.15.153:0/1435154124 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1be015bb60 con 0x7f1be00ad7c0 2024-08-17T02:26:43.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.513+0000 7f1bd67fc700 1 -- 172.21.15.153:0/1435154124 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f1be015bb60 con 0x7f1be00ad7c0 2024-08-17T02:26:43.515 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:43.515 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":21,"fsid":"56d41c33-b929-456d-96be-2aac4ecd299d","created":"2024-08-17T02:25:47.756085+0000","modified":"2024-08-17T02:26:13.759246+0000","last_up_change":"2024-08-17T02:25:58.643690+0000","last_in_change":"2024-08-17T02:25:49.809186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:58.093273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:09.856520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:11.080706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0736f8e6-818e-42e6-a0dc-8aaf813315d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":24234},{"type":"v1","addr":"172.21.15.153:6817","nonce":24234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":24234},{"type":"v1","addr":"172.21.15.153:6819","nonce":24234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":24234},{"type":"v1","addr":"172.21.15.153:6823","nonce":24234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":24234},{"type":"v1","addr":"172.21.15.153:6821","nonce":24234}]},"public_addr":"172.21.15.153:6817/24234","cluster_addr":"172.21.15.153:6819/24234","heartbeat_back_addr":"172.21.15.153:6823/24234","heartbeat_front_addr":"172.21.15.153:6821/24234","state":["exists","up"]},{"osd":1,"uuid":"011762e9-6c2d-441a-aa56-68474639d72f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":24232},{"type":"v1","addr":"172.21.15.153:6801","nonce":24232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":24232},{"type":"v1","addr":"172.21.15.153:6803","nonce":24232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":24232},{"type":"v1","addr":"172.21.15.153:6809","nonce":24232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":24232},{"type":"v1","addr":"172.21.15.153:6806","nonce":24232}]},"public_addr":"172.21.15.153:6801/24232","cluster_addr":"172.21.15.153:6803/24232","heartbeat_back_addr":"172.21.15.153:6809/24232","heartbeat_front_addr":"172.21.15.153:6806/24232","state":["exists","up"]},{"osd":2,"uuid":"b562cd97-aa12-455e-b46a-e720a2ec9d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":24235},{"type":"v1","addr":"172.21.15.153:6808","nonce":24235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":24235},{"type":"v1","addr":"172.21.15.153:6811","nonce":24235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":24235},{"type":"v1","addr":"172.21.15.153:6815","nonce":24235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":24235},{"type":"v1","addr":"172.21.15.153:6813","nonce":24235}]},"public_addr":"172.21.15.153:6808/24235","cluster_addr":"172.21.15.153:6811/24235","heartbeat_back_addr":"172.21.15.153:6815/24235","heartbeat_front_addr":"172.21.15.153:6813/24235","state":["exists","up"]},{"osd":3,"uuid":"222da52f-90c2-4132-a5d2-6f6cf83d4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":24236},{"type":"v1","addr":"172.21.15.153:6825","nonce":24236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":24236},{"type":"v1","addr":"172.21.15.153:6827","nonce":24236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":24236},{"type":"v1","addr":"172.21.15.153:6831","nonce":24236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":24236},{"type":"v1","addr":"172.21.15.153:6829","nonce":24236}]},"public_addr":"172.21.15.153:6825/24236","cluster_addr":"172.21.15.153:6827/24236","heartbeat_back_addr":"172.21.15.153:6831/24236","heartbeat_front_addr":"172.21.15.153:6829/24236","state":["exists","up"]},{"osd":4,"uuid":"a38a04cd-032b-4977-a260-1ef3567d0c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24456},{"type":"v1","addr":"172.21.15.174:6809","nonce":24456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24456},{"type":"v1","addr":"172.21.15.174:6811","nonce":24456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24456},{"type":"v1","addr":"172.21.15.174:6815","nonce":24456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24456},{"type":"v1","addr":"172.21.15.174:6813","nonce":24456}]},"public_addr":"172.21.15.174:6809/24456","cluster_addr":"172.21.15.174:6811/24456","heartbeat_back_addr":"172.21.15.174:6815/24456","heartbeat_front_addr":"172.21.15.174:6813/24456","state":["exists","up"]},{"osd":5,"uuid":"c7778084-e751-48da-87a1-ab8bbe85aa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24457},{"type":"v1","addr":"172.21.15.174:6825","nonce":24457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24457},{"type":"v1","addr":"172.21.15.174:6827","nonce":24457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24457},{"type":"v1","addr":"172.21.15.174:6831","nonce":24457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24457},{"type":"v1","addr":"172.21.15.174:6829","nonce":24457}]},"public_addr":"172.21.15.174:6825/24457","cluster_addr":"172.21.15.174:6827/24457","heartbeat_back_addr":"172.21.15.174:6831/24457","heartbeat_front_addr":"172.21.15.174:6829/24457","state":["exists","up"]},{"osd":6,"uuid":"2d8e0715-254f-442c-9625-50721d0bc858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24477},{"type":"v1","addr":"172.21.15.174:6801","nonce":24477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24477},{"type":"v1","addr":"172.21.15.174:6803","nonce":24477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24477},{"type":"v1","addr":"172.21.15.174:6807","nonce":24477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24477},{"type":"v1","addr":"172.21.15.174:6805","nonce":24477}]},"public_addr":"172.21.15.174:6801/24477","cluster_addr":"172.21.15.174:6803/24477","heartbeat_back_addr":"172.21.15.174:6807/24477","heartbeat_front_addr":"172.21.15.174:6805/24477","state":["exists","up"]},{"osd":7,"uuid":"dffda25a-4601-4ddb-9a27-b0be1cadde27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24455},{"type":"v1","addr":"172.21.15.174:6817","nonce":24455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24455},{"type":"v1","addr":"172.21.15.174:6819","nonce":24455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24455},{"type":"v1","addr":"172.21.15.174:6823","nonce":24455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24455},{"type":"v1","addr":"172.21.15.174:6821","nonce":24455}]},"public_addr":"172.21.15.174:6817/24455","cluster_addr":"172.21.15.174:6819/24455","heartbeat_back_addr":"172.21.15.174:6823/24455","heartbeat_front_addr":"172.21.15.174:6821/24455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.990117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.033862+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.748087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.112877+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.070448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.360961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.110940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.226377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:43.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.513+0000 7f1be72c6700 1 -- 172.21.15.153:0/1435154124 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1bcc060860 msgr2=0x7f1bcc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.513+0000 7f1be72c6700 1 --2- 172.21.15.153:0/1435154124 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1bcc060860 0x7f1bcc062d10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1bd800adc0 tx=0x7f1bd8006f90 comp rx=0 tx=0).stop 2024-08-17T02:26:43.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.513+0000 7f1be72c6700 1 -- 172.21.15.153:0/1435154124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1be00ad7c0 msgr2=0x7f1be0146960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.513+0000 7f1be72c6700 1 --2- 172.21.15.153:0/1435154124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1be00ad7c0 0x7f1be0146960 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc00c950 tx=0x7f1bdc002760 comp rx=0 tx=0).stop 2024-08-17T02:26:43.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.513+0000 7f1be72c6700 1 -- 172.21.15.153:0/1435154124 shutdown_connections 2024-08-17T02:26:43.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.513+0000 7f1be72c6700 1 --2- 172.21.15.153:0/1435154124 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1bcc060860 0x7f1bcc062d10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.513+0000 7f1be72c6700 1 --2- 172.21.15.153:0/1435154124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1be0155d20 0x7f1be0146f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.513+0000 7f1be72c6700 1 --2- 172.21.15.153:0/1435154124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1be00ad7c0 0x7f1be0146960 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.513+0000 7f1be72c6700 1 --2- 172.21.15.153:0/1435154124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1be006df10 0x7f1be014a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.513+0000 7f1be72c6700 1 -- 172.21.15.153:0/1435154124 >> 172.21.15.153:0/1435154124 conn(0x7f1be00678d0 msgr2=0x7f1be006a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:43.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.513+0000 7f1be72c6700 1 -- 172.21.15.153:0/1435154124 shutdown_connections 2024-08-17T02:26:43.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.513+0000 7f1be72c6700 1 -- 172.21.15.153:0/1435154124 wait complete. 2024-08-17T02:26:43.529 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:58.093273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:26:09.856520+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:26:11.080706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:26:43.530 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:43.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.637+0000 7f800b937700 1 Processor -- start 2024-08-17T02:26:43.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.637+0000 7f800b937700 1 -- start start 2024-08-17T02:26:43.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.641+0000 7f800b937700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8004158fb0 0x7f8004159380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.641+0000 7f800b937700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f80040c8b70 0x7f80040699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.641+0000 7f800b937700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80040686a0 0x7f8004068b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.641+0000 7f800b937700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8004069ee0 con 0x7f8004158fb0 2024-08-17T02:26:43.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.641+0000 7f800b937700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8004069060 con 0x7f80040c8b70 2024-08-17T02:26:43.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.641+0000 7f800b937700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800406a3b0 con 0x7f80040686a0 2024-08-17T02:26:43.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.641+0000 7f80096d3700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8004158fb0 0x7f8004159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.641+0000 7f80096d3700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8004158fb0 0x7f8004159380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54920/0 (socket says 172.21.15.153:54920) 2024-08-17T02:26:43.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.641+0000 7f80096d3700 1 -- 172.21.15.153:0/1377931999 learned_addr learned my addr 172.21.15.153:0/1377931999 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:43.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.641+0000 7f8009ed4700 1 --2- 172.21.15.153:0/1377931999 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80040686a0 0x7f8004068b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.641+0000 7f8008ed2700 1 --2- 172.21.15.153:0/1377931999 >> v2:172.21.15.174:3300/0 conn(0x7f80040c8b70 0x7f80040699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.641+0000 7f80096d3700 1 -- 172.21.15.153:0/1377931999 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80040686a0 msgr2=0x7f8004068b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:43.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.641+0000 7f80096d3700 1 --2- 172.21.15.153:0/1377931999 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80040686a0 0x7f8004068b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.641+0000 7f80096d3700 1 -- 172.21.15.153:0/1377931999 >> v2:172.21.15.174:3300/0 conn(0x7f80040c8b70 msgr2=0x7f80040699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:43.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.641+0000 7f80096d3700 1 --2- 172.21.15.153:0/1377931999 >> v2:172.21.15.174:3300/0 conn(0x7f80040c8b70 0x7f80040699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.641+0000 7f80096d3700 1 -- 172.21.15.153:0/1377931999 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80040a9fe0 con 0x7f8004158fb0 2024-08-17T02:26:43.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.641+0000 7f80096d3700 1 --2- 172.21.15.153:0/1377931999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8004158fb0 0x7f8004159380 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f800406d6e0 tx=0x7f8000009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ec679e875c29e85 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:43.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.641+0000 7f7ffbfff700 1 -- 172.21.15.153:0/1377931999 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800000e070 con 0x7f8004158fb0 2024-08-17T02:26:43.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.641+0000 7f7ffbfff700 1 -- 172.21.15.153:0/1377931999 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800000b930 con 0x7f8004158fb0 2024-08-17T02:26:43.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.641+0000 7f7ffbfff700 1 -- 172.21.15.153:0/1377931999 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80000092e0 con 0x7f8004158fb0 2024-08-17T02:26:43.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.641+0000 7f800b937700 1 -- 172.21.15.153:0/1377931999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8004158fb0 msgr2=0x7f8004159380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.641+0000 7f800b937700 1 --2- 172.21.15.153:0/1377931999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8004158fb0 0x7f8004159380 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f800406d6e0 tx=0x7f8000009840 comp rx=0 tx=0).stop 2024-08-17T02:26:43.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.641+0000 7f800b937700 1 -- 172.21.15.153:0/1377931999 shutdown_connections 2024-08-17T02:26:43.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.641+0000 7f800b937700 1 --2- 172.21.15.153:0/1377931999 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80040686a0 0x7f8004068b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.641+0000 7f800b937700 1 --2- 172.21.15.153:0/1377931999 >> v2:172.21.15.174:3300/0 conn(0x7f80040c8b70 0x7f80040699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.641+0000 7f800b937700 1 --2- 172.21.15.153:0/1377931999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8004158fb0 0x7f8004159380 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.641+0000 7f800b937700 1 -- 172.21.15.153:0/1377931999 >> 172.21.15.153:0/1377931999 conn(0x7f80040c9bf0 msgr2=0x7f800406d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:43.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.641+0000 7f800b937700 1 -- 172.21.15.153:0/1377931999 shutdown_connections 2024-08-17T02:26:43.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.641+0000 7f800b937700 1 -- 172.21.15.153:0/1377931999 wait complete. 2024-08-17T02:26:43.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.641+0000 7f800b937700 1 Processor -- start 2024-08-17T02:26:43.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.641+0000 7f800b937700 1 -- start start 2024-08-17T02:26:43.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.645+0000 7f800b937700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80040686a0 0x7f800413da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.645+0000 7f800b937700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80040c8b70 0x7f80040ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.645+0000 7f800b937700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80040caec0 0x7f80040abc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.645+0000 7f800b937700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80040cb9a0 con 0x7f80040686a0 2024-08-17T02:26:43.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.645+0000 7f800b937700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800413dfd0 con 0x7f80040caec0 2024-08-17T02:26:43.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.645+0000 7f800b937700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8004156360 con 0x7f80040c8b70 2024-08-17T02:26:43.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.645+0000 7f80096d3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80040686a0 0x7f800413da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.645+0000 7f80096d3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80040686a0 0x7f800413da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54934/0 (socket says 172.21.15.153:54934) 2024-08-17T02:26:43.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.645+0000 7f80096d3700 1 -- 172.21.15.153:0/1049618480 learned_addr learned my addr 172.21.15.153:0/1049618480 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:43.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.645+0000 7f8008ed2700 1 --2- 172.21.15.153:0/1049618480 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80040c8b70 0x7f80040ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.645+0000 7f8009ed4700 1 --2- 172.21.15.153:0/1049618480 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80040caec0 0x7f80040abc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.645+0000 7f80096d3700 1 -- 172.21.15.153:0/1049618480 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80040c8b70 msgr2=0x7f80040ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.645+0000 7f80096d3700 1 --2- 172.21.15.153:0/1049618480 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80040c8b70 0x7f80040ca980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.645+0000 7f80096d3700 1 -- 172.21.15.153:0/1049618480 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80040caec0 msgr2=0x7f80040abc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.645+0000 7f80096d3700 1 --2- 172.21.15.153:0/1049618480 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80040caec0 0x7f80040abc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.645+0000 7f80096d3700 1 -- 172.21.15.153:0/1049618480 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8000009ae0 con 0x7f80040686a0 2024-08-17T02:26:43.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.645+0000 7f8009ed4700 1 --2- 172.21.15.153:0/1049618480 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80040caec0 0x7f80040abc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:43.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.645+0000 7f80096d3700 1 --2- 172.21.15.153:0/1049618480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80040686a0 0x7f800413da90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8000009ab0 tx=0x7f8000018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:43.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.645+0000 7f7ff97fa700 1 -- 172.21.15.153:0/1049618480 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80000087a0 con 0x7f80040686a0 2024-08-17T02:26:43.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.645+0000 7f7ff97fa700 1 -- 172.21.15.153:0/1049618480 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8000008920 con 0x7f80040686a0 2024-08-17T02:26:43.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.645+0000 7f7ff97fa700 1 -- 172.21.15.153:0/1049618480 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8000008ce0 con 0x7f80040686a0 2024-08-17T02:26:43.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.645+0000 7f800b937700 1 -- 172.21.15.153:0/1049618480 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80040cb3e0 con 0x7f80040686a0 2024-08-17T02:26:43.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.645+0000 7f800b937700 1 -- 172.21.15.153:0/1049618480 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8004155ff0 con 0x7f80040686a0 2024-08-17T02:26:43.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.645+0000 7f800b937700 1 -- 172.21.15.153:0/1049618480 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8004155e50 con 0x7f80040686a0 2024-08-17T02:26:43.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.649+0000 7f7ff97fa700 1 -- 172.21.15.153:0/1049618480 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8000003040 con 0x7f80040686a0 2024-08-17T02:26:43.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.649+0000 7f7ff97fa700 1 --2- 172.21.15.153:0/1049618480 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7fe8060860 0x7f7fe8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.649+0000 7f7ff97fa700 1 -- 172.21.15.153:0/1049618480 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f800007e150 con 0x7f80040686a0 2024-08-17T02:26:43.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.649+0000 7f8008ed2700 1 --2- 172.21.15.153:0/1049618480 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7fe8060860 0x7f7fe8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.649+0000 7f8008ed2700 1 --2- 172.21.15.153:0/1049618480 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7fe8060860 0x7f7fe8062d10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8004154e60 tx=0x7f7ff40091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:43.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.653+0000 7f7ff97fa700 1 -- 172.21.15.153:0/1049618480 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f8004155e50 con 0x7f80040686a0 2024-08-17T02:26:43.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.817+0000 7f800b937700 1 -- 172.21.15.153:0/1049618480 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8004155e50 con 0x7f80040686a0 2024-08-17T02:26:43.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.821+0000 7f7ff97fa700 1 -- 172.21.15.153:0/1049618480 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8004155e50 con 0x7f80040686a0 2024-08-17T02:26:43.822 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2024-08-17T02:26:43.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.821+0000 7f800b937700 1 -- 172.21.15.153:0/1049618480 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7fe8060860 msgr2=0x7f7fe8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.821+0000 7f800b937700 1 --2- 172.21.15.153:0/1049618480 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7fe8060860 0x7f7fe8062d10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8004154e60 tx=0x7f7ff40091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.821+0000 7f800b937700 1 -- 172.21.15.153:0/1049618480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80040686a0 msgr2=0x7f800413da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.821+0000 7f800b937700 1 --2- 172.21.15.153:0/1049618480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80040686a0 0x7f800413da90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8000009ab0 tx=0x7f8000018000 comp rx=0 tx=0).stop 2024-08-17T02:26:43.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.821+0000 7f800b937700 1 -- 172.21.15.153:0/1049618480 shutdown_connections 2024-08-17T02:26:43.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.821+0000 7f800b937700 1 --2- 172.21.15.153:0/1049618480 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7fe8060860 0x7f7fe8062d10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.821+0000 7f800b937700 1 --2- 172.21.15.153:0/1049618480 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80040caec0 0x7f80040abc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.821+0000 7f800b937700 1 --2- 172.21.15.153:0/1049618480 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80040c8b70 0x7f80040ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.821+0000 7f800b937700 1 --2- 172.21.15.153:0/1049618480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80040686a0 0x7f800413da90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.821+0000 7f800b937700 1 -- 172.21.15.153:0/1049618480 >> 172.21.15.153:0/1049618480 conn(0x7f80040c9bf0 msgr2=0x7f80040af9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:43.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.821+0000 7f800b937700 1 -- 172.21.15.153:0/1049618480 shutdown_connections 2024-08-17T02:26:43.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.821+0000 7f800b937700 1 -- 172.21.15.153:0/1049618480 wait complete. 2024-08-17T02:26:43.837 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:26:43.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.945+0000 7f014d853700 1 Processor -- start 2024-08-17T02:26:43.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.945+0000 7f014d853700 1 -- start start 2024-08-17T02:26:43.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f014d853700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f014813f680 0x7f01480aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f014d853700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f01480ad6c0 0x7f014806e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f014d853700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01480b0810 con 0x7f014813fa50 2024-08-17T02:26:43.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f014d853700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01480afc70 con 0x7f01480ad6c0 2024-08-17T02:26:43.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f014d853700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01480af060 con 0x7f014813f680 2024-08-17T02:26:43.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f0147fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f014813fa50 0x7f01480b0100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:55500/0 (socket says 172.21.15.153:55500) 2024-08-17T02:26:43.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f0147fff700 1 -- 172.21.15.153:0/1396001621 learned_addr learned my addr 172.21.15.153:0/1396001621 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:43.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f014d052700 1 --2- 172.21.15.153:0/1396001621 >> v2:172.21.15.174:3300/0 conn(0x7f01480ad6c0 0x7f014806e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f014c851700 1 --2- 172.21.15.153:0/1396001621 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f014813f680 0x7f01480aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f01477fe700 1 -- 172.21.15.153:0/1396001621 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2029061438 0 0) 0x7f01480b0810 con 0x7f014813fa50 2024-08-17T02:26:43.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f01477fe700 1 -- 172.21.15.153:0/1396001621 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0130003570 con 0x7f014813fa50 2024-08-17T02:26:43.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f01477fe700 1 -- 172.21.15.153:0/1396001621 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3546240477 0 0) 0x7f0130003570 con 0x7f014813fa50 2024-08-17T02:26:43.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f01477fe700 1 -- 172.21.15.153:0/1396001621 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f014813f680 msgr2=0x7f01480aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:43.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f01477fe700 1 --2- 172.21.15.153:0/1396001621 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f014813f680 0x7f01480aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f01477fe700 1 -- 172.21.15.153:0/1396001621 >> v2:172.21.15.174:3300/0 conn(0x7f01480ad6c0 msgr2=0x7f014806e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:43.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f01477fe700 1 --2- 172.21.15.153:0/1396001621 >> v2:172.21.15.174:3300/0 conn(0x7f01480ad6c0 0x7f014806e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f01477fe700 1 -- 172.21.15.153:0/1396001621 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01480af340 con 0x7f014813fa50 2024-08-17T02:26:43.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f01477fe700 1 -- 172.21.15.153:0/1396001621 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3701463666 0 0) 0x7f0138001470 con 0x7f014813fa50 2024-08-17T02:26:43.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f01477fe700 1 -- 172.21.15.153:0/1396001621 >> v1:172.21.15.153:6789/0 conn(0x7f014813fa50 legacy=0x7f01480b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f01477fe700 1 --2- 172.21.15.153:0/1396001621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0130003a60 0x7f0130003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f01477fe700 1 --2- 172.21.15.153:0/1396001621 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0130004810 0x7f0130004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f01477fe700 1 --2- 172.21.15.153:0/1396001621 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f014813f680 0x7f01300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f01477fe700 1 -- 172.21.15.153:0/1396001621 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01480afc70 con 0x7f0130003a60 2024-08-17T02:26:43.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f01477fe700 1 -- 172.21.15.153:0/1396001621 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01480af060 con 0x7f0130004810 2024-08-17T02:26:43.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f01477fe700 1 -- 172.21.15.153:0/1396001621 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f013000ba60 con 0x7f014813f680 2024-08-17T02:26:43.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f014c851700 1 --2- 172.21.15.153:0/1396001621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0130003a60 0x7f0130003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f0147fff700 1 --2- 172.21.15.153:0/1396001621 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0130004810 0x7f0130004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f014d052700 1 --2- 172.21.15.153:0/1396001621 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f014813f680 0x7f01300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f014c851700 1 -- 172.21.15.153:0/1396001621 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f014813f680 msgr2=0x7f01300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:43.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f014c851700 1 --2- 172.21.15.153:0/1396001621 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f014813f680 0x7f01300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f014c851700 1 -- 172.21.15.153:0/1396001621 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0130004810 msgr2=0x7f0130004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:43.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f014c851700 1 --2- 172.21.15.153:0/1396001621 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0130004810 0x7f0130004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f014c851700 1 -- 172.21.15.153:0/1396001621 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0130003570 con 0x7f0130003a60 2024-08-17T02:26:43.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f014d052700 1 --2- 172.21.15.153:0/1396001621 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f014813f680 0x7f01300051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:43.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f014c851700 1 --2- 172.21.15.153:0/1396001621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0130003a60 0x7f0130003e70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f013c009c30 tx=0x7f013c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b1f388550f30490 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:43.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f01477fe700 1 -- 172.21.15.153:0/1396001621 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c00e710 con 0x7f0130003a60 2024-08-17T02:26:43.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f01477fe700 1 -- 172.21.15.153:0/1396001621 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013c00e870 con 0x7f0130003a60 2024-08-17T02:26:43.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f01477fe700 1 -- 172.21.15.153:0/1396001621 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c00ec30 con 0x7f0130003a60 2024-08-17T02:26:43.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f014d853700 1 -- 172.21.15.153:0/1396001621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0130003a60 msgr2=0x7f0130003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f014d853700 1 --2- 172.21.15.153:0/1396001621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0130003a60 0x7f0130003e70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f013c009c30 tx=0x7f013c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f014d052700 1 -- 172.21.15.153:0/1396001621 reap_dead start 2024-08-17T02:26:43.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f014d853700 1 -- 172.21.15.153:0/1396001621 shutdown_connections 2024-08-17T02:26:43.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f014d853700 1 -- 172.21.15.153:0/1396001621 >> 172.21.15.153:0/1396001621 conn(0x7f01480678a0 msgr2=0x7f0148067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:43.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f014d853700 1 -- 172.21.15.153:0/1396001621 shutdown_connections 2024-08-17T02:26:43.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.949+0000 7f014d853700 1 -- 172.21.15.153:0/1396001621 wait complete. 2024-08-17T02:26:43.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.953+0000 7f014d853700 1 Processor -- start 2024-08-17T02:26:43.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.953+0000 7f014d853700 1 -- start start 2024-08-17T02:26:43.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.953+0000 7f014d853700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0130003a60 0x7f014814ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.953+0000 7f014d853700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f014812ef00 0x7f014814b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.953+0000 7f014d853700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0148158170 0x7f0148158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.953+0000 7f014d853700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014812f970 con 0x7f0130003a60 2024-08-17T02:26:43.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.953+0000 7f014d853700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014814cd20 con 0x7f0148158170 2024-08-17T02:26:43.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.953+0000 7f014d853700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014812fbc0 con 0x7f014812ef00 2024-08-17T02:26:43.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.953+0000 7f014c851700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0130003a60 0x7f014814ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.953+0000 7f014c851700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0130003a60 0x7f014814ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54948/0 (socket says 172.21.15.153:54948) 2024-08-17T02:26:43.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.953+0000 7f014c851700 1 -- 172.21.15.153:0/759375277 learned_addr learned my addr 172.21.15.153:0/759375277 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:43.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.953+0000 7f0147fff700 1 --2- 172.21.15.153:0/759375277 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f014812ef00 0x7f014814b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.953+0000 7f014d052700 1 --2- 172.21.15.153:0/759375277 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0148158170 0x7f0148158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.953+0000 7f014c851700 1 -- 172.21.15.153:0/759375277 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f014812ef00 msgr2=0x7f014814b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.953+0000 7f014c851700 1 --2- 172.21.15.153:0/759375277 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f014812ef00 0x7f014814b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.953+0000 7f014c851700 1 -- 172.21.15.153:0/759375277 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0148158170 msgr2=0x7f0148158610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.953+0000 7f014c851700 1 --2- 172.21.15.153:0/759375277 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0148158170 0x7f0148158610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.953+0000 7f014c851700 1 -- 172.21.15.153:0/759375277 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014814e100 con 0x7f0130003a60 2024-08-17T02:26:43.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.953+0000 7f014c851700 1 --2- 172.21.15.153:0/759375277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0130003a60 0x7f014814ad30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f013c00e4b0 tx=0x7f013c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:43.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.953+0000 7f0144ff9700 1 -- 172.21.15.153:0/759375277 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c023070 con 0x7f0130003a60 2024-08-17T02:26:43.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.953+0000 7f0144ff9700 1 -- 172.21.15.153:0/759375277 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013c00e9e0 con 0x7f0130003a60 2024-08-17T02:26:43.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.953+0000 7f014d853700 1 -- 172.21.15.153:0/759375277 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f014814e3e0 con 0x7f0130003a60 2024-08-17T02:26:43.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.953+0000 7f0144ff9700 1 -- 172.21.15.153:0/759375277 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c01e030 con 0x7f0130003a60 2024-08-17T02:26:43.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.953+0000 7f014d853700 1 -- 172.21.15.153:0/759375277 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0148149fe0 con 0x7f0130003a60 2024-08-17T02:26:43.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.957+0000 7f0144ff9700 1 -- 172.21.15.153:0/759375277 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f013c013470 con 0x7f0130003a60 2024-08-17T02:26:43.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.957+0000 7f014d853700 1 -- 172.21.15.153:0/759375277 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0148064330 con 0x7f0130003a60 2024-08-17T02:26:43.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.957+0000 7f0144ff9700 1 --2- 172.21.15.153:0/759375277 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f0134060890 0x7f0134062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.957+0000 7f0144ff9700 1 -- 172.21.15.153:0/759375277 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f013c07e230 con 0x7f0130003a60 2024-08-17T02:26:43.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.957+0000 7f0147fff700 1 --2- 172.21.15.153:0/759375277 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f0134060890 0x7f0134062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.957+0000 7f0147fff700 1 --2- 172.21.15.153:0/759375277 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f0134060890 0x7f0134062d40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0138001d20 tx=0x7f0138009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:43.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:43.965+0000 7f0144ff9700 1 -- 172.21.15.153:0/759375277 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f013c052110 con 0x7f0130003a60 2024-08-17T02:26:44.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.125+0000 7f014d853700 1 -- 172.21.15.153:0/759375277 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f014812f970 con 0x7f0130003a60 2024-08-17T02:26:44.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.129+0000 7f0144ff9700 1 -- 172.21.15.153:0/759375277 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f013c051ca0 con 0x7f0130003a60 2024-08-17T02:26:44.131 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2024-08-17T02:26:44.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.129+0000 7f014d853700 1 -- 172.21.15.153:0/759375277 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f0134060890 msgr2=0x7f0134062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.129+0000 7f014d853700 1 --2- 172.21.15.153:0/759375277 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f0134060890 0x7f0134062d40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0138001d20 tx=0x7f0138009040 comp rx=0 tx=0).stop 2024-08-17T02:26:44.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.129+0000 7f014d853700 1 -- 172.21.15.153:0/759375277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0130003a60 msgr2=0x7f014814ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.129+0000 7f014d853700 1 --2- 172.21.15.153:0/759375277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0130003a60 0x7f014814ad30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f013c00e4b0 tx=0x7f013c01a000 comp rx=0 tx=0).stop 2024-08-17T02:26:44.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.129+0000 7f014d853700 1 -- 172.21.15.153:0/759375277 shutdown_connections 2024-08-17T02:26:44.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.129+0000 7f014d853700 1 --2- 172.21.15.153:0/759375277 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f0134060890 0x7f0134062d40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.129+0000 7f014d853700 1 --2- 172.21.15.153:0/759375277 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0148158170 0x7f0148158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.129+0000 7f014d853700 1 --2- 172.21.15.153:0/759375277 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f014812ef00 0x7f014814b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.129+0000 7f014d853700 1 --2- 172.21.15.153:0/759375277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0130003a60 0x7f014814ad30 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.129+0000 7f014d853700 1 -- 172.21.15.153:0/759375277 >> 172.21.15.153:0/759375277 conn(0x7f01480678a0 msgr2=0x7f0148131580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:44.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.129+0000 7f014d853700 1 -- 172.21.15.153:0/759375277 shutdown_connections 2024-08-17T02:26:44.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.129+0000 7f014d853700 1 -- 172.21.15.153:0/759375277 wait complete. 2024-08-17T02:26:44.149 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:26:44.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.257+0000 7fb4419b0700 1 Processor -- start 2024-08-17T02:26:44.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.257+0000 7fb4419b0700 1 -- start start 2024-08-17T02:26:44.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.261+0000 7fb4419b0700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb43c1597d0 0x7fb43c0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.261+0000 7fb4419b0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb43c06bac0 0x7fb43c0686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.261+0000 7fb4419b0700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb43c0adb00 con 0x7fb43c159400 2024-08-17T02:26:44.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.261+0000 7fb4419b0700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb43c06bf60 con 0x7fb43c1597d0 2024-08-17T02:26:44.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.261+0000 7fb4419b0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c0ac630 con 0x7fb43c06bac0 2024-08-17T02:26:44.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.261+0000 7fb43affd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb43c159400 0x7fb43c0ad3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:55508/0 (socket says 172.21.15.153:55508) 2024-08-17T02:26:44.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.261+0000 7fb43affd700 1 -- 172.21.15.153:0/453706977 learned_addr learned my addr 172.21.15.153:0/453706977 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:44.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.261+0000 7fb43a7fc700 1 --2- 172.21.15.153:0/453706977 >> v2:172.21.15.153:3300/0 conn(0x7fb43c1597d0 0x7fb43c0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.261+0000 7fb43b7fe700 1 --2- 172.21.15.153:0/453706977 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb43c06bac0 0x7fb43c0686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.261+0000 7fb439ffb700 1 -- 172.21.15.153:0/453706977 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1398344448 0 0) 0x7fb43c0adb00 con 0x7fb43c159400 2024-08-17T02:26:44.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.261+0000 7fb439ffb700 1 -- 172.21.15.153:0/453706977 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb428003570 con 0x7fb43c159400 2024-08-17T02:26:44.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.261+0000 7fb43a7fc700 1 -- 172.21.15.153:0/453706977 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb43c06bac0 msgr2=0x7fb43c0686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:44.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.261+0000 7fb43a7fc700 1 --2- 172.21.15.153:0/453706977 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb43c06bac0 0x7fb43c0686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.261+0000 7fb43a7fc700 1 -- 172.21.15.153:0/453706977 >> v1:172.21.15.153:6789/0 conn(0x7fb43c159400 legacy=0x7fb43c0ad3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.261+0000 7fb43a7fc700 1 -- 172.21.15.153:0/453706977 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43c0ac910 con 0x7fb43c1597d0 2024-08-17T02:26:44.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.261+0000 7fb43a7fc700 1 --2- 172.21.15.153:0/453706977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb43c1597d0 0x7fb43c0b1c00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb4240098e0 tx=0x7fb4240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e0a19b91a18f14 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:44.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.261+0000 7fb439ffb700 1 -- 172.21.15.153:0/453706977 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb424011630 con 0x7fb43c1597d0 2024-08-17T02:26:44.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.261+0000 7fb439ffb700 1 -- 172.21.15.153:0/453706977 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb424011790 con 0x7fb43c1597d0 2024-08-17T02:26:44.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.261+0000 7fb439ffb700 1 -- 172.21.15.153:0/453706977 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb424011b30 con 0x7fb43c1597d0 2024-08-17T02:26:44.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.261+0000 7fb4419b0700 1 -- 172.21.15.153:0/453706977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb43c1597d0 msgr2=0x7fb43c0b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.261+0000 7fb4419b0700 1 --2- 172.21.15.153:0/453706977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb43c1597d0 0x7fb43c0b1c00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb4240098e0 tx=0x7fb4240091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.261+0000 7fb4419b0700 1 -- 172.21.15.153:0/453706977 shutdown_connections 2024-08-17T02:26:44.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.261+0000 7fb4419b0700 1 --2- 172.21.15.153:0/453706977 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb43c06bac0 0x7fb43c0686a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.261+0000 7fb4419b0700 1 --2- 172.21.15.153:0/453706977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb43c1597d0 0x7fb43c0b1c00 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.261+0000 7fb4419b0700 1 -- 172.21.15.153:0/453706977 >> 172.21.15.153:0/453706977 conn(0x7fb43c0c9bf0 msgr2=0x7fb43c06d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:44.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.261+0000 7fb4419b0700 1 -- 172.21.15.153:0/453706977 shutdown_connections 2024-08-17T02:26:44.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.261+0000 7fb4419b0700 1 -- 172.21.15.153:0/453706977 wait complete. 2024-08-17T02:26:44.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.265+0000 7fb4419b0700 1 Processor -- start 2024-08-17T02:26:44.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.265+0000 7fb4419b0700 1 -- start start 2024-08-17T02:26:44.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.265+0000 7fb4419b0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb43c06bac0 0x7fb43c0aac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.265+0000 7fb4419b0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb43c159400 0x7fb43c0b0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.265+0000 7fb4419b0700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb43c1597d0 0x7fb43c0b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.265+0000 7fb4419b0700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c153b60 con 0x7fb43c06bac0 2024-08-17T02:26:44.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.265+0000 7fb4419b0700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c166d40 con 0x7fb43c1597d0 2024-08-17T02:26:44.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.265+0000 7fb4419b0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c1675e0 con 0x7fb43c159400 2024-08-17T02:26:44.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.265+0000 7fb43affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb43c06bac0 0x7fb43c0aac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.265+0000 7fb43affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb43c06bac0 0x7fb43c0aac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54970/0 (socket says 172.21.15.153:54970) 2024-08-17T02:26:44.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.265+0000 7fb43affd700 1 -- 172.21.15.153:0/1632501872 learned_addr learned my addr 172.21.15.153:0/1632501872 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:44.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.265+0000 7fb43a7fc700 1 --2- 172.21.15.153:0/1632501872 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb43c159400 0x7fb43c0b0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.265+0000 7fb43b7fe700 1 --2- 172.21.15.153:0/1632501872 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb43c1597d0 0x7fb43c0b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.265+0000 7fb43affd700 1 -- 172.21.15.153:0/1632501872 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb43c159400 msgr2=0x7fb43c0b0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.265+0000 7fb43affd700 1 --2- 172.21.15.153:0/1632501872 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb43c159400 0x7fb43c0b0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.265+0000 7fb43affd700 1 -- 172.21.15.153:0/1632501872 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb43c1597d0 msgr2=0x7fb43c0b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.265+0000 7fb43affd700 1 --2- 172.21.15.153:0/1632501872 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb43c1597d0 0x7fb43c0b0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.265+0000 7fb43affd700 1 -- 172.21.15.153:0/1632501872 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb424009420 con 0x7fb43c06bac0 2024-08-17T02:26:44.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.265+0000 7fb43affd700 1 --2- 172.21.15.153:0/1632501872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb43c06bac0 0x7fb43c0aac60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb43400cd60 tx=0x7fb434001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:44.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.265+0000 7fb432ffd700 1 -- 172.21.15.153:0/1632501872 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43400aa80 con 0x7fb43c06bac0 2024-08-17T02:26:44.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.265+0000 7fb432ffd700 1 -- 172.21.15.153:0/1632501872 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43400ac00 con 0x7fb43c06bac0 2024-08-17T02:26:44.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.265+0000 7fb4419b0700 1 -- 172.21.15.153:0/1632501872 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb43c1669c0 con 0x7fb43c06bac0 2024-08-17T02:26:44.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.265+0000 7fb432ffd700 1 -- 172.21.15.153:0/1632501872 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4340070f0 con 0x7fb43c06bac0 2024-08-17T02:26:44.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.265+0000 7fb4419b0700 1 -- 172.21.15.153:0/1632501872 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb43c167270 con 0x7fb43c06bac0 2024-08-17T02:26:44.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.269+0000 7fb4419b0700 1 -- 172.21.15.153:0/1632501872 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb43c0645c0 con 0x7fb43c06bac0 2024-08-17T02:26:44.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.269+0000 7fb432ffd700 1 -- 172.21.15.153:0/1632501872 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb4340074e0 con 0x7fb43c06bac0 2024-08-17T02:26:44.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.269+0000 7fb432ffd700 1 --2- 172.21.15.153:0/1632501872 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb41c060890 0x7fb41c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.269+0000 7fb432ffd700 1 -- 172.21.15.153:0/1632501872 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb43407cfd0 con 0x7fb43c06bac0 2024-08-17T02:26:44.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.269+0000 7fb43a7fc700 1 --2- 172.21.15.153:0/1632501872 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb41c060890 0x7fb41c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.273+0000 7fb43a7fc700 1 --2- 172.21.15.153:0/1632501872 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb41c060890 0x7fb41c062d40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb4240091e0 tx=0x7fb424017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:44.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.277+0000 7fb432ffd700 1 -- 172.21.15.153:0/1632501872 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb43404d400 con 0x7fb43c06bac0 2024-08-17T02:26:44.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.437+0000 7fb4419b0700 1 -- 172.21.15.153:0/1632501872 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb43c156fc0 con 0x7fb43c06bac0 2024-08-17T02:26:44.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.437+0000 7fb432ffd700 1 -- 172.21.15.153:0/1632501872 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb434050a20 con 0x7fb43c06bac0 2024-08-17T02:26:44.439 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2024-08-17T02:26:44.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.437+0000 7fb4419b0700 1 -- 172.21.15.153:0/1632501872 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb41c060890 msgr2=0x7fb41c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.437+0000 7fb4419b0700 1 --2- 172.21.15.153:0/1632501872 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb41c060890 0x7fb41c062d40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb4240091e0 tx=0x7fb424017000 comp rx=0 tx=0).stop 2024-08-17T02:26:44.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.437+0000 7fb4419b0700 1 -- 172.21.15.153:0/1632501872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb43c06bac0 msgr2=0x7fb43c0aac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.437+0000 7fb4419b0700 1 --2- 172.21.15.153:0/1632501872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb43c06bac0 0x7fb43c0aac60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb43400cd60 tx=0x7fb434001b10 comp rx=0 tx=0).stop 2024-08-17T02:26:44.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.437+0000 7fb4419b0700 1 -- 172.21.15.153:0/1632501872 shutdown_connections 2024-08-17T02:26:44.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.437+0000 7fb4419b0700 1 --2- 172.21.15.153:0/1632501872 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb41c060890 0x7fb41c062d40 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.437+0000 7fb4419b0700 1 --2- 172.21.15.153:0/1632501872 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb43c1597d0 0x7fb43c0b0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.437+0000 7fb4419b0700 1 --2- 172.21.15.153:0/1632501872 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb43c159400 0x7fb43c0b0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.437+0000 7fb4419b0700 1 --2- 172.21.15.153:0/1632501872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb43c06bac0 0x7fb43c0aac60 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.437+0000 7fb4419b0700 1 -- 172.21.15.153:0/1632501872 >> 172.21.15.153:0/1632501872 conn(0x7fb43c0c9bf0 msgr2=0x7fb43c157aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:44.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.437+0000 7fb4419b0700 1 -- 172.21.15.153:0/1632501872 shutdown_connections 2024-08-17T02:26:44.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.437+0000 7fb4419b0700 1 -- 172.21.15.153:0/1632501872 wait complete. 2024-08-17T02:26:44.453 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:44.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.557+0000 7f9390907700 1 Processor -- start 2024-08-17T02:26:44.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.561+0000 7f9390907700 1 -- start start 2024-08-17T02:26:44.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.561+0000 7f9390907700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f938c0ab540 0x7f938c0b1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.561+0000 7f9390907700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f938c06e370 0x7f938c155010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.561+0000 7f9390907700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f938c06f0e0 con 0x7f938c06df10 2024-08-17T02:26:44.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.561+0000 7f9390907700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f938c0aba70 con 0x7f938c06e370 2024-08-17T02:26:44.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.561+0000 7f9390907700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f938c0abd50 con 0x7f938c0ab540 2024-08-17T02:26:44.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.561+0000 7f938bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f938c06e370 0x7f938c155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.561+0000 7f938b7fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f938c0ab540 0x7f938c0b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.561+0000 7f938b7fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f938c0ab540 0x7f938c0b1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.153:43602/0 (socket says 172.21.15.153:43602) 2024-08-17T02:26:44.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.561+0000 7f938b7fe700 1 -- 172.21.15.153:0/3275443649 learned_addr learned my addr 172.21.15.153:0/3275443649 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:44.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.561+0000 7f938bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f938c06e370 0x7f938c155010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54978/0 (socket says 172.21.15.153:54978) 2024-08-17T02:26:44.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.561+0000 7f9382ffd700 1 --1- 172.21.15.153:0/3275443649 >> v1:172.21.15.174:6789/0 conn(0x7f938c06df10 0x7f938c06e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.153:43584/0 (socket says 172.21.15.153:43584) 2024-08-17T02:26:44.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.561+0000 7f938b7fe700 1 -- 172.21.15.153:0/3275443649 >> v2:172.21.15.153:3300/0 conn(0x7f938c06e370 msgr2=0x7f938c155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:44.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.561+0000 7f938b7fe700 1 --2- 172.21.15.153:0/3275443649 >> v2:172.21.15.153:3300/0 conn(0x7f938c06e370 0x7f938c155010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.561+0000 7f938b7fe700 1 -- 172.21.15.153:0/3275443649 >> v1:172.21.15.174:6789/0 conn(0x7f938c06df10 legacy=0x7f938c06e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.561+0000 7f938b7fe700 1 -- 172.21.15.153:0/3275443649 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938c0ac030 con 0x7f938c0ab540 2024-08-17T02:26:44.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.561+0000 7f938b7fe700 1 --2- 172.21.15.153:0/3275443649 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f938c0ab540 0x7f938c0b1320 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f938c06c910 tx=0x7f937c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f27da0f261bbb10 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:44.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.561+0000 7f938affd700 1 -- 172.21.15.153:0/3275443649 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c009e70 con 0x7f938c0ab540 2024-08-17T02:26:44.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.561+0000 7f938affd700 1 -- 172.21.15.153:0/3275443649 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937c00b760 con 0x7f938c0ab540 2024-08-17T02:26:44.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.561+0000 7f938affd700 1 -- 172.21.15.153:0/3275443649 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c00bb00 con 0x7f938c0ab540 2024-08-17T02:26:44.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.561+0000 7f9390907700 1 -- 172.21.15.153:0/3275443649 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f938c0ab540 msgr2=0x7f938c0b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.561+0000 7f9390907700 1 --2- 172.21.15.153:0/3275443649 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f938c0ab540 0x7f938c0b1320 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f938c06c910 tx=0x7f937c009250 comp rx=0 tx=0).stop 2024-08-17T02:26:44.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.561+0000 7f9390907700 1 -- 172.21.15.153:0/3275443649 shutdown_connections 2024-08-17T02:26:44.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.561+0000 7f9390907700 1 --2- 172.21.15.153:0/3275443649 >> v2:172.21.15.153:3300/0 conn(0x7f938c06e370 0x7f938c155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.565+0000 7f9390907700 1 --2- 172.21.15.153:0/3275443649 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f938c0ab540 0x7f938c0b1320 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.565+0000 7f9390907700 1 -- 172.21.15.153:0/3275443649 >> 172.21.15.153:0/3275443649 conn(0x7f938c0678d0 msgr2=0x7f938c067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:44.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.565+0000 7f9390907700 1 -- 172.21.15.153:0/3275443649 shutdown_connections 2024-08-17T02:26:44.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.565+0000 7f9390907700 1 -- 172.21.15.153:0/3275443649 wait complete. 2024-08-17T02:26:44.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.565+0000 7f9390907700 1 Processor -- start 2024-08-17T02:26:44.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.565+0000 7f9390907700 1 -- start start 2024-08-17T02:26:44.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.565+0000 7f9390907700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f938c06df10 0x7f938c0aac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.565+0000 7f9390907700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f938c06e370 0x7f938c143120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.565+0000 7f9390907700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f938c0ab540 0x7f938c0ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.565+0000 7f9390907700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c0aa870 con 0x7f938c0ab540 2024-08-17T02:26:44.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.565+0000 7f9390907700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c145a90 con 0x7f938c06e370 2024-08-17T02:26:44.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.565+0000 7f9390907700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f938c0a9cf0 con 0x7f938c06df10 2024-08-17T02:26:44.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.565+0000 7f938bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f938c0ab540 0x7f938c0ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.565+0000 7f938bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f938c0ab540 0x7f938c0ad1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54984/0 (socket says 172.21.15.153:54984) 2024-08-17T02:26:44.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.565+0000 7f9382ffd700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f938c06e370 0x7f938c143120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.565+0000 7f938bfff700 1 -- 172.21.15.153:0/2626608040 learned_addr learned my addr 172.21.15.153:0/2626608040 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:44.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.565+0000 7f938b7fe700 1 --2- 172.21.15.153:0/2626608040 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f938c06df10 0x7f938c0aac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.565+0000 7f938bfff700 1 -- 172.21.15.153:0/2626608040 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f938c06df10 msgr2=0x7f938c0aac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.565+0000 7f938bfff700 1 --2- 172.21.15.153:0/2626608040 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f938c06df10 0x7f938c0aac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.565+0000 7f938bfff700 1 -- 172.21.15.153:0/2626608040 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f938c06e370 msgr2=0x7f938c143120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.565+0000 7f938bfff700 1 --2- 172.21.15.153:0/2626608040 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f938c06e370 0x7f938c143120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.565+0000 7f938bfff700 1 -- 172.21.15.153:0/2626608040 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f937c0094f0 con 0x7f938c0ab540 2024-08-17T02:26:44.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.565+0000 7f938bfff700 1 --2- 172.21.15.153:0/2626608040 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f938c0ab540 0x7f938c0ad1b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9384009e90 tx=0x7f938400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:44.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.565+0000 7f9383fff700 1 -- 172.21.15.153:0/2626608040 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938400cb70 con 0x7f938c0ab540 2024-08-17T02:26:44.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.565+0000 7f9390907700 1 -- 172.21.15.153:0/2626608040 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f938c0a9fd0 con 0x7f938c0ab540 2024-08-17T02:26:44.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.565+0000 7f9383fff700 1 -- 172.21.15.153:0/2626608040 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f938400f040 con 0x7f938c0ab540 2024-08-17T02:26:44.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.565+0000 7f9383fff700 1 -- 172.21.15.153:0/2626608040 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9384014480 con 0x7f938c0ab540 2024-08-17T02:26:44.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.565+0000 7f9390907700 1 -- 172.21.15.153:0/2626608040 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f938c0aa590 con 0x7f938c0ab540 2024-08-17T02:26:44.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.569+0000 7f9390907700 1 -- 172.21.15.153:0/2626608040 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f938c145bd0 con 0x7f938c0ab540 2024-08-17T02:26:44.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.569+0000 7f9383fff700 1 -- 172.21.15.153:0/2626608040 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9384014830 con 0x7f938c0ab540 2024-08-17T02:26:44.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.569+0000 7f9383fff700 1 --2- 172.21.15.153:0/2626608040 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f936c060860 0x7f936c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.569+0000 7f9383fff700 1 -- 172.21.15.153:0/2626608040 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f938407d880 con 0x7f938c0ab540 2024-08-17T02:26:44.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.569+0000 7f938b7fe700 1 --2- 172.21.15.153:0/2626608040 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f936c060860 0x7f936c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.573+0000 7f938b7fe700 1 --2- 172.21.15.153:0/2626608040 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f936c060860 0x7f936c062d10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f938c06c910 tx=0x7f937c016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:44.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.577+0000 7f9383fff700 1 -- 172.21.15.153:0/2626608040 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f938404dcd0 con 0x7f938c0ab540 2024-08-17T02:26:44.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.777+0000 7f9390907700 1 -- 172.21.15.153:0/2626608040 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f938c0643a0 con 0x7f938c0ab540 2024-08-17T02:26:44.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.781+0000 7f9383fff700 1 -- 172.21.15.153:0/2626608040 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f9384018090 con 0x7f938c0ab540 2024-08-17T02:26:44.783 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:44.783 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/610991976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":610991976},{"type":"v1","addr":"172.21.15.153:6835","nonce":610991976}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/3521472122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3521472122},{"type":"v1","addr":"172.21.15.153:6837","nonce":3521472122}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1184225885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1184225885},{"type":"v1","addr":"172.21.15.174:6833","nonce":1184225885}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:12.082812+0000","modified":"2024-08-17T02:26:14.770527+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/477398839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":477398839},{"type":"v1","addr":"172.21.15.174:6835","nonce":477398839}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:26:44.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.781+0000 7f9390907700 1 -- 172.21.15.153:0/2626608040 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f936c060860 msgr2=0x7f936c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.781+0000 7f9390907700 1 --2- 172.21.15.153:0/2626608040 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f936c060860 0x7f936c062d10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f938c06c910 tx=0x7f937c016000 comp rx=0 tx=0).stop 2024-08-17T02:26:44.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.781+0000 7f9390907700 1 -- 172.21.15.153:0/2626608040 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f938c0ab540 msgr2=0x7f938c0ad1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.781+0000 7f9390907700 1 --2- 172.21.15.153:0/2626608040 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f938c0ab540 0x7f938c0ad1b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9384009e90 tx=0x7f938400b040 comp rx=0 tx=0).stop 2024-08-17T02:26:44.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.781+0000 7f9390907700 1 -- 172.21.15.153:0/2626608040 shutdown_connections 2024-08-17T02:26:44.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.781+0000 7f9390907700 1 --2- 172.21.15.153:0/2626608040 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f936c060860 0x7f936c062d10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.781+0000 7f9390907700 1 --2- 172.21.15.153:0/2626608040 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f938c0ab540 0x7f938c0ad1b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.781+0000 7f9390907700 1 --2- 172.21.15.153:0/2626608040 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f938c06e370 0x7f938c143120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.781+0000 7f9390907700 1 --2- 172.21.15.153:0/2626608040 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f938c06df10 0x7f938c0aac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.781+0000 7f9390907700 1 -- 172.21.15.153:0/2626608040 >> 172.21.15.153:0/2626608040 conn(0x7f938c0678d0 msgr2=0x7f938c1507c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:44.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.781+0000 7f9390907700 1 -- 172.21.15.153:0/2626608040 shutdown_connections 2024-08-17T02:26:44.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.781+0000 7f9390907700 1 -- 172.21.15.153:0/2626608040 wait complete. 2024-08-17T02:26:44.787 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 6 2024-08-17T02:26:44.797 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:44.901 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.897+0000 7f96373c3700 1 Processor -- start 2024-08-17T02:26:44.901 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.897+0000 7f96373c3700 1 -- start start 2024-08-17T02:26:44.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.897+0000 7f96373c3700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f96300aedf0 0x7f96300af1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.897+0000 7f96373c3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f96301571c0 0x7f9630067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.897+0000 7f96373c3700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96300c95f0 con 0x7f9630067690 2024-08-17T02:26:44.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.897+0000 7f96373c3700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96300b28c0 con 0x7f96300aedf0 2024-08-17T02:26:44.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.897+0000 7f96373c3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96300b1f90 con 0x7f96301571c0 2024-08-17T02:26:44.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.901+0000 7f96363c1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f96300aedf0 0x7f96300af1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.901+0000 7f96363c1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f96300aedf0 0x7f96300af1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54986/0 (socket says 172.21.15.153:54986) 2024-08-17T02:26:44.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.901+0000 7f96363c1700 1 -- 172.21.15.153:0/1883316758 learned_addr learned my addr 172.21.15.153:0/1883316758 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:44.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.901+0000 7f9636bc2700 1 --2- 172.21.15.153:0/1883316758 >> v2:172.21.15.174:3300/0 conn(0x7f96301571c0 0x7f9630067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.901+0000 7f96363c1700 1 -- 172.21.15.153:0/1883316758 >> v2:172.21.15.174:3300/0 conn(0x7f96301571c0 msgr2=0x7f9630067fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:44.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.901+0000 7f96363c1700 1 --2- 172.21.15.153:0/1883316758 >> v2:172.21.15.174:3300/0 conn(0x7f96301571c0 0x7f9630067fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.901+0000 7f96363c1700 1 -- 172.21.15.153:0/1883316758 >> v1:172.21.15.174:6789/0 conn(0x7f9630067690 legacy=0x7f9630156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.901+0000 7f96363c1700 1 -- 172.21.15.153:0/1883316758 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96300b2270 con 0x7f96300aedf0 2024-08-17T02:26:44.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.901+0000 7f96363c1700 1 --2- 172.21.15.153:0/1883316758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96300aedf0 0x7f96300af1c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9630069700 tx=0x7f962c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eae1b449649a913 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:44.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.901+0000 7f96353bf700 1 -- 172.21.15.153:0/1883316758 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962c009e70 con 0x7f96300aedf0 2024-08-17T02:26:44.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.901+0000 7f96353bf700 1 -- 172.21.15.153:0/1883316758 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962c00b860 con 0x7f96300aedf0 2024-08-17T02:26:44.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.901+0000 7f96353bf700 1 -- 172.21.15.153:0/1883316758 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962c00bc20 con 0x7f96300aedf0 2024-08-17T02:26:44.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.901+0000 7f96373c3700 1 -- 172.21.15.153:0/1883316758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96300aedf0 msgr2=0x7f96300af1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.901+0000 7f96373c3700 1 --2- 172.21.15.153:0/1883316758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96300aedf0 0x7f96300af1c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9630069700 tx=0x7f962c009250 comp rx=0 tx=0).stop 2024-08-17T02:26:44.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.901+0000 7f96373c3700 1 -- 172.21.15.153:0/1883316758 shutdown_connections 2024-08-17T02:26:44.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.901+0000 7f96373c3700 1 --2- 172.21.15.153:0/1883316758 >> v2:172.21.15.174:3300/0 conn(0x7f96301571c0 0x7f9630067fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.901+0000 7f96373c3700 1 --2- 172.21.15.153:0/1883316758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96300aedf0 0x7f96300af1c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.901+0000 7f96373c3700 1 -- 172.21.15.153:0/1883316758 >> 172.21.15.153:0/1883316758 conn(0x7f96300ca2b0 msgr2=0x7f963006e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:44.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.901+0000 7f96373c3700 1 -- 172.21.15.153:0/1883316758 shutdown_connections 2024-08-17T02:26:44.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.901+0000 7f96373c3700 1 -- 172.21.15.153:0/1883316758 wait complete. 2024-08-17T02:26:44.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.905+0000 7f96373c3700 1 Processor -- start 2024-08-17T02:26:44.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.905+0000 7f96373c3700 1 -- start start 2024-08-17T02:26:44.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.905+0000 7f96373c3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9630067690 0x7f963014b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.905+0000 7f96373c3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f96300aedf0 0x7f96301671d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.905+0000 7f96373c3700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f96301571c0 0x7f96301511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.905+0000 7f96373c3700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9630159450 con 0x7f9630067690 2024-08-17T02:26:44.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.905+0000 7f96373c3700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963014bd10 con 0x7f96301571c0 2024-08-17T02:26:44.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.905+0000 7f96373c3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9630158840 con 0x7f96300aedf0 2024-08-17T02:26:44.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.905+0000 7f96363c1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9630067690 0x7f963014b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.905+0000 7f96363c1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9630067690 0x7f963014b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55000/0 (socket says 172.21.15.153:55000) 2024-08-17T02:26:44.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.905+0000 7f96363c1700 1 -- 172.21.15.153:0/1634466843 learned_addr learned my addr 172.21.15.153:0/1634466843 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:44.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.905+0000 7f9636bc2700 1 --2- 172.21.15.153:0/1634466843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f96301571c0 0x7f96301511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.905+0000 7f9635bc0700 1 --2- 172.21.15.153:0/1634466843 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f96300aedf0 0x7f96301671d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.905+0000 7f96363c1700 1 -- 172.21.15.153:0/1634466843 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f96300aedf0 msgr2=0x7f96301671d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.905+0000 7f96363c1700 1 --2- 172.21.15.153:0/1634466843 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f96300aedf0 0x7f96301671d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.905+0000 7f96363c1700 1 -- 172.21.15.153:0/1634466843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f96301571c0 msgr2=0x7f96301511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.905+0000 7f96363c1700 1 --2- 172.21.15.153:0/1634466843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f96301571c0 0x7f96301511a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.905+0000 7f96363c1700 1 -- 172.21.15.153:0/1634466843 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f962c0094f0 con 0x7f9630067690 2024-08-17T02:26:44.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.909+0000 7f9635bc0700 1 --2- 172.21.15.153:0/1634466843 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f96300aedf0 0x7f96301671d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:44.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.909+0000 7f96363c1700 1 --2- 172.21.15.153:0/1634466843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9630067690 0x7f963014b7d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f962c006fd0 tx=0x7f962c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:44.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.909+0000 7f96227fc700 1 -- 172.21.15.153:0/1634466843 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962c01f070 con 0x7f9630067690 2024-08-17T02:26:44.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.909+0000 7f96227fc700 1 -- 172.21.15.153:0/1634466843 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962c002f30 con 0x7f9630067690 2024-08-17T02:26:44.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.909+0000 7f96373c3700 1 -- 172.21.15.153:0/1634466843 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9630158b20 con 0x7f9630067690 2024-08-17T02:26:44.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.909+0000 7f96227fc700 1 -- 172.21.15.153:0/1634466843 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962c00b9d0 con 0x7f9630067690 2024-08-17T02:26:44.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.909+0000 7f96373c3700 1 -- 172.21.15.153:0/1634466843 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96301590e0 con 0x7f9630067690 2024-08-17T02:26:44.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.909+0000 7f96373c3700 1 -- 172.21.15.153:0/1634466843 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96300643a0 con 0x7f9630067690 2024-08-17T02:26:44.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.909+0000 7f96227fc700 1 -- 172.21.15.153:0/1634466843 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f962c023070 con 0x7f9630067690 2024-08-17T02:26:44.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.913+0000 7f96227fc700 1 --2- 172.21.15.153:0/1634466843 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9614060860 0x7f9614062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.913+0000 7f96227fc700 1 -- 172.21.15.153:0/1634466843 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f962c07dd80 con 0x7f9630067690 2024-08-17T02:26:44.915 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.913+0000 7f9635bc0700 1 --2- 172.21.15.153:0/1634466843 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9614060860 0x7f9614062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.915 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.913+0000 7f9635bc0700 1 --2- 172.21.15.153:0/1634466843 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9614060860 0x7f9614062d10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9624007fd0 tx=0x7f9624009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:44.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:44.921+0000 7f96227fc700 1 -- 172.21.15.153:0/1634466843 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f962c04e280 con 0x7f9630067690 2024-08-17T02:26:45.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.077+0000 7f96373c3700 1 -- 172.21.15.153:0/1634466843 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f963015d1d0 con 0x7f9630067690 2024-08-17T02:26:45.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.077+0000 7f96227fc700 1 -- 172.21.15.153:0/1634466843 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f962c015090 con 0x7f9630067690 2024-08-17T02:26:45.082 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:45.082 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":21,"fsid":"56d41c33-b929-456d-96be-2aac4ecd299d","created":"2024-08-17T02:25:47.756085+0000","modified":"2024-08-17T02:26:13.759246+0000","last_up_change":"2024-08-17T02:25:58.643690+0000","last_in_change":"2024-08-17T02:25:49.809186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:58.093273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:09.856520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:11.080706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0736f8e6-818e-42e6-a0dc-8aaf813315d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":24234},{"type":"v1","addr":"172.21.15.153:6817","nonce":24234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":24234},{"type":"v1","addr":"172.21.15.153:6819","nonce":24234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":24234},{"type":"v1","addr":"172.21.15.153:6823","nonce":24234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":24234},{"type":"v1","addr":"172.21.15.153:6821","nonce":24234}]},"public_addr":"172.21.15.153:6817/24234","cluster_addr":"172.21.15.153:6819/24234","heartbeat_back_addr":"172.21.15.153:6823/24234","heartbeat_front_addr":"172.21.15.153:6821/24234","state":["exists","up"]},{"osd":1,"uuid":"011762e9-6c2d-441a-aa56-68474639d72f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":24232},{"type":"v1","addr":"172.21.15.153:6801","nonce":24232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":24232},{"type":"v1","addr":"172.21.15.153:6803","nonce":24232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":24232},{"type":"v1","addr":"172.21.15.153:6809","nonce":24232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":24232},{"type":"v1","addr":"172.21.15.153:6806","nonce":24232}]},"public_addr":"172.21.15.153:6801/24232","cluster_addr":"172.21.15.153:6803/24232","heartbeat_back_addr":"172.21.15.153:6809/24232","heartbeat_front_addr":"172.21.15.153:6806/24232","state":["exists","up"]},{"osd":2,"uuid":"b562cd97-aa12-455e-b46a-e720a2ec9d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":24235},{"type":"v1","addr":"172.21.15.153:6808","nonce":24235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":24235},{"type":"v1","addr":"172.21.15.153:6811","nonce":24235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":24235},{"type":"v1","addr":"172.21.15.153:6815","nonce":24235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":24235},{"type":"v1","addr":"172.21.15.153:6813","nonce":24235}]},"public_addr":"172.21.15.153:6808/24235","cluster_addr":"172.21.15.153:6811/24235","heartbeat_back_addr":"172.21.15.153:6815/24235","heartbeat_front_addr":"172.21.15.153:6813/24235","state":["exists","up"]},{"osd":3,"uuid":"222da52f-90c2-4132-a5d2-6f6cf83d4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":24236},{"type":"v1","addr":"172.21.15.153:6825","nonce":24236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":24236},{"type":"v1","addr":"172.21.15.153:6827","nonce":24236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":24236},{"type":"v1","addr":"172.21.15.153:6831","nonce":24236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":24236},{"type":"v1","addr":"172.21.15.153:6829","nonce":24236}]},"public_addr":"172.21.15.153:6825/24236","cluster_addr":"172.21.15.153:6827/24236","heartbeat_back_addr":"172.21.15.153:6831/24236","heartbeat_front_addr":"172.21.15.153:6829/24236","state":["exists","up"]},{"osd":4,"uuid":"a38a04cd-032b-4977-a260-1ef3567d0c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24456},{"type":"v1","addr":"172.21.15.174:6809","nonce":24456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24456},{"type":"v1","addr":"172.21.15.174:6811","nonce":24456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24456},{"type":"v1","addr":"172.21.15.174:6815","nonce":24456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24456},{"type":"v1","addr":"172.21.15.174:6813","nonce":24456}]},"public_addr":"172.21.15.174:6809/24456","cluster_addr":"172.21.15.174:6811/24456","heartbeat_back_addr":"172.21.15.174:6815/24456","heartbeat_front_addr":"172.21.15.174:6813/24456","state":["exists","up"]},{"osd":5,"uuid":"c7778084-e751-48da-87a1-ab8bbe85aa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24457},{"type":"v1","addr":"172.21.15.174:6825","nonce":24457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24457},{"type":"v1","addr":"172.21.15.174:6827","nonce":24457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24457},{"type":"v1","addr":"172.21.15.174:6831","nonce":24457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24457},{"type":"v1","addr":"172.21.15.174:6829","nonce":24457}]},"public_addr":"172.21.15.174:6825/24457","cluster_addr":"172.21.15.174:6827/24457","heartbeat_back_addr":"172.21.15.174:6831/24457","heartbeat_front_addr":"172.21.15.174:6829/24457","state":["exists","up"]},{"osd":6,"uuid":"2d8e0715-254f-442c-9625-50721d0bc858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24477},{"type":"v1","addr":"172.21.15.174:6801","nonce":24477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24477},{"type":"v1","addr":"172.21.15.174:6803","nonce":24477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24477},{"type":"v1","addr":"172.21.15.174:6807","nonce":24477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24477},{"type":"v1","addr":"172.21.15.174:6805","nonce":24477}]},"public_addr":"172.21.15.174:6801/24477","cluster_addr":"172.21.15.174:6803/24477","heartbeat_back_addr":"172.21.15.174:6807/24477","heartbeat_front_addr":"172.21.15.174:6805/24477","state":["exists","up"]},{"osd":7,"uuid":"dffda25a-4601-4ddb-9a27-b0be1cadde27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24455},{"type":"v1","addr":"172.21.15.174:6817","nonce":24455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24455},{"type":"v1","addr":"172.21.15.174:6819","nonce":24455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24455},{"type":"v1","addr":"172.21.15.174:6823","nonce":24455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24455},{"type":"v1","addr":"172.21.15.174:6821","nonce":24455}]},"public_addr":"172.21.15.174:6817/24455","cluster_addr":"172.21.15.174:6819/24455","heartbeat_back_addr":"172.21.15.174:6823/24455","heartbeat_front_addr":"172.21.15.174:6821/24455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.990117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.033862+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.748087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.112877+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.070448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.360961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.110940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.226377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:45.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.081+0000 7f96373c3700 1 -- 172.21.15.153:0/1634466843 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9614060860 msgr2=0x7f9614062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.081+0000 7f96373c3700 1 --2- 172.21.15.153:0/1634466843 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9614060860 0x7f9614062d10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9624007fd0 tx=0x7f9624009040 comp rx=0 tx=0).stop 2024-08-17T02:26:45.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.081+0000 7f96373c3700 1 -- 172.21.15.153:0/1634466843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9630067690 msgr2=0x7f963014b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.081+0000 7f96373c3700 1 --2- 172.21.15.153:0/1634466843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9630067690 0x7f963014b7d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f962c006fd0 tx=0x7f962c017000 comp rx=0 tx=0).stop 2024-08-17T02:26:45.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.081+0000 7f96373c3700 1 -- 172.21.15.153:0/1634466843 shutdown_connections 2024-08-17T02:26:45.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.081+0000 7f96373c3700 1 --2- 172.21.15.153:0/1634466843 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9614060860 0x7f9614062d10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.081+0000 7f96373c3700 1 --2- 172.21.15.153:0/1634466843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f96301571c0 0x7f96301511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.081+0000 7f96373c3700 1 --2- 172.21.15.153:0/1634466843 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f96300aedf0 0x7f96301671d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.081+0000 7f96373c3700 1 --2- 172.21.15.153:0/1634466843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9630067690 0x7f963014b7d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.081+0000 7f96373c3700 1 -- 172.21.15.153:0/1634466843 >> 172.21.15.153:0/1634466843 conn(0x7f96300ca2b0 msgr2=0x7f96300affe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:45.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.081+0000 7f96373c3700 1 -- 172.21.15.153:0/1634466843 shutdown_connections 2024-08-17T02:26:45.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.081+0000 7f96373c3700 1 -- 172.21.15.153:0/1634466843 wait complete. 2024-08-17T02:26:45.096 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:26:45.096 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:45.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.201+0000 7f25cffff700 1 Processor -- start 2024-08-17T02:26:45.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.201+0000 7f25cffff700 1 -- start start 2024-08-17T02:26:45.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.201+0000 7f25cffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f25d014f930 0x7f25d00b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.205+0000 7f25cffff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f25d0068db0 0x7f25d00ad500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.205+0000 7f25cffff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25d0155b30 con 0x7f25d00b21b0 2024-08-17T02:26:45.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.205+0000 7f25cffff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d00af730 con 0x7f25d014f930 2024-08-17T02:26:45.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.205+0000 7f25cffff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d0155df0 con 0x7f25d0068db0 2024-08-17T02:26:45.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.205+0000 7f25ceffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f25d014f930 0x7f25d00b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.205+0000 7f25ceffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f25d014f930 0x7f25d00b1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55012/0 (socket says 172.21.15.153:55012) 2024-08-17T02:26:45.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.205+0000 7f25ceffd700 1 -- 172.21.15.153:0/1630261007 learned_addr learned my addr 172.21.15.153:0/1630261007 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:45.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.205+0000 7f25cf7fe700 1 --2- 172.21.15.153:0/1630261007 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f25d0068db0 0x7f25d00ad500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.205+0000 7f25ceffd700 1 -- 172.21.15.153:0/1630261007 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f25d0068db0 msgr2=0x7f25d00ad500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:45.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.205+0000 7f25ceffd700 1 --2- 172.21.15.153:0/1630261007 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f25d0068db0 0x7f25d00ad500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.205+0000 7f25ceffd700 1 -- 172.21.15.153:0/1630261007 >> v1:172.21.15.174:6789/0 conn(0x7f25d00b21b0 legacy=0x7f25d00686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.205+0000 7f25ceffd700 1 -- 172.21.15.153:0/1630261007 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d01560d0 con 0x7f25d014f930 2024-08-17T02:26:45.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.205+0000 7f25cdffb700 1 -- 172.21.15.153:0/1630261007 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2361681505 0 0) 0x7f25d0155b30 con 0x7f25d00b21b0 2024-08-17T02:26:45.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.205+0000 7f25ceffd700 1 --2- 172.21.15.153:0/1630261007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25d014f930 0x7f25d00b1c70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f25c00099b0 tx=0x7f25c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef538320ea41922a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:45.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.205+0000 7f25cdffb700 1 -- 172.21.15.153:0/1630261007 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c0009ea0 con 0x7f25d014f930 2024-08-17T02:26:45.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.205+0000 7f25cdffb700 1 -- 172.21.15.153:0/1630261007 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c000b860 con 0x7f25d014f930 2024-08-17T02:26:45.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.205+0000 7f25cdffb700 1 -- 172.21.15.153:0/1630261007 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c000bc00 con 0x7f25d014f930 2024-08-17T02:26:45.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.205+0000 7f25cffff700 1 -- 172.21.15.153:0/1630261007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25d014f930 msgr2=0x7f25d00b1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.205+0000 7f25cffff700 1 --2- 172.21.15.153:0/1630261007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25d014f930 0x7f25d00b1c70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f25c00099b0 tx=0x7f25c0009250 comp rx=0 tx=0).stop 2024-08-17T02:26:45.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.205+0000 7f25cffff700 1 -- 172.21.15.153:0/1630261007 shutdown_connections 2024-08-17T02:26:45.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.205+0000 7f25cffff700 1 --2- 172.21.15.153:0/1630261007 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f25d0068db0 0x7f25d00ad500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.205+0000 7f25cffff700 1 --2- 172.21.15.153:0/1630261007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25d014f930 0x7f25d00b1c70 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.205+0000 7f25cffff700 1 -- 172.21.15.153:0/1630261007 >> 172.21.15.153:0/1630261007 conn(0x7f25d006d790 msgr2=0x7f25d006db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:45.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.205+0000 7f25cffff700 1 -- 172.21.15.153:0/1630261007 shutdown_connections 2024-08-17T02:26:45.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.205+0000 7f25cffff700 1 -- 172.21.15.153:0/1630261007 wait complete. 2024-08-17T02:26:45.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.205+0000 7f25cffff700 1 Processor -- start 2024-08-17T02:26:45.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.209+0000 7f25cffff700 1 -- start start 2024-08-17T02:26:45.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.209+0000 7f25cffff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f25d0068db0 0x7f25d0154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.209+0000 7f25cffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25d00b21b0 0x7f25d0140d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.209+0000 7f25cffff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f25d014f930 0x7f25d0151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.209+0000 7f25cffff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d0154a70 con 0x7f25d00b21b0 2024-08-17T02:26:45.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.209+0000 7f25cffff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d00aa7c0 con 0x7f25d014f930 2024-08-17T02:26:45.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.209+0000 7f25cffff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d0154140 con 0x7f25d0068db0 2024-08-17T02:26:45.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.209+0000 7f25ce7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25d00b21b0 0x7f25d0140d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.209+0000 7f25ce7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25d00b21b0 0x7f25d0140d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55016/0 (socket says 172.21.15.153:55016) 2024-08-17T02:26:45.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.209+0000 7f25ce7fc700 1 -- 172.21.15.153:0/358623466 learned_addr learned my addr 172.21.15.153:0/358623466 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:45.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.209+0000 7f25ceffd700 1 --2- 172.21.15.153:0/358623466 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f25d0068db0 0x7f25d0154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.209+0000 7f25cf7fe700 1 --2- 172.21.15.153:0/358623466 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f25d014f930 0x7f25d0151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.209+0000 7f25ce7fc700 1 -- 172.21.15.153:0/358623466 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f25d0068db0 msgr2=0x7f25d0154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.209+0000 7f25ce7fc700 1 --2- 172.21.15.153:0/358623466 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f25d0068db0 0x7f25d0154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.209+0000 7f25ce7fc700 1 -- 172.21.15.153:0/358623466 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f25d014f930 msgr2=0x7f25d0151fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.209+0000 7f25ce7fc700 1 --2- 172.21.15.153:0/358623466 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f25d014f930 0x7f25d0151fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.209+0000 7f25ce7fc700 1 -- 172.21.15.153:0/358623466 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c00094f0 con 0x7f25d00b21b0 2024-08-17T02:26:45.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.209+0000 7f25cf7fe700 1 --2- 172.21.15.153:0/358623466 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f25d014f930 0x7f25d0151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:45.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.209+0000 7f25ce7fc700 1 --2- 172.21.15.153:0/358623466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25d00b21b0 0x7f25d0140d10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f25b800cb60 tx=0x7f25b80017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:45.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.209+0000 7f25c6ffd700 1 -- 172.21.15.153:0/358623466 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b800a7e0 con 0x7f25d00b21b0 2024-08-17T02:26:45.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.209+0000 7f25c6ffd700 1 -- 172.21.15.153:0/358623466 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b800a960 con 0x7f25d00b21b0 2024-08-17T02:26:45.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.209+0000 7f25cffff700 1 -- 172.21.15.153:0/358623466 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d0154420 con 0x7f25d00b21b0 2024-08-17T02:26:45.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.209+0000 7f25c6ffd700 1 -- 172.21.15.153:0/358623466 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b800ad20 con 0x7f25d00b21b0 2024-08-17T02:26:45.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.209+0000 7f25cffff700 1 -- 172.21.15.153:0/358623466 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d0155440 con 0x7f25d00b21b0 2024-08-17T02:26:45.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.209+0000 7f25cffff700 1 -- 172.21.15.153:0/358623466 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25d0154c20 con 0x7f25d00b21b0 2024-08-17T02:26:45.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.213+0000 7f25c6ffd700 1 -- 172.21.15.153:0/358623466 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f25b8003030 con 0x7f25d00b21b0 2024-08-17T02:26:45.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.213+0000 7f25c6ffd700 1 --2- 172.21.15.153:0/358623466 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f25b0060890 0x7f25b0062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.213+0000 7f25ceffd700 1 --2- 172.21.15.153:0/358623466 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f25b0060890 0x7f25b0062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.213+0000 7f25c6ffd700 1 -- 172.21.15.153:0/358623466 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f25b807cca0 con 0x7f25d00b21b0 2024-08-17T02:26:45.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.213+0000 7f25ceffd700 1 --2- 172.21.15.153:0/358623466 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f25b0060890 0x7f25b0062d40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f25c00099b0 tx=0x7f25c0017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:45.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.221+0000 7f25c6ffd700 1 -- 172.21.15.153:0/358623466 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f25d0154c20 con 0x7f25d00b21b0 2024-08-17T02:26:45.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.417+0000 7f25cffff700 1 -- 172.21.15.153:0/358623466 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25d00643a0 con 0x7f25d00b21b0 2024-08-17T02:26:45.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.417+0000 7f25c6ffd700 1 -- 172.21.15.153:0/358623466 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f25b804d0f0 con 0x7f25d00b21b0 2024-08-17T02:26:45.422 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:45.422 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/610991976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":610991976},{"type":"v1","addr":"172.21.15.153:6835","nonce":610991976}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/3521472122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3521472122},{"type":"v1","addr":"172.21.15.153:6837","nonce":3521472122}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1184225885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1184225885},{"type":"v1","addr":"172.21.15.174:6833","nonce":1184225885}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:12.082812+0000","modified":"2024-08-17T02:26:14.770527+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/477398839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":477398839},{"type":"v1","addr":"172.21.15.174:6835","nonce":477398839}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:26:45.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.421+0000 7f25cffff700 1 -- 172.21.15.153:0/358623466 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f25b0060890 msgr2=0x7f25b0062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.421+0000 7f25cffff700 1 --2- 172.21.15.153:0/358623466 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f25b0060890 0x7f25b0062d40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f25c00099b0 tx=0x7f25c0017000 comp rx=0 tx=0).stop 2024-08-17T02:26:45.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.421+0000 7f25cffff700 1 -- 172.21.15.153:0/358623466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25d00b21b0 msgr2=0x7f25d0140d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.421+0000 7f25cffff700 1 --2- 172.21.15.153:0/358623466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25d00b21b0 0x7f25d0140d10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f25b800cb60 tx=0x7f25b80017a0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.421+0000 7f25cffff700 1 -- 172.21.15.153:0/358623466 shutdown_connections 2024-08-17T02:26:45.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.421+0000 7f25cffff700 1 --2- 172.21.15.153:0/358623466 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f25b0060890 0x7f25b0062d40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.421+0000 7f25cffff700 1 --2- 172.21.15.153:0/358623466 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f25d014f930 0x7f25d0151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.421+0000 7f25cffff700 1 --2- 172.21.15.153:0/358623466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25d00b21b0 0x7f25d0140d10 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.421+0000 7f25cffff700 1 --2- 172.21.15.153:0/358623466 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f25d0068db0 0x7f25d0154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.421+0000 7f25cffff700 1 -- 172.21.15.153:0/358623466 >> 172.21.15.153:0/358623466 conn(0x7f25d006d790 msgr2=0x7f25d014db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:45.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.421+0000 7f25cffff700 1 -- 172.21.15.153:0/358623466 shutdown_connections 2024-08-17T02:26:45.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.421+0000 7f25cffff700 1 -- 172.21.15.153:0/358623466 wait complete. 2024-08-17T02:26:45.426 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 6 2024-08-17T02:26:45.436 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:45.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.537+0000 7facae8dd700 1 Processor -- start 2024-08-17T02:26:45.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.537+0000 7facae8dd700 1 -- start start 2024-08-17T02:26:45.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.541+0000 7facae8dd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7faca80b0350 0x7faca80ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.541+0000 7facae8dd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faca806df10 0x7faca806e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.541+0000 7facae8dd700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faca806e8b0 con 0x7faca8155d20 2024-08-17T02:26:45.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.541+0000 7facae8dd700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faca80b07a0 con 0x7faca80b0350 2024-08-17T02:26:45.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.541+0000 7facae8dd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faca80af2b0 con 0x7faca806df10 2024-08-17T02:26:45.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.541+0000 7facad0da700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7faca80b0350 0x7faca80ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.541+0000 7facad0da700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7faca80b0350 0x7faca80ad7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55018/0 (socket says 172.21.15.153:55018) 2024-08-17T02:26:45.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.541+0000 7facad0da700 1 -- 172.21.15.153:0/2808246627 learned_addr learned my addr 172.21.15.153:0/2808246627 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:45.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.541+0000 7facae0dc700 1 --2- 172.21.15.153:0/2808246627 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faca806df10 0x7faca806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.541+0000 7facad0da700 1 -- 172.21.15.153:0/2808246627 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faca806df10 msgr2=0x7faca806e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:45.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.541+0000 7facad0da700 1 --2- 172.21.15.153:0/2808246627 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faca806df10 0x7faca806e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.541+0000 7facad0da700 1 -- 172.21.15.153:0/2808246627 >> v1:172.21.15.174:6789/0 conn(0x7faca8155d20 legacy=0x7faca80aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:45.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.541+0000 7facad0da700 1 -- 172.21.15.153:0/2808246627 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca80af590 con 0x7faca80b0350 2024-08-17T02:26:45.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.541+0000 7facad0da700 1 --2- 172.21.15.153:0/2808246627 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faca80b0350 0x7faca80ad7c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fac9c0099b0 tx=0x7fac9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f9fae2dba7c782 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:45.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.541+0000 7facac8d9700 1 -- 172.21.15.153:0/2808246627 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9c00b820 con 0x7faca80b0350 2024-08-17T02:26:45.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.541+0000 7facac8d9700 1 -- 172.21.15.153:0/2808246627 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9c00b980 con 0x7faca80b0350 2024-08-17T02:26:45.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.541+0000 7facac8d9700 1 -- 172.21.15.153:0/2808246627 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9c00bd20 con 0x7faca80b0350 2024-08-17T02:26:45.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.541+0000 7facae8dd700 1 -- 172.21.15.153:0/2808246627 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faca80b0350 msgr2=0x7faca80ad7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.541+0000 7facae8dd700 1 --2- 172.21.15.153:0/2808246627 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faca80b0350 0x7faca80ad7c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fac9c0099b0 tx=0x7fac9c009250 comp rx=0 tx=0).stop 2024-08-17T02:26:45.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.541+0000 7facae8dd700 1 -- 172.21.15.153:0/2808246627 shutdown_connections 2024-08-17T02:26:45.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.541+0000 7facae8dd700 1 --2- 172.21.15.153:0/2808246627 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faca806df10 0x7faca806e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.541+0000 7facae8dd700 1 --2- 172.21.15.153:0/2808246627 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faca80b0350 0x7faca80ad7c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.541+0000 7facae8dd700 1 -- 172.21.15.153:0/2808246627 >> 172.21.15.153:0/2808246627 conn(0x7faca80678d0 msgr2=0x7faca8067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:45.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.541+0000 7facae8dd700 1 -- 172.21.15.153:0/2808246627 shutdown_connections 2024-08-17T02:26:45.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.541+0000 7facae8dd700 1 -- 172.21.15.153:0/2808246627 wait complete. 2024-08-17T02:26:45.547 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.545+0000 7facae8dd700 1 Processor -- start 2024-08-17T02:26:45.547 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.545+0000 7facae8dd700 1 -- start start 2024-08-17T02:26:45.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.545+0000 7facae8dd700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faca806df10 0x7faca8149290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.545+0000 7facae8dd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faca80b0350 0x7faca81428f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.545+0000 7facae8dd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faca8155d20 0x7faca8147230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.545+0000 7facae8dd700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca8143820 con 0x7faca80b0350 2024-08-17T02:26:45.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.545+0000 7facae8dd700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca8144300 con 0x7faca806df10 2024-08-17T02:26:45.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.545+0000 7facae8dd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faca8143260 con 0x7faca8155d20 2024-08-17T02:26:45.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.545+0000 7facad0da700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faca80b0350 0x7faca81428f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.545+0000 7facad0da700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faca80b0350 0x7faca81428f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55034/0 (socket says 172.21.15.153:55034) 2024-08-17T02:26:45.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.545+0000 7facad0da700 1 -- 172.21.15.153:0/2428018740 learned_addr learned my addr 172.21.15.153:0/2428018740 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:45.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.545+0000 7facad8db700 1 --2- 172.21.15.153:0/2428018740 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faca806df10 0x7faca8149290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.545+0000 7facae0dc700 1 --2- 172.21.15.153:0/2428018740 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faca8155d20 0x7faca8147230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.545+0000 7facad0da700 1 -- 172.21.15.153:0/2428018740 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faca8155d20 msgr2=0x7faca8147230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.545+0000 7facad0da700 1 --2- 172.21.15.153:0/2428018740 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faca8155d20 0x7faca8147230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.545+0000 7facad0da700 1 -- 172.21.15.153:0/2428018740 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faca806df10 msgr2=0x7faca8149290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.549+0000 7facad0da700 1 --2- 172.21.15.153:0/2428018740 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faca806df10 0x7faca8149290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.549+0000 7facad0da700 1 -- 172.21.15.153:0/2428018740 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9c0094f0 con 0x7faca80b0350 2024-08-17T02:26:45.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.549+0000 7facad0da700 1 --2- 172.21.15.153:0/2428018740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faca80b0350 0x7faca81428f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fac9c009290 tx=0x7fac9c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:45.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.549+0000 7faca5ffb700 1 -- 172.21.15.153:0/2428018740 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9c011c10 con 0x7faca80b0350 2024-08-17T02:26:45.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.549+0000 7faca5ffb700 1 -- 172.21.15.153:0/2428018740 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9c020070 con 0x7faca80b0350 2024-08-17T02:26:45.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.549+0000 7facae8dd700 1 -- 172.21.15.153:0/2428018740 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faca8143540 con 0x7faca80b0350 2024-08-17T02:26:45.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.549+0000 7faca5ffb700 1 -- 172.21.15.153:0/2428018740 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9c01b450 con 0x7faca80b0350 2024-08-17T02:26:45.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.549+0000 7facae8dd700 1 -- 172.21.15.153:0/2428018740 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faca8142e30 con 0x7faca80b0350 2024-08-17T02:26:45.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.549+0000 7facae8dd700 1 -- 172.21.15.153:0/2428018740 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faca8143020 con 0x7faca80b0350 2024-08-17T02:26:45.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.549+0000 7faca5ffb700 1 -- 172.21.15.153:0/2428018740 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fac9c022030 con 0x7faca80b0350 2024-08-17T02:26:45.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.549+0000 7faca5ffb700 1 --2- 172.21.15.153:0/2428018740 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fac94060860 0x7fac94062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.549+0000 7faca5ffb700 1 -- 172.21.15.153:0/2428018740 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fac9c07e8a0 con 0x7faca80b0350 2024-08-17T02:26:45.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.549+0000 7facad8db700 1 --2- 172.21.15.153:0/2428018740 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fac94060860 0x7fac94062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.553+0000 7facad8db700 1 --2- 172.21.15.153:0/2428018740 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fac94060860 0x7fac94062d10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fac98009af0 tx=0x7fac98009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:45.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.557+0000 7faca5ffb700 1 -- 172.21.15.153:0/2428018740 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7faca8143020 con 0x7faca80b0350 2024-08-17T02:26:45.762 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.761+0000 7facae8dd700 1 -- 172.21.15.153:0/2428018740 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faca806e8b0 con 0x7faca80b0350 2024-08-17T02:26:45.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.761+0000 7faca5ffb700 1 -- 172.21.15.153:0/2428018740 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4597 (secure 0 0 0) 0x7faca806e8b0 con 0x7faca80b0350 2024-08-17T02:26:45.764 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:45.764 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/610991976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":610991976},{"type":"v1","addr":"172.21.15.153:6835","nonce":610991976}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/3521472122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3521472122},{"type":"v1","addr":"172.21.15.153:6837","nonce":3521472122}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1184225885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1184225885},{"type":"v1","addr":"172.21.15.174:6833","nonce":1184225885}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:12.082812+0000","modified":"2024-08-17T02:26:14.770527+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/477398839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":477398839},{"type":"v1","addr":"172.21.15.174:6835","nonce":477398839}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:26:45.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.761+0000 7facae8dd700 1 -- 172.21.15.153:0/2428018740 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fac94060860 msgr2=0x7fac94062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.761+0000 7facae8dd700 1 --2- 172.21.15.153:0/2428018740 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fac94060860 0x7fac94062d10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fac98009af0 tx=0x7fac98009060 comp rx=0 tx=0).stop 2024-08-17T02:26:45.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.761+0000 7facae8dd700 1 -- 172.21.15.153:0/2428018740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faca80b0350 msgr2=0x7faca81428f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.761+0000 7facae8dd700 1 --2- 172.21.15.153:0/2428018740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faca80b0350 0x7faca81428f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fac9c009290 tx=0x7fac9c016000 comp rx=0 tx=0).stop 2024-08-17T02:26:45.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.761+0000 7facae8dd700 1 -- 172.21.15.153:0/2428018740 shutdown_connections 2024-08-17T02:26:45.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.761+0000 7facae8dd700 1 --2- 172.21.15.153:0/2428018740 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fac94060860 0x7fac94062d10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.761+0000 7facae8dd700 1 --2- 172.21.15.153:0/2428018740 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faca8155d20 0x7faca8147230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.761+0000 7facae8dd700 1 --2- 172.21.15.153:0/2428018740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faca80b0350 0x7faca81428f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.761+0000 7facae8dd700 1 --2- 172.21.15.153:0/2428018740 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faca806df10 0x7faca8149290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.761+0000 7facae8dd700 1 -- 172.21.15.153:0/2428018740 >> 172.21.15.153:0/2428018740 conn(0x7faca80678d0 msgr2=0x7faca8063060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:45.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.761+0000 7facae8dd700 1 -- 172.21.15.153:0/2428018740 shutdown_connections 2024-08-17T02:26:45.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.761+0000 7facae8dd700 1 -- 172.21.15.153:0/2428018740 wait complete. 2024-08-17T02:26:45.767 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 6 2024-08-17T02:26:45.777 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:45.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.877+0000 7f53626fe700 1 Processor -- start 2024-08-17T02:26:45.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.877+0000 7f53626fe700 1 -- start start 2024-08-17T02:26:45.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.881+0000 7f53626fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f535c159040 0x7f535c0cf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.881+0000 7f53626fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f535c0d0010 0x7f535c0d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.881+0000 7f53626fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f535c15cea0 0x7f535c15d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.881+0000 7f53626fe700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f535c0cf190 con 0x7f535c15cea0 2024-08-17T02:26:45.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.881+0000 7f53626fe700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f535c0d09a0 con 0x7f535c0d0010 2024-08-17T02:26:45.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.881+0000 7f53626fe700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f535c0ce5e0 con 0x7f535c159040 2024-08-17T02:26:45.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.881+0000 7f5361efd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f535c15cea0 0x7f535c15d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.881+0000 7f5361efd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f535c15cea0 0x7f535c15d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55044/0 (socket says 172.21.15.153:55044) 2024-08-17T02:26:45.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.881+0000 7f5361efd700 1 -- 172.21.15.153:0/1198312567 learned_addr learned my addr 172.21.15.153:0/1198312567 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:45.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.881+0000 7f5360efb700 1 --2- 172.21.15.153:0/1198312567 >> v2:172.21.15.174:3300/0 conn(0x7f535c0d0010 0x7f535c0d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.881+0000 7f53616fc700 1 --2- 172.21.15.153:0/1198312567 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f535c159040 0x7f535c0cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.881+0000 7f5361efd700 1 -- 172.21.15.153:0/1198312567 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f535c159040 msgr2=0x7f535c0cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:45.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.881+0000 7f5361efd700 1 --2- 172.21.15.153:0/1198312567 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f535c159040 0x7f535c0cf620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.881+0000 7f5361efd700 1 -- 172.21.15.153:0/1198312567 >> v2:172.21.15.174:3300/0 conn(0x7f535c0d0010 msgr2=0x7f535c0d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:45.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.881+0000 7f5361efd700 1 --2- 172.21.15.153:0/1198312567 >> v2:172.21.15.174:3300/0 conn(0x7f535c0d0010 0x7f535c0d0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.881+0000 7f5361efd700 1 -- 172.21.15.153:0/1198312567 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f535c0ce860 con 0x7f535c15cea0 2024-08-17T02:26:45.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.881+0000 7f5361efd700 1 --2- 172.21.15.153:0/1198312567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f535c15cea0 0x7f535c15d320 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f535c067f20 tx=0x7f5354009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0a0f51ecbf82845 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:45.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.881+0000 7f534ffff700 1 -- 172.21.15.153:0/1198312567 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535400e070 con 0x7f535c15cea0 2024-08-17T02:26:45.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.881+0000 7f534ffff700 1 -- 172.21.15.153:0/1198312567 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535400ba20 con 0x7f535c15cea0 2024-08-17T02:26:45.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.881+0000 7f534ffff700 1 -- 172.21.15.153:0/1198312567 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53540092e0 con 0x7f535c15cea0 2024-08-17T02:26:45.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.881+0000 7f53626fe700 1 -- 172.21.15.153:0/1198312567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f535c15cea0 msgr2=0x7f535c15d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.881+0000 7f53626fe700 1 --2- 172.21.15.153:0/1198312567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f535c15cea0 0x7f535c15d320 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f535c067f20 tx=0x7f5354009840 comp rx=0 tx=0).stop 2024-08-17T02:26:45.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.881+0000 7f53626fe700 1 -- 172.21.15.153:0/1198312567 shutdown_connections 2024-08-17T02:26:45.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.881+0000 7f53626fe700 1 --2- 172.21.15.153:0/1198312567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f535c15cea0 0x7f535c15d320 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.881+0000 7f53626fe700 1 --2- 172.21.15.153:0/1198312567 >> v2:172.21.15.174:3300/0 conn(0x7f535c0d0010 0x7f535c0d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.881+0000 7f53626fe700 1 --2- 172.21.15.153:0/1198312567 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f535c159040 0x7f535c0cf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.881+0000 7f53626fe700 1 -- 172.21.15.153:0/1198312567 >> 172.21.15.153:0/1198312567 conn(0x7f535c068250 msgr2=0x7f535c068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:45.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.881+0000 7f53626fe700 1 -- 172.21.15.153:0/1198312567 shutdown_connections 2024-08-17T02:26:45.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.881+0000 7f53626fe700 1 -- 172.21.15.153:0/1198312567 wait complete. 2024-08-17T02:26:45.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.885+0000 7f53626fe700 1 Processor -- start 2024-08-17T02:26:45.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.885+0000 7f53626fe700 1 -- start start 2024-08-17T02:26:45.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.885+0000 7f53626fe700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f535c0d0010 0x7f535c0cc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.885+0000 7f53626fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f535c159040 0x7f535c0affa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.885+0000 7f53626fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f535c15cea0 0x7f535c0c4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.885+0000 7f53626fe700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535c0b5130 con 0x7f535c159040 2024-08-17T02:26:45.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.885+0000 7f53626fe700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535c0b4270 con 0x7f535c0d0010 2024-08-17T02:26:45.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.885+0000 7f53626fe700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f535c153e70 con 0x7f535c15cea0 2024-08-17T02:26:45.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.885+0000 7f5360efb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f535c159040 0x7f535c0affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.885+0000 7f5360efb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f535c159040 0x7f535c0affa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55058/0 (socket says 172.21.15.153:55058) 2024-08-17T02:26:45.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.885+0000 7f5360efb700 1 -- 172.21.15.153:0/24860084 learned_addr learned my addr 172.21.15.153:0/24860084 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:45.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.889+0000 7f53616fc700 1 --2- 172.21.15.153:0/24860084 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f535c0d0010 0x7f535c0cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.889+0000 7f5361efd700 1 --2- 172.21.15.153:0/24860084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f535c15cea0 0x7f535c0c4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.889+0000 7f5360efb700 1 -- 172.21.15.153:0/24860084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f535c15cea0 msgr2=0x7f535c0c4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.889+0000 7f5360efb700 1 --2- 172.21.15.153:0/24860084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f535c15cea0 0x7f535c0c4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.889+0000 7f5360efb700 1 -- 172.21.15.153:0/24860084 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f535c0d0010 msgr2=0x7f535c0cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.889+0000 7f5360efb700 1 --2- 172.21.15.153:0/24860084 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f535c0d0010 0x7f535c0cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.889+0000 7f5360efb700 1 -- 172.21.15.153:0/24860084 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5354009ae0 con 0x7f535c159040 2024-08-17T02:26:45.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.889+0000 7f5360efb700 1 --2- 172.21.15.153:0/24860084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f535c159040 0x7f535c0affa0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f535000ec80 tx=0x7f53500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:45.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.889+0000 7f534d7fa700 1 -- 172.21.15.153:0/24860084 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535000c850 con 0x7f535c159040 2024-08-17T02:26:45.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.889+0000 7f534d7fa700 1 -- 172.21.15.153:0/24860084 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535000c9b0 con 0x7f535c159040 2024-08-17T02:26:45.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.889+0000 7f53626fe700 1 -- 172.21.15.153:0/24860084 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f535c0b4520 con 0x7f535c159040 2024-08-17T02:26:45.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.889+0000 7f534d7fa700 1 -- 172.21.15.153:0/24860084 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535000cd50 con 0x7f535c159040 2024-08-17T02:26:45.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.889+0000 7f53626fe700 1 -- 172.21.15.153:0/24860084 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f535c0b4ae0 con 0x7f535c159040 2024-08-17T02:26:45.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.889+0000 7f534d7fa700 1 -- 172.21.15.153:0/24860084 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5350013680 con 0x7f535c159040 2024-08-17T02:26:45.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.889+0000 7f53626fe700 1 -- 172.21.15.153:0/24860084 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f535c0b52a0 con 0x7f535c159040 2024-08-17T02:26:45.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.889+0000 7f534d7fa700 1 --2- 172.21.15.153:0/24860084 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f5340060860 0x7f5340062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.889+0000 7f534d7fa700 1 -- 172.21.15.153:0/24860084 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f535007d1e0 con 0x7f535c159040 2024-08-17T02:26:45.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.893+0000 7f53616fc700 1 --2- 172.21.15.153:0/24860084 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f5340060860 0x7f5340062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.893+0000 7f53616fc700 1 --2- 172.21.15.153:0/24860084 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f5340060860 0x7f5340062d10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5358006fd0 tx=0x7f5358008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:45.901 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:45.897+0000 7f534d7fa700 1 -- 172.21.15.153:0/24860084 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f535004d590 con 0x7f535c159040 2024-08-17T02:26:46.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.065+0000 7f53626fe700 1 -- 172.21.15.153:0/24860084 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f535c0643a0 con 0x7f535c159040 2024-08-17T02:26:46.069 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.065+0000 7f534d7fa700 1 -- 172.21.15.153:0/24860084 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f5350050bb0 con 0x7f535c159040 2024-08-17T02:26:46.069 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:46.069 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":21,"fsid":"56d41c33-b929-456d-96be-2aac4ecd299d","created":"2024-08-17T02:25:47.756085+0000","modified":"2024-08-17T02:26:13.759246+0000","last_up_change":"2024-08-17T02:25:58.643690+0000","last_in_change":"2024-08-17T02:25:49.809186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:58.093273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:09.856520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:11.080706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0736f8e6-818e-42e6-a0dc-8aaf813315d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":24234},{"type":"v1","addr":"172.21.15.153:6817","nonce":24234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":24234},{"type":"v1","addr":"172.21.15.153:6819","nonce":24234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":24234},{"type":"v1","addr":"172.21.15.153:6823","nonce":24234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":24234},{"type":"v1","addr":"172.21.15.153:6821","nonce":24234}]},"public_addr":"172.21.15.153:6817/24234","cluster_addr":"172.21.15.153:6819/24234","heartbeat_back_addr":"172.21.15.153:6823/24234","heartbeat_front_addr":"172.21.15.153:6821/24234","state":["exists","up"]},{"osd":1,"uuid":"011762e9-6c2d-441a-aa56-68474639d72f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":24232},{"type":"v1","addr":"172.21.15.153:6801","nonce":24232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":24232},{"type":"v1","addr":"172.21.15.153:6803","nonce":24232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":24232},{"type":"v1","addr":"172.21.15.153:6809","nonce":24232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":24232},{"type":"v1","addr":"172.21.15.153:6806","nonce":24232}]},"public_addr":"172.21.15.153:6801/24232","cluster_addr":"172.21.15.153:6803/24232","heartbeat_back_addr":"172.21.15.153:6809/24232","heartbeat_front_addr":"172.21.15.153:6806/24232","state":["exists","up"]},{"osd":2,"uuid":"b562cd97-aa12-455e-b46a-e720a2ec9d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":24235},{"type":"v1","addr":"172.21.15.153:6808","nonce":24235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":24235},{"type":"v1","addr":"172.21.15.153:6811","nonce":24235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":24235},{"type":"v1","addr":"172.21.15.153:6815","nonce":24235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":24235},{"type":"v1","addr":"172.21.15.153:6813","nonce":24235}]},"public_addr":"172.21.15.153:6808/24235","cluster_addr":"172.21.15.153:6811/24235","heartbeat_back_addr":"172.21.15.153:6815/24235","heartbeat_front_addr":"172.21.15.153:6813/24235","state":["exists","up"]},{"osd":3,"uuid":"222da52f-90c2-4132-a5d2-6f6cf83d4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":24236},{"type":"v1","addr":"172.21.15.153:6825","nonce":24236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":24236},{"type":"v1","addr":"172.21.15.153:6827","nonce":24236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":24236},{"type":"v1","addr":"172.21.15.153:6831","nonce":24236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":24236},{"type":"v1","addr":"172.21.15.153:6829","nonce":24236}]},"public_addr":"172.21.15.153:6825/24236","cluster_addr":"172.21.15.153:6827/24236","heartbeat_back_addr":"172.21.15.153:6831/24236","heartbeat_front_addr":"172.21.15.153:6829/24236","state":["exists","up"]},{"osd":4,"uuid":"a38a04cd-032b-4977-a260-1ef3567d0c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24456},{"type":"v1","addr":"172.21.15.174:6809","nonce":24456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24456},{"type":"v1","addr":"172.21.15.174:6811","nonce":24456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24456},{"type":"v1","addr":"172.21.15.174:6815","nonce":24456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24456},{"type":"v1","addr":"172.21.15.174:6813","nonce":24456}]},"public_addr":"172.21.15.174:6809/24456","cluster_addr":"172.21.15.174:6811/24456","heartbeat_back_addr":"172.21.15.174:6815/24456","heartbeat_front_addr":"172.21.15.174:6813/24456","state":["exists","up"]},{"osd":5,"uuid":"c7778084-e751-48da-87a1-ab8bbe85aa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24457},{"type":"v1","addr":"172.21.15.174:6825","nonce":24457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24457},{"type":"v1","addr":"172.21.15.174:6827","nonce":24457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24457},{"type":"v1","addr":"172.21.15.174:6831","nonce":24457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24457},{"type":"v1","addr":"172.21.15.174:6829","nonce":24457}]},"public_addr":"172.21.15.174:6825/24457","cluster_addr":"172.21.15.174:6827/24457","heartbeat_back_addr":"172.21.15.174:6831/24457","heartbeat_front_addr":"172.21.15.174:6829/24457","state":["exists","up"]},{"osd":6,"uuid":"2d8e0715-254f-442c-9625-50721d0bc858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24477},{"type":"v1","addr":"172.21.15.174:6801","nonce":24477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24477},{"type":"v1","addr":"172.21.15.174:6803","nonce":24477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24477},{"type":"v1","addr":"172.21.15.174:6807","nonce":24477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24477},{"type":"v1","addr":"172.21.15.174:6805","nonce":24477}]},"public_addr":"172.21.15.174:6801/24477","cluster_addr":"172.21.15.174:6803/24477","heartbeat_back_addr":"172.21.15.174:6807/24477","heartbeat_front_addr":"172.21.15.174:6805/24477","state":["exists","up"]},{"osd":7,"uuid":"dffda25a-4601-4ddb-9a27-b0be1cadde27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24455},{"type":"v1","addr":"172.21.15.174:6817","nonce":24455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24455},{"type":"v1","addr":"172.21.15.174:6819","nonce":24455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24455},{"type":"v1","addr":"172.21.15.174:6823","nonce":24455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24455},{"type":"v1","addr":"172.21.15.174:6821","nonce":24455}]},"public_addr":"172.21.15.174:6817/24455","cluster_addr":"172.21.15.174:6819/24455","heartbeat_back_addr":"172.21.15.174:6823/24455","heartbeat_front_addr":"172.21.15.174:6821/24455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.990117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.033862+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.748087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.112877+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.070448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.360961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.110940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.226377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:46.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.069+0000 7f53626fe700 1 -- 172.21.15.153:0/24860084 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f5340060860 msgr2=0x7f5340062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.069+0000 7f53626fe700 1 --2- 172.21.15.153:0/24860084 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f5340060860 0x7f5340062d10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5358006fd0 tx=0x7f5358008040 comp rx=0 tx=0).stop 2024-08-17T02:26:46.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.069+0000 7f53626fe700 1 -- 172.21.15.153:0/24860084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f535c159040 msgr2=0x7f535c0affa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.069+0000 7f53626fe700 1 --2- 172.21.15.153:0/24860084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f535c159040 0x7f535c0affa0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f535000ec80 tx=0x7f53500091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.069+0000 7f53626fe700 1 -- 172.21.15.153:0/24860084 shutdown_connections 2024-08-17T02:26:46.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.069+0000 7f53626fe700 1 --2- 172.21.15.153:0/24860084 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f5340060860 0x7f5340062d10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.069+0000 7f53626fe700 1 --2- 172.21.15.153:0/24860084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f535c15cea0 0x7f535c0c4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.069+0000 7f53626fe700 1 --2- 172.21.15.153:0/24860084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f535c159040 0x7f535c0affa0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.069+0000 7f53626fe700 1 --2- 172.21.15.153:0/24860084 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f535c0d0010 0x7f535c0cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.069+0000 7f53626fe700 1 -- 172.21.15.153:0/24860084 >> 172.21.15.153:0/24860084 conn(0x7f535c068250 msgr2=0x7f535c0aee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:46.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.069+0000 7f53626fe700 1 -- 172.21.15.153:0/24860084 shutdown_connections 2024-08-17T02:26:46.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.069+0000 7f53626fe700 1 -- 172.21.15.153:0/24860084 wait complete. 2024-08-17T02:26:46.083 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:26:46.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.185+0000 7f36fb59e700 1 Processor -- start 2024-08-17T02:26:46.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.185+0000 7f36fb59e700 1 -- start start 2024-08-17T02:26:46.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.189+0000 7f36fb59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f36fc154900 0x7f36fc0b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.189+0000 7f36fb59e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f36fc0cb560 0x7f36fc160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.189+0000 7f36fb59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36fc0b1730 con 0x7f36fc0b12d0 2024-08-17T02:26:46.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.189+0000 7f36fb59e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36fc068790 con 0x7f36fc154900 2024-08-17T02:26:46.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.189+0000 7f36fb59e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36fc1583f0 con 0x7f36fc0cb560 2024-08-17T02:26:46.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.189+0000 7f36fa59c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f36fc154900 0x7f36fc0b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.189+0000 7f36f9d9b700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f36fc0b12d0 0x7f36fc0cae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:55516/0 (socket says 172.21.15.153:55516) 2024-08-17T02:26:46.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.189+0000 7f36f9d9b700 1 -- 172.21.15.153:0/1201818739 learned_addr learned my addr 172.21.15.153:0/1201818739 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:46.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.189+0000 7f36fad9d700 1 --2- 172.21.15.153:0/1201818739 >> v2:172.21.15.174:3300/0 conn(0x7f36fc0cb560 0x7f36fc160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.189+0000 7f36fa59c700 1 -- 172.21.15.153:0/1201818739 >> v2:172.21.15.174:3300/0 conn(0x7f36fc0cb560 msgr2=0x7f36fc160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:46.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.189+0000 7f36fa59c700 1 --2- 172.21.15.153:0/1201818739 >> v2:172.21.15.174:3300/0 conn(0x7f36fc0cb560 0x7f36fc160ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.189+0000 7f36fa59c700 1 -- 172.21.15.153:0/1201818739 >> v1:172.21.15.153:6789/0 conn(0x7f36fc0b12d0 legacy=0x7f36fc0cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.189+0000 7f36fa59c700 1 -- 172.21.15.153:0/1201818739 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36fc0cbaa0 con 0x7f36fc154900 2024-08-17T02:26:46.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.189+0000 7f36f959a700 1 -- 172.21.15.153:0/1201818739 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 401091413 0 0) 0x7f36e4001110 con 0x7f36fc0b12d0 2024-08-17T02:26:46.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.189+0000 7f36fa59c700 1 --2- 172.21.15.153:0/1201818739 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36fc154900 0x7f36fc0b0d90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f36fc06c980 tx=0x7f36ec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5530fe6ab293915 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:46.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.189+0000 7f36f959a700 1 -- 172.21.15.153:0/1201818739 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec00e070 con 0x7f36fc154900 2024-08-17T02:26:46.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.189+0000 7f36f959a700 1 -- 172.21.15.153:0/1201818739 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ec00bb60 con 0x7f36fc154900 2024-08-17T02:26:46.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.189+0000 7f36f959a700 1 -- 172.21.15.153:0/1201818739 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec012430 con 0x7f36fc154900 2024-08-17T02:26:46.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.189+0000 7f36fb59e700 1 -- 172.21.15.153:0/1201818739 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36fc154900 msgr2=0x7f36fc0b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.189+0000 7f36fb59e700 1 --2- 172.21.15.153:0/1201818739 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36fc154900 0x7f36fc0b0d90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f36fc06c980 tx=0x7f36ec009780 comp rx=0 tx=0).stop 2024-08-17T02:26:46.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.189+0000 7f36fb59e700 1 -- 172.21.15.153:0/1201818739 shutdown_connections 2024-08-17T02:26:46.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.189+0000 7f36fb59e700 1 --2- 172.21.15.153:0/1201818739 >> v2:172.21.15.174:3300/0 conn(0x7f36fc0cb560 0x7f36fc160ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.189+0000 7f36fb59e700 1 --2- 172.21.15.153:0/1201818739 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36fc154900 0x7f36fc0b0d90 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.189+0000 7f36fb59e700 1 -- 172.21.15.153:0/1201818739 >> 172.21.15.153:0/1201818739 conn(0x7f36fc0678d0 msgr2=0x7f36fc067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:46.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.189+0000 7f36fb59e700 1 -- 172.21.15.153:0/1201818739 shutdown_connections 2024-08-17T02:26:46.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.189+0000 7f36fb59e700 1 -- 172.21.15.153:0/1201818739 wait complete. 2024-08-17T02:26:46.200 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.193+0000 7f36fb59e700 1 Processor -- start 2024-08-17T02:26:46.200 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.193+0000 7f36fb59e700 1 -- start start 2024-08-17T02:26:46.200 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.193+0000 7f36fb59e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f36fc0b12d0 0x7f36fc14b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.193+0000 7f36fb59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f36fc0cb560 0x7f36fc155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.193+0000 7f36fb59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36fc154900 0x7f36fc0c12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.193+0000 7f36fb59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc155d60 con 0x7f36fc154900 2024-08-17T02:26:46.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.193+0000 7f36fb59e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc155fb0 con 0x7f36fc0b12d0 2024-08-17T02:26:46.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.193+0000 7f36fb59e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc156290 con 0x7f36fc0cb560 2024-08-17T02:26:46.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.193+0000 7f36fad9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36fc154900 0x7f36fc0c12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.193+0000 7f36fad9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36fc154900 0x7f36fc0c12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55064/0 (socket says 172.21.15.153:55064) 2024-08-17T02:26:46.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.193+0000 7f36fad9d700 1 -- 172.21.15.153:0/3689025107 learned_addr learned my addr 172.21.15.153:0/3689025107 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:46.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.193+0000 7f36fa59c700 1 --2- 172.21.15.153:0/3689025107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f36fc0b12d0 0x7f36fc14b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.193+0000 7f36f9d9b700 1 --2- 172.21.15.153:0/3689025107 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f36fc0cb560 0x7f36fc155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.193+0000 7f36fad9d700 1 -- 172.21.15.153:0/3689025107 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f36fc0cb560 msgr2=0x7f36fc155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.193+0000 7f36fad9d700 1 --2- 172.21.15.153:0/3689025107 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f36fc0cb560 0x7f36fc155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.193+0000 7f36fad9d700 1 -- 172.21.15.153:0/3689025107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f36fc0b12d0 msgr2=0x7f36fc14b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.193+0000 7f36fad9d700 1 --2- 172.21.15.153:0/3689025107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f36fc0b12d0 0x7f36fc14b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.193+0000 7f36fad9d700 1 -- 172.21.15.153:0/3689025107 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ec009a20 con 0x7f36fc154900 2024-08-17T02:26:46.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.193+0000 7f36fad9d700 1 --2- 172.21.15.153:0/3689025107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36fc154900 0x7f36fc0c12c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f36f400ea50 tx=0x7f36f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:46.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.193+0000 7f36f27fc700 1 -- 172.21.15.153:0/3689025107 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f400ee90 con 0x7f36fc154900 2024-08-17T02:26:46.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.193+0000 7f36f27fc700 1 -- 172.21.15.153:0/3689025107 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f400c850 con 0x7f36fc154900 2024-08-17T02:26:46.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.193+0000 7f36fb59e700 1 -- 172.21.15.153:0/3689025107 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36fc156570 con 0x7f36fc154900 2024-08-17T02:26:46.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.193+0000 7f36f27fc700 1 -- 172.21.15.153:0/3689025107 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f400cc10 con 0x7f36fc154900 2024-08-17T02:26:46.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.193+0000 7f36fb59e700 1 -- 172.21.15.153:0/3689025107 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36fc156b30 con 0x7f36fc154900 2024-08-17T02:26:46.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.197+0000 7f36fb59e700 1 -- 172.21.15.153:0/3689025107 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36fc156d50 con 0x7f36fc154900 2024-08-17T02:26:46.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.197+0000 7f36f27fc700 1 -- 172.21.15.153:0/3689025107 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f36f4013470 con 0x7f36fc154900 2024-08-17T02:26:46.203 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.197+0000 7f36f27fc700 1 --2- 172.21.15.153:0/3689025107 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f36dc060860 0x7f36dc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.203 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.197+0000 7f36fa59c700 1 --2- 172.21.15.153:0/3689025107 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f36dc060860 0x7f36dc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.203 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.197+0000 7f36f27fc700 1 -- 172.21.15.153:0/3689025107 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f36f407cda0 con 0x7f36fc154900 2024-08-17T02:26:46.203 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.197+0000 7f36fa59c700 1 --2- 172.21.15.153:0/3689025107 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f36dc060860 0x7f36dc062d10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f36ec009fd0 tx=0x7f36ec019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:46.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.201+0000 7f36f27fc700 1 -- 172.21.15.153:0/3689025107 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f36f404d1f0 con 0x7f36fc154900 2024-08-17T02:26:46.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.401+0000 7f36fb59e700 1 -- 172.21.15.153:0/3689025107 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f36fc0643a0 con 0x7f36fc154900 2024-08-17T02:26:46.407 INFO:tasks.ceph.mon.a.smithi153.stderr:2024-08-17T02:26:46.405+0000 7ff8ba661700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:26:46.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.413+0000 7f36f27fc700 1 -- 172.21.15.153:0/3689025107 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) v1 ==== 161+0+0 (secure 0 0 0) 0x7f36f4050810 con 0x7f36fc154900 2024-08-17T02:26:46.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.413+0000 7f36fb59e700 1 -- 172.21.15.153:0/3689025107 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f36dc060860 msgr2=0x7f36dc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.413+0000 7f36fb59e700 1 --2- 172.21.15.153:0/3689025107 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f36dc060860 0x7f36dc062d10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f36ec009fd0 tx=0x7f36ec019000 comp rx=0 tx=0).stop 2024-08-17T02:26:46.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.413+0000 7f36fb59e700 1 -- 172.21.15.153:0/3689025107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36fc154900 msgr2=0x7f36fc0c12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.413+0000 7f36fb59e700 1 --2- 172.21.15.153:0/3689025107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36fc154900 0x7f36fc0c12c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f36f400ea50 tx=0x7f36f40091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.413+0000 7f36fb59e700 1 -- 172.21.15.153:0/3689025107 shutdown_connections 2024-08-17T02:26:46.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.413+0000 7f36fb59e700 1 --2- 172.21.15.153:0/3689025107 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f36dc060860 0x7f36dc062d10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.413+0000 7f36fb59e700 1 --2- 172.21.15.153:0/3689025107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36fc154900 0x7f36fc0c12c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.413+0000 7f36fb59e700 1 --2- 172.21.15.153:0/3689025107 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f36fc0cb560 0x7f36fc155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.413+0000 7f36fb59e700 1 --2- 172.21.15.153:0/3689025107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f36fc0b12d0 0x7f36fc14b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.413+0000 7f36fb59e700 1 -- 172.21.15.153:0/3689025107 >> 172.21.15.153:0/3689025107 conn(0x7f36fc0678d0 msgr2=0x7f36fc0aca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:46.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.413+0000 7f36fb59e700 1 -- 172.21.15.153:0/3689025107 shutdown_connections 2024-08-17T02:26:46.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.413+0000 7f36fb59e700 1 -- 172.21.15.153:0/3689025107 wait complete. 2024-08-17T02:26:46.418 INFO:teuthology.orchestra.run.smithi153.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:26:46.421 INFO:tasks.ceph.mds.b.smithi174.stderr: -2214> 2024-08-17T02:26:16.375+0000 7fda21605700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:26:46.429 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:26:46.450 INFO:tasks.ceph.mds.b.smithi174.stdout:starting mds.b at 2024-08-17T02:26:46.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.541+0000 7f33dc994700 1 Processor -- start 2024-08-17T02:26:46.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.541+0000 7f33dc994700 1 -- start start 2024-08-17T02:26:46.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.541+0000 7f33dc994700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f33d815a500 0x7f33d80ae830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.541+0000 7f33dc994700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33d806ed10 con 0x7f33d815a8d0 2024-08-17T02:26:46.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.541+0000 7f33dc994700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33d80b1dc0 con 0x7f33d8068db0 2024-08-17T02:26:46.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.541+0000 7f33dc994700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33d806ea30 con 0x7f33d815a500 2024-08-17T02:26:46.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.541+0000 7f33d5d9b700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f33d815a8d0 0x7f33d80686a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:55518/0 (socket says 172.21.15.153:55518) 2024-08-17T02:26:46.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.541+0000 7f33d5d9b700 1 -- 172.21.15.153:0/2119317122 learned_addr learned my addr 172.21.15.153:0/2119317122 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:46.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.541+0000 7f33d659c700 1 --2- 172.21.15.153:0/2119317122 >> v2:172.21.15.153:3300/0 conn(0x7f33d815a500 0x7f33d80ae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.547 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.541+0000 7f33d559a700 1 -- 172.21.15.153:0/2119317122 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 456537053 0 0) 0x7f33d806ed10 con 0x7f33d815a8d0 2024-08-17T02:26:46.547 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.541+0000 7f33d559a700 1 -- 172.21.15.153:0/2119317122 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33c0003570 con 0x7f33d815a8d0 2024-08-17T02:26:46.547 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.541+0000 7f33d559a700 1 -- 172.21.15.153:0/2119317122 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1318593457 0 0) 0x7f33d80b1dc0 con 0x7f33d8068db0 2024-08-17T02:26:46.547 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.541+0000 7f33d659c700 1 -- 172.21.15.153:0/2119317122 >> v1:172.21.15.174:6789/0 conn(0x7f33d8068db0 legacy=0x7f33d80b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.547 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.541+0000 7f33d659c700 1 -- 172.21.15.153:0/2119317122 >> v1:172.21.15.153:6789/0 conn(0x7f33d815a8d0 legacy=0x7f33d80686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.541+0000 7f33d659c700 1 -- 172.21.15.153:0/2119317122 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d80b1770 con 0x7f33d815a500 2024-08-17T02:26:46.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.541+0000 7f33d659c700 1 --2- 172.21.15.153:0/2119317122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33d815a500 0x7f33d80ae830 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f33cc0098e0 tx=0x7f33cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=685d227a5392188f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:46.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.545+0000 7f33d559a700 1 -- 172.21.15.153:0/2119317122 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c80017f0 con 0x7f33d815a500 2024-08-17T02:26:46.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.545+0000 7f33d559a700 1 -- 172.21.15.153:0/2119317122 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33cc011420 con 0x7f33d815a500 2024-08-17T02:26:46.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.545+0000 7f33d559a700 1 -- 172.21.15.153:0/2119317122 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33cc0117c0 con 0x7f33d815a500 2024-08-17T02:26:46.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.545+0000 7f33dc994700 1 -- 172.21.15.153:0/2119317122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33d815a500 msgr2=0x7f33d80ae830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.545+0000 7f33dc994700 1 --2- 172.21.15.153:0/2119317122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33d815a500 0x7f33d80ae830 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f33cc0098e0 tx=0x7f33cc0091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.545+0000 7f33dc994700 1 -- 172.21.15.153:0/2119317122 shutdown_connections 2024-08-17T02:26:46.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.545+0000 7f33dc994700 1 --2- 172.21.15.153:0/2119317122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33d815a500 0x7f33d80ae830 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.545+0000 7f33dc994700 1 -- 172.21.15.153:0/2119317122 >> 172.21.15.153:0/2119317122 conn(0x7f33d80c9bf0 msgr2=0x7f33d806d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:46.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.545+0000 7f33dc994700 1 -- 172.21.15.153:0/2119317122 shutdown_connections 2024-08-17T02:26:46.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.545+0000 7f33dc994700 1 -- 172.21.15.153:0/2119317122 wait complete. 2024-08-17T02:26:46.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.545+0000 7f33dc994700 1 Processor -- start 2024-08-17T02:26:46.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.545+0000 7f33dc994700 1 -- start start 2024-08-17T02:26:46.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.545+0000 7f33dc994700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33d8068db0 0x7f33d80cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.545+0000 7f33dc994700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f33d815a500 0x7f33d80aced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.545+0000 7f33dc994700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33d815a8d0 0x7f33d80a9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.545+0000 7f33dc994700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d80ae1f0 con 0x7f33d815a8d0 2024-08-17T02:26:46.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.545+0000 7f33dc994700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d80cbcf0 con 0x7f33d8068db0 2024-08-17T02:26:46.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.545+0000 7f33dc994700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d80cb320 con 0x7f33d815a500 2024-08-17T02:26:46.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.545+0000 7f33d6d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33d815a8d0 0x7f33d80a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.545+0000 7f33d6d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33d815a8d0 0x7f33d80a9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55090/0 (socket says 172.21.15.153:55090) 2024-08-17T02:26:46.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.545+0000 7f33d6d9d700 1 -- 172.21.15.153:0/1481650954 learned_addr learned my addr 172.21.15.153:0/1481650954 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:46.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.545+0000 7f33d659c700 1 --2- 172.21.15.153:0/1481650954 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33d8068db0 0x7f33d80cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.545+0000 7f33d5d9b700 1 --2- 172.21.15.153:0/1481650954 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f33d815a500 0x7f33d80aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.545+0000 7f33d6d9d700 1 -- 172.21.15.153:0/1481650954 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f33d815a500 msgr2=0x7f33d80aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.545+0000 7f33d6d9d700 1 --2- 172.21.15.153:0/1481650954 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f33d815a500 0x7f33d80aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.545+0000 7f33d6d9d700 1 -- 172.21.15.153:0/1481650954 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33d8068db0 msgr2=0x7f33d80cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.545+0000 7f33d6d9d700 1 --2- 172.21.15.153:0/1481650954 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33d8068db0 0x7f33d80cb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.545+0000 7f33d6d9d700 1 -- 172.21.15.153:0/1481650954 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33cc009420 con 0x7f33d815a8d0 2024-08-17T02:26:46.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.549+0000 7f33d6d9d700 1 --2- 172.21.15.153:0/1481650954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33d815a8d0 0x7f33d80a9860 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f33d000c5d0 tx=0x7f33d0007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:46.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.549+0000 7f33c67fc700 1 -- 172.21.15.153:0/1481650954 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d0011590 con 0x7f33d815a8d0 2024-08-17T02:26:46.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.549+0000 7f33c67fc700 1 -- 172.21.15.153:0/1481650954 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d00116f0 con 0x7f33d815a8d0 2024-08-17T02:26:46.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.549+0000 7f33dc994700 1 -- 172.21.15.153:0/1481650954 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33d80ca710 con 0x7f33d815a8d0 2024-08-17T02:26:46.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.549+0000 7f33c67fc700 1 -- 172.21.15.153:0/1481650954 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d0011ab0 con 0x7f33d815a8d0 2024-08-17T02:26:46.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.549+0000 7f33dc994700 1 -- 172.21.15.153:0/1481650954 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33d80cacd0 con 0x7f33d815a8d0 2024-08-17T02:26:46.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.549+0000 7f33c67fc700 1 -- 172.21.15.153:0/1481650954 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f33d001b3b0 con 0x7f33d815a8d0 2024-08-17T02:26:46.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.549+0000 7f33dc994700 1 -- 172.21.15.153:0/1481650954 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33d80645c0 con 0x7f33d815a8d0 2024-08-17T02:26:46.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.553+0000 7f33c67fc700 1 --2- 172.21.15.153:0/1481650954 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f33b8060860 0x7f33b8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.553+0000 7f33c67fc700 1 -- 172.21.15.153:0/1481650954 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f33d007c1b0 con 0x7f33d815a8d0 2024-08-17T02:26:46.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.553+0000 7f33d659c700 1 --2- 172.21.15.153:0/1481650954 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f33b8060860 0x7f33b8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.553+0000 7f33d659c700 1 --2- 172.21.15.153:0/1481650954 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f33b8060860 0x7f33b8062d10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f33cc0030c0 tx=0x7f33cc017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:46.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.557+0000 7f33c67fc700 1 -- 172.21.15.153:0/1481650954 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f33d004c510 con 0x7f33d815a8d0 2024-08-17T02:26:46.762 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:46.757+0000 7f33dc994700 1 -- 172.21.15.153:0/1481650954 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f33d80cb460 con 0x7f33d815a8d0 2024-08-17T02:26:47.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.413+0000 7f33c67fc700 1 -- 172.21.15.153:0/1481650954 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7f33d004fb30 con 0x7f33d815a8d0 2024-08-17T02:26:47.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.417+0000 7f33dc994700 1 -- 172.21.15.153:0/1481650954 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f33b8060860 msgr2=0x7f33b8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.417+0000 7f33dc994700 1 --2- 172.21.15.153:0/1481650954 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f33b8060860 0x7f33b8062d10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f33cc0030c0 tx=0x7f33cc017000 comp rx=0 tx=0).stop 2024-08-17T02:26:47.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.417+0000 7f33dc994700 1 -- 172.21.15.153:0/1481650954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33d815a8d0 msgr2=0x7f33d80a9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.417+0000 7f33dc994700 1 --2- 172.21.15.153:0/1481650954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33d815a8d0 0x7f33d80a9860 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f33d000c5d0 tx=0x7f33d0007d70 comp rx=0 tx=0).stop 2024-08-17T02:26:47.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.417+0000 7f33dc994700 1 -- 172.21.15.153:0/1481650954 shutdown_connections 2024-08-17T02:26:47.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.417+0000 7f33dc994700 1 --2- 172.21.15.153:0/1481650954 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f33b8060860 0x7f33b8062d10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.417+0000 7f33dc994700 1 --2- 172.21.15.153:0/1481650954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33d815a8d0 0x7f33d80a9860 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.417+0000 7f33dc994700 1 --2- 172.21.15.153:0/1481650954 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f33d815a500 0x7f33d80aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.417+0000 7f33dc994700 1 --2- 172.21.15.153:0/1481650954 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33d8068db0 0x7f33d80cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.417+0000 7f33dc994700 1 -- 172.21.15.153:0/1481650954 >> 172.21.15.153:0/1481650954 conn(0x7f33d80c9bf0 msgr2=0x7f33d81597b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:47.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.417+0000 7f33dc994700 1 -- 172.21.15.153:0/1481650954 shutdown_connections 2024-08-17T02:26:47.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.417+0000 7f33dc994700 1 -- 172.21.15.153:0/1481650954 wait complete. 2024-08-17T02:26:47.436 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:26:47.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.549+0000 7f37b7108700 1 Processor -- start 2024-08-17T02:26:47.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.549+0000 7f37b7108700 1 -- start start 2024-08-17T02:26:47.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.553+0000 7f37b7108700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37b00b2e70 0x7f37b00cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.553+0000 7f37b7108700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f37b00cc230 0x7f37b00c6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.553+0000 7f37b7108700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37b00c5bb0 con 0x7f37b00ce640 2024-08-17T02:26:47.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.553+0000 7f37b7108700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37b00cc670 con 0x7f37b00cc230 2024-08-17T02:26:47.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.553+0000 7f37b7108700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b00b32c0 con 0x7f37b00b2e70 2024-08-17T02:26:47.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.553+0000 7f37b6907700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f37b00cc230 0x7f37b00c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.553+0000 7f37b6907700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f37b00cc230 0x7f37b00c6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55102/0 (socket says 172.21.15.153:55102) 2024-08-17T02:26:47.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.553+0000 7f37b6907700 1 -- 172.21.15.153:0/2413489566 learned_addr learned my addr 172.21.15.153:0/2413489566 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:47.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.553+0000 7f37b6106700 1 --1- 172.21.15.153:0/2413489566 >> v1:172.21.15.153:6789/0 conn(0x7f37b00ce640 0x7f37b00cea10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:55520/0 (socket says 172.21.15.153:55520) 2024-08-17T02:26:47.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.553+0000 7f37b5905700 1 --2- 172.21.15.153:0/2413489566 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37b00b2e70 0x7f37b00cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.553+0000 7f37b6907700 1 -- 172.21.15.153:0/2413489566 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37b00b2e70 msgr2=0x7f37b00cbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:47.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.553+0000 7f37b6907700 1 --2- 172.21.15.153:0/2413489566 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37b00b2e70 0x7f37b00cbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.553+0000 7f37b6907700 1 -- 172.21.15.153:0/2413489566 >> v1:172.21.15.153:6789/0 conn(0x7f37b00ce640 legacy=0x7f37b00cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.553+0000 7f37b6907700 1 -- 172.21.15.153:0/2413489566 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b00c4fa0 con 0x7f37b00cc230 2024-08-17T02:26:47.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.553+0000 7f37b6907700 1 --2- 172.21.15.153:0/2413489566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37b00cc230 0x7f37b00c6040 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f37a8009f20 tx=0x7f37a8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2331097a4406d2a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.553+0000 7f37b5104700 1 -- 172.21.15.153:0/2413489566 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a800e070 con 0x7f37b00cc230 2024-08-17T02:26:47.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.553+0000 7f37b5104700 1 -- 172.21.15.153:0/2413489566 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a800ba80 con 0x7f37b00cc230 2024-08-17T02:26:47.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.553+0000 7f37b5104700 1 -- 172.21.15.153:0/2413489566 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a80092e0 con 0x7f37b00cc230 2024-08-17T02:26:47.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.553+0000 7f37b7108700 1 -- 172.21.15.153:0/2413489566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37b00cc230 msgr2=0x7f37b00c6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.553+0000 7f37b7108700 1 --2- 172.21.15.153:0/2413489566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37b00cc230 0x7f37b00c6040 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f37a8009f20 tx=0x7f37a8009840 comp rx=0 tx=0).stop 2024-08-17T02:26:47.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.553+0000 7f37b7108700 1 -- 172.21.15.153:0/2413489566 shutdown_connections 2024-08-17T02:26:47.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.553+0000 7f37b7108700 1 --2- 172.21.15.153:0/2413489566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37b00cc230 0x7f37b00c6040 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.553+0000 7f37b7108700 1 --2- 172.21.15.153:0/2413489566 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37b00b2e70 0x7f37b00cbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.553+0000 7f37b7108700 1 -- 172.21.15.153:0/2413489566 >> 172.21.15.153:0/2413489566 conn(0x7f37b0099410 msgr2=0x7f37b00675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:47.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.553+0000 7f37b7108700 1 -- 172.21.15.153:0/2413489566 shutdown_connections 2024-08-17T02:26:47.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.553+0000 7f37b7108700 1 -- 172.21.15.153:0/2413489566 wait complete. 2024-08-17T02:26:47.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.557+0000 7f37b7108700 1 Processor -- start 2024-08-17T02:26:47.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.557+0000 7f37b7108700 1 -- start start 2024-08-17T02:26:47.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.557+0000 7f37b7108700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37b00b2e70 0x7f37b0152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.557+0000 7f37b7108700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37b00cc230 0x7f37b0157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.557+0000 7f37b7108700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37b00ce640 0x7f37b0068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.557+0000 7f37b7108700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b0154b60 con 0x7f37b00ce640 2024-08-17T02:26:47.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.557+0000 7f37b7108700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b0155910 con 0x7f37b00b2e70 2024-08-17T02:26:47.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.557+0000 7f37b7108700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b0154d90 con 0x7f37b00cc230 2024-08-17T02:26:47.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.557+0000 7f37b6907700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37b00ce640 0x7f37b0068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.557+0000 7f37b6907700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37b00ce640 0x7f37b0068320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55106/0 (socket says 172.21.15.153:55106) 2024-08-17T02:26:47.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.557+0000 7f37b6907700 1 -- 172.21.15.153:0/3383849459 learned_addr learned my addr 172.21.15.153:0/3383849459 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:47.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.557+0000 7f37b5905700 1 --2- 172.21.15.153:0/3383849459 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37b00cc230 0x7f37b0157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.557+0000 7f37b6106700 1 --2- 172.21.15.153:0/3383849459 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37b00b2e70 0x7f37b0152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.557+0000 7f37b6907700 1 -- 172.21.15.153:0/3383849459 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37b00cc230 msgr2=0x7f37b0157890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.557+0000 7f37b6907700 1 --2- 172.21.15.153:0/3383849459 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37b00cc230 0x7f37b0157890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.557+0000 7f37b6907700 1 -- 172.21.15.153:0/3383849459 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37b00b2e70 msgr2=0x7f37b0152fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.557+0000 7f37b6907700 1 --2- 172.21.15.153:0/3383849459 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37b00b2e70 0x7f37b0152fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.557+0000 7f37b6907700 1 -- 172.21.15.153:0/3383849459 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a8009ae0 con 0x7f37b00ce640 2024-08-17T02:26:47.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.557+0000 7f37b5905700 1 --2- 172.21.15.153:0/3383849459 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37b00cc230 0x7f37b0157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:47.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.557+0000 7f37b6106700 1 --2- 172.21.15.153:0/3383849459 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37b00b2e70 0x7f37b0152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:47.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.561+0000 7f37b6907700 1 --2- 172.21.15.153:0/3383849459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37b00ce640 0x7f37b0068320 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f37a800b6c0 tx=0x7f37a8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.561+0000 7f37a67fc700 1 -- 172.21.15.153:0/3383849459 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a8007e70 con 0x7f37b00ce640 2024-08-17T02:26:47.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.561+0000 7f37a67fc700 1 -- 172.21.15.153:0/3383849459 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a80092e0 con 0x7f37b00ce640 2024-08-17T02:26:47.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.561+0000 7f37b7108700 1 -- 172.21.15.153:0/3383849459 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37b0155070 con 0x7f37b00ce640 2024-08-17T02:26:47.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.561+0000 7f37a67fc700 1 -- 172.21.15.153:0/3383849459 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a801d670 con 0x7f37b00ce640 2024-08-17T02:26:47.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.561+0000 7f37b7108700 1 -- 172.21.15.153:0/3383849459 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37b0155630 con 0x7f37b00ce640 2024-08-17T02:26:47.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.561+0000 7f37b7108700 1 -- 172.21.15.153:0/3383849459 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37b0155b50 con 0x7f37b00ce640 2024-08-17T02:26:47.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.565+0000 7f37a67fc700 1 -- 172.21.15.153:0/3383849459 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f37a8003050 con 0x7f37b00ce640 2024-08-17T02:26:47.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.565+0000 7f37a67fc700 1 --2- 172.21.15.153:0/3383849459 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3794060860 0x7f3794062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.565+0000 7f37a67fc700 1 -- 172.21.15.153:0/3383849459 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f37a807eae0 con 0x7f37b00ce640 2024-08-17T02:26:47.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.565+0000 7f37b6106700 1 --2- 172.21.15.153:0/3383849459 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3794060860 0x7f3794062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.565+0000 7f37b6106700 1 --2- 172.21.15.153:0/3383849459 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3794060860 0x7f3794062d10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f37a0007fd0 tx=0x7f37a0007dd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.569+0000 7f37a67fc700 1 -- 172.21.15.153:0/3383849459 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f37a804ef60 con 0x7f37b00ce640 2024-08-17T02:26:47.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:47.737+0000 7f37b7108700 1 -- 172.21.15.153:0/3383849459 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f37b0155b50 con 0x7f37b00ce640 2024-08-17T02:26:48.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.421+0000 7f37a67fc700 1 -- 172.21.15.153:0/3383849459 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) v1 ==== 181+0+0 (secure 0 0 0) 0x7f37b0155b50 con 0x7f37b00ce640 2024-08-17T02:26:48.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.425+0000 7f37b7108700 1 -- 172.21.15.153:0/3383849459 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3794060860 msgr2=0x7f3794062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.425+0000 7f37b7108700 1 --2- 172.21.15.153:0/3383849459 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3794060860 0x7f3794062d10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f37a0007fd0 tx=0x7f37a0007dd0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.425+0000 7f37b7108700 1 -- 172.21.15.153:0/3383849459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37b00ce640 msgr2=0x7f37b0068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.425+0000 7f37b7108700 1 --2- 172.21.15.153:0/3383849459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37b00ce640 0x7f37b0068320 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f37a800b6c0 tx=0x7f37a8018000 comp rx=0 tx=0).stop 2024-08-17T02:26:48.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.425+0000 7f37b7108700 1 -- 172.21.15.153:0/3383849459 shutdown_connections 2024-08-17T02:26:48.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.425+0000 7f37b7108700 1 --2- 172.21.15.153:0/3383849459 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3794060860 0x7f3794062d10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.425+0000 7f37b7108700 1 --2- 172.21.15.153:0/3383849459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37b00ce640 0x7f37b0068320 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.425+0000 7f37b7108700 1 --2- 172.21.15.153:0/3383849459 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37b00cc230 0x7f37b0157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.425+0000 7f37b7108700 1 --2- 172.21.15.153:0/3383849459 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37b00b2e70 0x7f37b0152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.425+0000 7f37b7108700 1 -- 172.21.15.153:0/3383849459 >> 172.21.15.153:0/3383849459 conn(0x7f37b0099410 msgr2=0x7f37b00cc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:48.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.425+0000 7f37b7108700 1 -- 172.21.15.153:0/3383849459 shutdown_connections 2024-08-17T02:26:48.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.425+0000 7f37b7108700 1 -- 172.21.15.153:0/3383849459 wait complete. 2024-08-17T02:26:48.430 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:26:48.444 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:26:48.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.557+0000 7fa193050700 1 Processor -- start 2024-08-17T02:26:48.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.557+0000 7fa193050700 1 -- start start 2024-08-17T02:26:48.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.561+0000 7fa193050700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa18c0cd3d0 0x7fa18c0cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.561+0000 7fa193050700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa18c0ac1b0 0x7fa18c0a9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.561+0000 7fa193050700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa18c0ad5b0 con 0x7fa18c158b70 2024-08-17T02:26:48.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.561+0000 7fa193050700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa18c0ac630 con 0x7fa18c0ac1b0 2024-08-17T02:26:48.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.561+0000 7fa193050700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c0acc80 con 0x7fa18c0cd3d0 2024-08-17T02:26:48.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.561+0000 7fa19284f700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fa18c158b70 0x7fa18c158fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.153:43624/0 (socket says 172.21.15.153:43624) 2024-08-17T02:26:48.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.561+0000 7fa19284f700 1 -- 172.21.15.153:0/4231195650 learned_addr learned my addr 172.21.15.153:0/4231195650 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:48.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.561+0000 7fa19204e700 1 --2- 172.21.15.153:0/4231195650 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa18c0cd3d0 0x7fa18c0cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.561+0000 7fa19184d700 1 --2- 172.21.15.153:0/4231195650 >> v2:172.21.15.153:3300/0 conn(0x7fa18c0ac1b0 0x7fa18c0a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.561+0000 7fa19184d700 1 -- 172.21.15.153:0/4231195650 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa18c0cd3d0 msgr2=0x7fa18c0cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:48.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.561+0000 7fa19184d700 1 --2- 172.21.15.153:0/4231195650 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa18c0cd3d0 0x7fa18c0cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.561+0000 7fa19184d700 1 -- 172.21.15.153:0/4231195650 >> v1:172.21.15.174:6789/0 conn(0x7fa18c158b70 legacy=0x7fa18c158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.561+0000 7fa19184d700 1 -- 172.21.15.153:0/4231195650 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa18c0acf60 con 0x7fa18c0ac1b0 2024-08-17T02:26:48.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.561+0000 7fa19104c700 1 -- 172.21.15.153:0/4231195650 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2760907003 0 0) 0x7fa18c0ad5b0 con 0x7fa18c158b70 2024-08-17T02:26:48.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.565+0000 7fa19184d700 1 --2- 172.21.15.153:0/4231195650 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa18c0ac1b0 0x7fa18c0a9860 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa1880098e0 tx=0x7fa1880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64b454fc639f3462 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.565+0000 7fa19104c700 1 -- 172.21.15.153:0/4231195650 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa188009e80 con 0x7fa18c0ac1b0 2024-08-17T02:26:48.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.565+0000 7fa19104c700 1 -- 172.21.15.153:0/4231195650 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa18800b860 con 0x7fa18c0ac1b0 2024-08-17T02:26:48.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.565+0000 7fa19104c700 1 -- 172.21.15.153:0/4231195650 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18800bc00 con 0x7fa18c0ac1b0 2024-08-17T02:26:48.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.565+0000 7fa193050700 1 -- 172.21.15.153:0/4231195650 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa18c0ac1b0 msgr2=0x7fa18c0a9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.565+0000 7fa193050700 1 --2- 172.21.15.153:0/4231195650 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa18c0ac1b0 0x7fa18c0a9860 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa1880098e0 tx=0x7fa1880091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.569+0000 7fa193050700 1 -- 172.21.15.153:0/4231195650 shutdown_connections 2024-08-17T02:26:48.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.569+0000 7fa193050700 1 --2- 172.21.15.153:0/4231195650 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa18c0ac1b0 0x7fa18c0a9860 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.569+0000 7fa193050700 1 --2- 172.21.15.153:0/4231195650 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa18c0cd3d0 0x7fa18c0cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.569+0000 7fa193050700 1 -- 172.21.15.153:0/4231195650 >> 172.21.15.153:0/4231195650 conn(0x7fa18c0ccdd0 msgr2=0x7fa18c0b1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:48.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.569+0000 7fa193050700 1 -- 172.21.15.153:0/4231195650 shutdown_connections 2024-08-17T02:26:48.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.569+0000 7fa193050700 1 -- 172.21.15.153:0/4231195650 wait complete. 2024-08-17T02:26:48.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.569+0000 7fa193050700 1 Processor -- start 2024-08-17T02:26:48.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.569+0000 7fa193050700 1 -- start start 2024-08-17T02:26:48.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.569+0000 7fa193050700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa18c0ac1b0 0x7fa18c1549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.569+0000 7fa193050700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa18c0cd3d0 0x7fa18c0a5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.573+0000 7fa193050700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa18c158b70 0x7fa18c0b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.573+0000 7fa193050700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c154ee0 con 0x7fa18c0ac1b0 2024-08-17T02:26:48.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.573+0000 7fa193050700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c15a0d0 con 0x7fa18c0cd3d0 2024-08-17T02:26:48.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.573+0000 7fa193050700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c0a5d00 con 0x7fa18c158b70 2024-08-17T02:26:48.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.573+0000 7fa19204e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa18c0ac1b0 0x7fa18c1549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.573+0000 7fa19204e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa18c0ac1b0 0x7fa18c1549a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55114/0 (socket says 172.21.15.153:55114) 2024-08-17T02:26:48.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.573+0000 7fa19204e700 1 -- 172.21.15.153:0/116808538 learned_addr learned my addr 172.21.15.153:0/116808538 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:48.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.573+0000 7fa19184d700 1 --2- 172.21.15.153:0/116808538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa18c0cd3d0 0x7fa18c0a5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.573+0000 7fa19204e700 1 -- 172.21.15.153:0/116808538 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa18c158b70 msgr2=0x7fa18c0b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.573+0000 7fa19204e700 1 --2- 172.21.15.153:0/116808538 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa18c158b70 0x7fa18c0b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.573+0000 7fa19204e700 1 -- 172.21.15.153:0/116808538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa18c0cd3d0 msgr2=0x7fa18c0a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.573+0000 7fa19204e700 1 --2- 172.21.15.153:0/116808538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa18c0cd3d0 0x7fa18c0a5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.573+0000 7fa19204e700 1 -- 172.21.15.153:0/116808538 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa188009420 con 0x7fa18c0ac1b0 2024-08-17T02:26:48.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.573+0000 7fa19204e700 1 --2- 172.21.15.153:0/116808538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa18c0ac1b0 0x7fa18c1549a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa17c00d890 tx=0x7fa17c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.573+0000 7fa1827fc700 1 -- 172.21.15.153:0/116808538 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c00b600 con 0x7fa18c0ac1b0 2024-08-17T02:26:48.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.573+0000 7fa1827fc700 1 -- 172.21.15.153:0/116808538 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa17c00b760 con 0x7fa18c0ac1b0 2024-08-17T02:26:48.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.573+0000 7fa193050700 1 -- 172.21.15.153:0/116808538 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa18c0a5fa0 con 0x7fa18c0ac1b0 2024-08-17T02:26:48.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.573+0000 7fa1827fc700 1 -- 172.21.15.153:0/116808538 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c00bae0 con 0x7fa18c0ac1b0 2024-08-17T02:26:48.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.573+0000 7fa193050700 1 -- 172.21.15.153:0/116808538 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa18c159a80 con 0x7fa18c0ac1b0 2024-08-17T02:26:48.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.573+0000 7fa193050700 1 -- 172.21.15.153:0/116808538 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa18c06f1a0 con 0x7fa18c0ac1b0 2024-08-17T02:26:48.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.573+0000 7fa1827fc700 1 -- 172.21.15.153:0/116808538 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa17c01e460 con 0x7fa18c0ac1b0 2024-08-17T02:26:48.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.573+0000 7fa1827fc700 1 --2- 172.21.15.153:0/116808538 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fa170060860 0x7fa170062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.573+0000 7fa1827fc700 1 -- 172.21.15.153:0/116808538 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5353+0+0 (secure 0 0 0) 0x7fa17c07d0e0 con 0x7fa18c0ac1b0 2024-08-17T02:26:48.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.573+0000 7fa19184d700 1 --2- 172.21.15.153:0/116808538 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fa170060860 0x7fa170062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.577+0000 7fa19184d700 1 --2- 172.21.15.153:0/116808538 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fa170060860 0x7fa170062d10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa1880093f0 tx=0x7fa188017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.581+0000 7fa1827fc700 1 -- 172.21.15.153:0/116808538 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa18c06f1a0 con 0x7fa18c0ac1b0 2024-08-17T02:26:48.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:48.737+0000 7fa193050700 1 -- 172.21.15.153:0/116808538 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa18c06f1a0 con 0x7fa18c0ac1b0 2024-08-17T02:26:49.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.429+0000 7fa1827fc700 1 -- 172.21.15.153:0/116808538 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa18c06f1a0 con 0x7fa18c0ac1b0 2024-08-17T02:26:49.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.433+0000 7fa193050700 1 -- 172.21.15.153:0/116808538 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fa170060860 msgr2=0x7fa170062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.433+0000 7fa193050700 1 --2- 172.21.15.153:0/116808538 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fa170060860 0x7fa170062d10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa1880093f0 tx=0x7fa188017000 comp rx=0 tx=0).stop 2024-08-17T02:26:49.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.433+0000 7fa193050700 1 -- 172.21.15.153:0/116808538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa18c0ac1b0 msgr2=0x7fa18c1549a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.433+0000 7fa193050700 1 --2- 172.21.15.153:0/116808538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa18c0ac1b0 0x7fa18c1549a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa17c00d890 tx=0x7fa17c008040 comp rx=0 tx=0).stop 2024-08-17T02:26:49.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.433+0000 7fa193050700 1 -- 172.21.15.153:0/116808538 shutdown_connections 2024-08-17T02:26:49.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.433+0000 7fa193050700 1 --2- 172.21.15.153:0/116808538 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fa170060860 0x7fa170062d10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.433+0000 7fa193050700 1 --2- 172.21.15.153:0/116808538 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa18c158b70 0x7fa18c0b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.433+0000 7fa193050700 1 --2- 172.21.15.153:0/116808538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa18c0cd3d0 0x7fa18c0a5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.433+0000 7fa193050700 1 --2- 172.21.15.153:0/116808538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa18c0ac1b0 0x7fa18c1549a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.433+0000 7fa193050700 1 -- 172.21.15.153:0/116808538 >> 172.21.15.153:0/116808538 conn(0x7fa18c0ccdd0 msgr2=0x7fa18c0afe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:49.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.433+0000 7fa193050700 1 -- 172.21.15.153:0/116808538 shutdown_connections 2024-08-17T02:26:49.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.433+0000 7fa193050700 1 -- 172.21.15.153:0/116808538 wait complete. 2024-08-17T02:26:49.437 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' removed 2024-08-17T02:26:49.449 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:26:49.449 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-17T02:26:49.449 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:26:49.449 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:26:49.449 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:26:49.449 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-17T02:26:49.449 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:26:49.450 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:26:49.450 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:26:49.450 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-17T02:26:49.450 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:26:49.450 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:26:49.450 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:26:49.450 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-17T02:26:49.451 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:26:49.451 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:26:49.460 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:26:49.461 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:26:49.462 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:26:49.462 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:26:49.463 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:26:49.463 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:26:49.464 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:26:49.464 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:26:49.465 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:26:49.465 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:49.466 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:26:49.466 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:49.467 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:26:49.467 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:49.467 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:26:49.468 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:49.468 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-17T02:26:49.527 INFO:tasks.ceph.mds.a.smithi153.stdout:starting mds.a at 2024-08-17T02:26:49.535 INFO:tasks.ceph.mds.d.smithi174.stdout:starting mds.d at 2024-08-17T02:26:49.536 INFO:tasks.ceph.mds.b.smithi174.stdout:starting mds.b at 2024-08-17T02:26:49.541 INFO:tasks.ceph.mds.c.smithi153.stdout:starting mds.c at 2024-08-17T02:26:49.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.573+0000 7f2b3b8dd700 1 Processor -- start 2024-08-17T02:26:49.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.573+0000 7f2b3b8dd700 1 -- start start 2024-08-17T02:26:49.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.577+0000 7f2b3b8dd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2b340c8d10 0x7f2b340c90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.577+0000 7f2b3b8dd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2b34156fe0 0x7f2b34153640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.577+0000 7f2b3b8dd700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b34153fe0 con 0x7f2b34153b80 2024-08-17T02:26:49.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.577+0000 7f2b3b8dd700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b3415aac0 con 0x7f2b340c8d10 2024-08-17T02:26:49.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.577+0000 7f2b3b8dd700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b34159eb0 con 0x7f2b34156fe0 2024-08-17T02:26:49.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.577+0000 7f2b39679700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2b340c8d10 0x7f2b340c90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.577+0000 7f2b39679700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2b340c8d10 0x7f2b340c90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55144/0 (socket says 172.21.15.153:55144) 2024-08-17T02:26:49.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.577+0000 7f2b39679700 1 -- 172.21.15.153:0/821471789 learned_addr learned my addr 172.21.15.153:0/821471789 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:49.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.577+0000 7f2b38e78700 1 --2- 172.21.15.153:0/821471789 >> v2:172.21.15.174:3300/0 conn(0x7f2b34156fe0 0x7f2b34153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.577+0000 7f2b39679700 1 -- 172.21.15.153:0/821471789 >> v2:172.21.15.174:3300/0 conn(0x7f2b34156fe0 msgr2=0x7f2b34153640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:49.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.577+0000 7f2b39679700 1 --2- 172.21.15.153:0/821471789 >> v2:172.21.15.174:3300/0 conn(0x7f2b34156fe0 0x7f2b34153640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.577+0000 7f2b39679700 1 -- 172.21.15.153:0/821471789 >> v1:172.21.15.174:6789/0 conn(0x7f2b34153b80 legacy=0x7f2b340c74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.577+0000 7f2b39679700 1 -- 172.21.15.153:0/821471789 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3415a190 con 0x7f2b340c8d10 2024-08-17T02:26:49.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.577+0000 7f2b39679700 1 --2- 172.21.15.153:0/821471789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b340c8d10 0x7f2b340c90e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2b280099b0 tx=0x7f2b28009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cc985219161516c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:49.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.577+0000 7f2b27fff700 1 -- 172.21.15.153:0/821471789 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2800b7e0 con 0x7f2b340c8d10 2024-08-17T02:26:49.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.577+0000 7f2b27fff700 1 -- 172.21.15.153:0/821471789 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2800b940 con 0x7f2b340c8d10 2024-08-17T02:26:49.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.577+0000 7f2b27fff700 1 -- 172.21.15.153:0/821471789 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2800bce0 con 0x7f2b340c8d10 2024-08-17T02:26:49.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.577+0000 7f2b3b8dd700 1 -- 172.21.15.153:0/821471789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b340c8d10 msgr2=0x7f2b340c90e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.577+0000 7f2b3b8dd700 1 --2- 172.21.15.153:0/821471789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b340c8d10 0x7f2b340c90e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2b280099b0 tx=0x7f2b28009250 comp rx=0 tx=0).stop 2024-08-17T02:26:49.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.577+0000 7f2b3b8dd700 1 -- 172.21.15.153:0/821471789 shutdown_connections 2024-08-17T02:26:49.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.577+0000 7f2b3b8dd700 1 --2- 172.21.15.153:0/821471789 >> v2:172.21.15.174:3300/0 conn(0x7f2b34156fe0 0x7f2b34153640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.577+0000 7f2b3b8dd700 1 --2- 172.21.15.153:0/821471789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b340c8d10 0x7f2b340c90e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.577+0000 7f2b3b8dd700 1 -- 172.21.15.153:0/821471789 >> 172.21.15.153:0/821471789 conn(0x7f2b340cd9a0 msgr2=0x7f2b340c99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:49.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.577+0000 7f2b3b8dd700 1 -- 172.21.15.153:0/821471789 shutdown_connections 2024-08-17T02:26:49.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.577+0000 7f2b3b8dd700 1 -- 172.21.15.153:0/821471789 wait complete. 2024-08-17T02:26:49.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.577+0000 7f2b3b8dd700 1 Processor -- start 2024-08-17T02:26:49.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.577+0000 7f2b3b8dd700 1 -- start start 2024-08-17T02:26:49.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.577+0000 7f2b3b8dd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b340c8d10 0x7f2b340aef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.577+0000 7f2b3b8dd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b34153b80 0x7f2b3414fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.577+0000 7f2b3b8dd700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b34156fe0 0x7f2b34156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.577+0000 7f2b3b8dd700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b340b0670 con 0x7f2b340c8d10 2024-08-17T02:26:49.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.577+0000 7f2b3b8dd700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b34155ff0 con 0x7f2b34156fe0 2024-08-17T02:26:49.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.577+0000 7f2b3b8dd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b340b0390 con 0x7f2b34153b80 2024-08-17T02:26:49.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.581+0000 7f2b39679700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b340c8d10 0x7f2b340aef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.581+0000 7f2b39679700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b340c8d10 0x7f2b340aef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55156/0 (socket says 172.21.15.153:55156) 2024-08-17T02:26:49.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.581+0000 7f2b39679700 1 -- 172.21.15.153:0/623338714 learned_addr learned my addr 172.21.15.153:0/623338714 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:49.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.581+0000 7f2b38e78700 1 --2- 172.21.15.153:0/623338714 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b34153b80 0x7f2b3414fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.581+0000 7f2b39e7a700 1 --2- 172.21.15.153:0/623338714 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b34156fe0 0x7f2b34156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.581+0000 7f2b39679700 1 -- 172.21.15.153:0/623338714 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b34153b80 msgr2=0x7f2b3414fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.581+0000 7f2b39679700 1 --2- 172.21.15.153:0/623338714 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b34153b80 0x7f2b3414fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.581+0000 7f2b39679700 1 -- 172.21.15.153:0/623338714 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b34156fe0 msgr2=0x7f2b34156480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.581+0000 7f2b39679700 1 --2- 172.21.15.153:0/623338714 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b34156fe0 0x7f2b34156480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.581+0000 7f2b39679700 1 -- 172.21.15.153:0/623338714 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b280094f0 con 0x7f2b340c8d10 2024-08-17T02:26:49.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.581+0000 7f2b39679700 1 --2- 172.21.15.153:0/623338714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b340c8d10 0x7f2b340aef20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2b34067310 tx=0x7f2b28016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:49.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.581+0000 7f2b257fa700 1 -- 172.21.15.153:0/623338714 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b28011bb0 con 0x7f2b340c8d10 2024-08-17T02:26:49.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.581+0000 7f2b257fa700 1 -- 172.21.15.153:0/623338714 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b28020070 con 0x7f2b340c8d10 2024-08-17T02:26:49.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.581+0000 7f2b3b8dd700 1 -- 172.21.15.153:0/623338714 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b341559a0 con 0x7f2b340c8d10 2024-08-17T02:26:49.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.581+0000 7f2b257fa700 1 -- 172.21.15.153:0/623338714 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2801c450 con 0x7f2b340c8d10 2024-08-17T02:26:49.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.581+0000 7f2b3b8dd700 1 -- 172.21.15.153:0/623338714 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b340af460 con 0x7f2b340c8d10 2024-08-17T02:26:49.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.581+0000 7f2b3b8dd700 1 -- 172.21.15.153:0/623338714 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b340645c0 con 0x7f2b340c8d10 2024-08-17T02:26:49.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.581+0000 7f2b257fa700 1 -- 172.21.15.153:0/623338714 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2b28022030 con 0x7f2b340c8d10 2024-08-17T02:26:49.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.585+0000 7f2b257fa700 1 --2- 172.21.15.153:0/623338714 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2b18060860 0x7f2b18062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.585+0000 7f2b257fa700 1 -- 172.21.15.153:0/623338714 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2b2807e3d0 con 0x7f2b340c8d10 2024-08-17T02:26:49.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.585+0000 7f2b38e78700 1 --2- 172.21.15.153:0/623338714 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2b18060860 0x7f2b18062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.585+0000 7f2b38e78700 1 --2- 172.21.15.153:0/623338714 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2b18060860 0x7f2b18062d10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2b340c7460 tx=0x7f2b30008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:49.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.589+0000 7f2b257fa700 1 -- 172.21.15.153:0/623338714 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f2b2804eb20 con 0x7f2b340c8d10 2024-08-17T02:26:49.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:49.765+0000 7f2b3b8dd700 1 -- 172.21.15.153:0/623338714 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f2b340cc870 con 0x7f2b340c8d10 2024-08-17T02:26:50.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.461+0000 7f2b257fa700 1 -- 172.21.15.153:0/623338714 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2b28052140 con 0x7f2b340c8d10 2024-08-17T02:26:50.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.465+0000 7f2b3b8dd700 1 -- 172.21.15.153:0/623338714 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2b18060860 msgr2=0x7f2b18062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.465+0000 7f2b3b8dd700 1 --2- 172.21.15.153:0/623338714 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2b18060860 0x7f2b18062d10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2b340c7460 tx=0x7f2b30008040 comp rx=0 tx=0).stop 2024-08-17T02:26:50.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.465+0000 7f2b3b8dd700 1 -- 172.21.15.153:0/623338714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b340c8d10 msgr2=0x7f2b340aef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.465+0000 7f2b3b8dd700 1 --2- 172.21.15.153:0/623338714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b340c8d10 0x7f2b340aef20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2b34067310 tx=0x7f2b28016000 comp rx=0 tx=0).stop 2024-08-17T02:26:50.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.465+0000 7f2b3b8dd700 1 -- 172.21.15.153:0/623338714 shutdown_connections 2024-08-17T02:26:50.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.465+0000 7f2b3b8dd700 1 --2- 172.21.15.153:0/623338714 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2b18060860 0x7f2b18062d10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.465+0000 7f2b3b8dd700 1 --2- 172.21.15.153:0/623338714 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b34156fe0 0x7f2b34156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.465+0000 7f2b3b8dd700 1 --2- 172.21.15.153:0/623338714 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b34153b80 0x7f2b3414fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.465+0000 7f2b3b8dd700 1 --2- 172.21.15.153:0/623338714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b340c8d10 0x7f2b340aef20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.465+0000 7f2b3b8dd700 1 -- 172.21.15.153:0/623338714 >> 172.21.15.153:0/623338714 conn(0x7f2b340cd9a0 msgr2=0x7f2b340c90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:50.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.465+0000 7f2b3b8dd700 1 -- 172.21.15.153:0/623338714 shutdown_connections 2024-08-17T02:26:50.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.465+0000 7f2b3b8dd700 1 -- 172.21.15.153:0/623338714 wait complete. 2024-08-17T02:26:50.469 INFO:teuthology.orchestra.run.smithi153.stderr: removed all blocklist entries 2024-08-17T02:26:50.484 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-17T02:26:50.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.589+0000 7f06cd2e1700 1 Processor -- start 2024-08-17T02:26:50.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.589+0000 7f06cd2e1700 1 -- start start 2024-08-17T02:26:50.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.589+0000 7f06cd2e1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06c815c5a0 0x7f06c80caac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.589+0000 7f06cd2e1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f06c80cb000 0x7f06c80686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.589+0000 7f06cd2e1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f06c815c970 0x7f06c8068be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.589+0000 7f06cd2e1700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c80cb510 con 0x7f06c815c970 2024-08-17T02:26:50.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.589+0000 7f06cd2e1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c80c6c80 con 0x7f06c80cb000 2024-08-17T02:26:50.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.589+0000 7f06cd2e1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c80c77c0 con 0x7f06c815c5a0 2024-08-17T02:26:50.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.589+0000 7f06c77fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f06c815c970 0x7f06c8068be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.593+0000 7f06c77fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f06c815c970 0x7f06c8068be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55164/0 (socket says 172.21.15.153:55164) 2024-08-17T02:26:50.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.593+0000 7f06c77fe700 1 -- 172.21.15.153:0/3047268102 learned_addr learned my addr 172.21.15.153:0/3047268102 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:50.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.593+0000 7f06be7fc700 1 --2- 172.21.15.153:0/3047268102 >> v2:172.21.15.174:3300/0 conn(0x7f06c80cb000 0x7f06c80686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.593+0000 7f06c6ffd700 1 --2- 172.21.15.153:0/3047268102 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06c815c5a0 0x7f06c80caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.593+0000 7f06c77fe700 1 -- 172.21.15.153:0/3047268102 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06c815c5a0 msgr2=0x7f06c80caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:50.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.593+0000 7f06c77fe700 1 --2- 172.21.15.153:0/3047268102 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06c815c5a0 0x7f06c80caac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.593+0000 7f06c77fe700 1 -- 172.21.15.153:0/3047268102 >> v2:172.21.15.174:3300/0 conn(0x7f06c80cb000 msgr2=0x7f06c80686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:50.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.593+0000 7f06c77fe700 1 --2- 172.21.15.153:0/3047268102 >> v2:172.21.15.174:3300/0 conn(0x7f06c80cb000 0x7f06c80686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.593+0000 7f06c77fe700 1 -- 172.21.15.153:0/3047268102 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c80c6e90 con 0x7f06c815c970 2024-08-17T02:26:50.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.593+0000 7f06be7fc700 1 --2- 172.21.15.153:0/3047268102 >> v2:172.21.15.174:3300/0 conn(0x7f06c80cb000 0x7f06c80686a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:50.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.593+0000 7f06c77fe700 1 --2- 172.21.15.153:0/3047268102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06c815c970 0x7f06c8068be0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f06c80701a0 tx=0x7f06c0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d74688075204619 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:50.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.593+0000 7f06c67fc700 1 -- 172.21.15.153:0/3047268102 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c000e070 con 0x7f06c815c970 2024-08-17T02:26:50.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.593+0000 7f06c67fc700 1 -- 172.21.15.153:0/3047268102 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c000ba20 con 0x7f06c815c970 2024-08-17T02:26:50.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.593+0000 7f06c67fc700 1 -- 172.21.15.153:0/3047268102 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c00092e0 con 0x7f06c815c970 2024-08-17T02:26:50.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.593+0000 7f06cd2e1700 1 -- 172.21.15.153:0/3047268102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06c815c970 msgr2=0x7f06c8068be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.593+0000 7f06cd2e1700 1 --2- 172.21.15.153:0/3047268102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06c815c970 0x7f06c8068be0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f06c80701a0 tx=0x7f06c0009840 comp rx=0 tx=0).stop 2024-08-17T02:26:50.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.593+0000 7f06cd2e1700 1 -- 172.21.15.153:0/3047268102 shutdown_connections 2024-08-17T02:26:50.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.593+0000 7f06cd2e1700 1 --2- 172.21.15.153:0/3047268102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06c815c970 0x7f06c8068be0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.593+0000 7f06cd2e1700 1 --2- 172.21.15.153:0/3047268102 >> v2:172.21.15.174:3300/0 conn(0x7f06c80cb000 0x7f06c80686a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.593+0000 7f06cd2e1700 1 --2- 172.21.15.153:0/3047268102 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06c815c5a0 0x7f06c80caac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.593+0000 7f06cd2e1700 1 -- 172.21.15.153:0/3047268102 >> 172.21.15.153:0/3047268102 conn(0x7f06c80c9c20 msgr2=0x7f06c806d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:50.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.593+0000 7f06cd2e1700 1 -- 172.21.15.153:0/3047268102 shutdown_connections 2024-08-17T02:26:50.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.593+0000 7f06cd2e1700 1 -- 172.21.15.153:0/3047268102 wait complete. 2024-08-17T02:26:50.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.597+0000 7f06cd2e1700 1 Processor -- start 2024-08-17T02:26:50.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.597+0000 7f06cd2e1700 1 -- start start 2024-08-17T02:26:50.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.597+0000 7f06cd2e1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06c80cb000 0x7f06c8157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.597+0000 7f06cd2e1700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06c815c5a0 0x7f06c80b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.597+0000 7f06cd2e1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06c815c970 0x7f06c80c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.597+0000 7f06cd2e1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c80c4360 con 0x7f06c815c970 2024-08-17T02:26:50.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.597+0000 7f06cd2e1700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c80c3790 con 0x7f06c815c5a0 2024-08-17T02:26:50.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.597+0000 7f06cd2e1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c80c3a30 con 0x7f06c80cb000 2024-08-17T02:26:50.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.597+0000 7f06c77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06c815c970 0x7f06c80c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.597+0000 7f06c77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06c815c970 0x7f06c80c47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55166/0 (socket says 172.21.15.153:55166) 2024-08-17T02:26:50.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.597+0000 7f06c77fe700 1 -- 172.21.15.153:0/4158971939 learned_addr learned my addr 172.21.15.153:0/4158971939 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:50.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.597+0000 7f06be7fc700 1 --2- 172.21.15.153:0/4158971939 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06c815c5a0 0x7f06c80b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.597+0000 7f06c6ffd700 1 --2- 172.21.15.153:0/4158971939 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06c80cb000 0x7f06c8157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.597+0000 7f06c77fe700 1 -- 172.21.15.153:0/4158971939 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06c80cb000 msgr2=0x7f06c8157070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.597+0000 7f06c77fe700 1 --2- 172.21.15.153:0/4158971939 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06c80cb000 0x7f06c8157070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.597+0000 7f06c77fe700 1 -- 172.21.15.153:0/4158971939 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06c815c5a0 msgr2=0x7f06c80b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.597+0000 7f06c77fe700 1 --2- 172.21.15.153:0/4158971939 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06c815c5a0 0x7f06c80b04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.597+0000 7f06c77fe700 1 -- 172.21.15.153:0/4158971939 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c0009ae0 con 0x7f06c815c970 2024-08-17T02:26:50.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.597+0000 7f06c6ffd700 1 --2- 172.21.15.153:0/4158971939 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06c80cb000 0x7f06c8157070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:50.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.597+0000 7f06c77fe700 1 --2- 172.21.15.153:0/4158971939 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06c815c970 0x7f06c80c47f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f06c0012000 tx=0x7f06c0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:50.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.601+0000 7f06bf7fe700 1 -- 172.21.15.153:0/4158971939 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c00032f0 con 0x7f06c815c970 2024-08-17T02:26:50.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.601+0000 7f06bf7fe700 1 -- 172.21.15.153:0/4158971939 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c0008e60 con 0x7f06c815c970 2024-08-17T02:26:50.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.601+0000 7f06cd2e1700 1 -- 172.21.15.153:0/4158971939 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c80c3d10 con 0x7f06c815c970 2024-08-17T02:26:50.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.601+0000 7f06bf7fe700 1 -- 172.21.15.153:0/4158971939 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c0025690 con 0x7f06c815c970 2024-08-17T02:26:50.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.601+0000 7f06cd2e1700 1 -- 172.21.15.153:0/4158971939 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c81575b0 con 0x7f06c815c970 2024-08-17T02:26:50.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.601+0000 7f06cd2e1700 1 -- 172.21.15.153:0/4158971939 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c8158920 con 0x7f06c815c970 2024-08-17T02:26:50.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.601+0000 7f06bf7fe700 1 -- 172.21.15.153:0/4158971939 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f06c0003040 con 0x7f06c815c970 2024-08-17T02:26:50.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.601+0000 7f06bf7fe700 1 --2- 172.21.15.153:0/4158971939 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f06a8060860 0x7f06a8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.601+0000 7f06bf7fe700 1 -- 172.21.15.153:0/4158971939 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f06c007e660 con 0x7f06c815c970 2024-08-17T02:26:50.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.601+0000 7f06c6ffd700 1 --2- 172.21.15.153:0/4158971939 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f06a8060860 0x7f06a8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.605+0000 7f06c6ffd700 1 --2- 172.21.15.153:0/4158971939 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f06a8060860 0x7f06a8062d10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f06b8009d80 tx=0x7f06b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:50.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.609+0000 7f06bf7fe700 1 -- 172.21.15.153:0/4158971939 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f06c004ed60 con 0x7f06c815c970 2024-08-17T02:26:50.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.833+0000 7f06cd2e1700 1 -- 172.21.15.153:0/4158971939 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f06c80645c0 con 0x7f06c815c970 2024-08-17T02:26:50.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.833+0000 7f06bf7fe700 1 -- 172.21.15.153:0/4158971939 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f06c0052380 con 0x7f06c815c970 2024-08-17T02:26:50.838 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:50.838 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-08-17T02:26:50.838 INFO:teuthology.orchestra.run.smithi153.stdout: "auth_dump": [ 2024-08-17T02:26:50.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-08-17T02:26:50.838 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.a", 2024-08-17T02:26:50.838 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQD8CcBm2U+sFxAAzA6rDgNnZkpY9gZMrTw2ug==", 2024-08-17T02:26:50.838 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-08-17T02:26:50.839 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2024-08-17T02:26:50.839 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2024-08-17T02:26:50.839 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2024-08-17T02:26:50.839 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-08-17T02:26:50.839 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-17T02:26:50.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-17T02:26:50.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-08-17T02:26:50.839 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.b", 2024-08-17T02:26:50.839 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQD8CcBmnQmgIRAAuDBR2XGip6zNsZAxr0MLLw==", 2024-08-17T02:26:50.839 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-08-17T02:26:50.839 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2024-08-17T02:26:50.839 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2024-08-17T02:26:50.839 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2024-08-17T02:26:50.840 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-08-17T02:26:50.840 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-17T02:26:50.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-17T02:26:50.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-08-17T02:26:50.840 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.c", 2024-08-17T02:26:50.840 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQD8CcBmfUDIHRAAnioAeAUXY2NHEockqg8e0A==", 2024-08-17T02:26:50.840 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-08-17T02:26:50.840 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2024-08-17T02:26:50.840 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2024-08-17T02:26:50.840 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2024-08-17T02:26:50.840 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-08-17T02:26:50.840 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-17T02:26:50.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-17T02:26:50.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-08-17T02:26:50.841 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.d", 2024-08-17T02:26:50.841 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQD8CcBmRBUTJRAA0tObsMEc2W5pq4LJMGTPZA==", 2024-08-17T02:26:50.841 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-08-17T02:26:50.841 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2024-08-17T02:26:50.841 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2024-08-17T02:26:50.841 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2024-08-17T02:26:50.841 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-08-17T02:26:50.841 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-17T02:26:50.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-17T02:26:50.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-08-17T02:26:50.841 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.0", 2024-08-17T02:26:50.842 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQD/CcBmVo++HhAADJGBfNoy5d4mV58B7ryJeA==", 2024-08-17T02:26:50.842 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-08-17T02:26:50.842 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2024-08-17T02:26:50.842 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2024-08-17T02:26:50.842 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-08-17T02:26:50.842 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-17T02:26:50.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-17T02:26:50.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-08-17T02:26:50.842 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.1", 2024-08-17T02:26:50.842 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQACCsBmoQ9XIxAAuVnPjkH1q/zbdSr+wNBUQg==", 2024-08-17T02:26:50.843 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-08-17T02:26:50.843 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2024-08-17T02:26:50.843 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2024-08-17T02:26:50.843 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-08-17T02:26:50.843 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-17T02:26:50.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-17T02:26:50.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-08-17T02:26:50.843 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.2", 2024-08-17T02:26:50.843 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQAFCsBm2vH/JBAAARKKRyz95fL8kJUwrGD1QA==", 2024-08-17T02:26:50.843 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-08-17T02:26:50.843 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2024-08-17T02:26:50.843 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2024-08-17T02:26:50.844 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-08-17T02:26:50.844 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-17T02:26:50.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-17T02:26:50.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-08-17T02:26:50.844 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.3", 2024-08-17T02:26:50.844 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQAICsBm9lQSKhAAoDfvXgpICdZzv+wOiLu5ag==", 2024-08-17T02:26:50.844 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-08-17T02:26:50.844 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2024-08-17T02:26:50.844 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2024-08-17T02:26:50.844 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-08-17T02:26:50.844 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-17T02:26:50.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-17T02:26:50.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-08-17T02:26:50.844 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.4", 2024-08-17T02:26:50.845 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQAOCsBmWYGgDBAANfj9Q4yqEhT6kLVMhyc06w==", 2024-08-17T02:26:50.845 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-08-17T02:26:50.845 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2024-08-17T02:26:50.845 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2024-08-17T02:26:50.845 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-08-17T02:26:50.845 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-17T02:26:50.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-17T02:26:50.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-08-17T02:26:50.845 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.5", 2024-08-17T02:26:50.845 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQARCsBmRJkvERAAriyC92UbxvDvOHjA4LxFbQ==", 2024-08-17T02:26:50.845 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-08-17T02:26:50.845 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2024-08-17T02:26:50.845 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2024-08-17T02:26:50.846 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-08-17T02:26:50.846 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-17T02:26:50.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-17T02:26:50.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-08-17T02:26:50.846 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.6", 2024-08-17T02:26:50.846 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQAUCsBmkmLKERAA02WSRiTSFugNJFeePCCXdQ==", 2024-08-17T02:26:50.846 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-08-17T02:26:50.846 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2024-08-17T02:26:50.846 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2024-08-17T02:26:50.846 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-08-17T02:26:50.846 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-17T02:26:50.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-17T02:26:50.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-08-17T02:26:50.847 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.7", 2024-08-17T02:26:50.847 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQAXCsBmhGolFhAAwkUO3YePQzExT6dK/BC5xQ==", 2024-08-17T02:26:50.847 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-08-17T02:26:50.847 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2024-08-17T02:26:50.847 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2024-08-17T02:26:50.847 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-08-17T02:26:50.847 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-17T02:26:50.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-17T02:26:50.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-08-17T02:26:50.847 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.0", 2024-08-17T02:26:50.847 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQD8CcBmfJk+KBAAY2Mtg0xuAkxYn7ISl/rQAw==", 2024-08-17T02:26:50.847 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-08-17T02:26:50.848 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2024-08-17T02:26:50.848 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2024-08-17T02:26:50.848 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2024-08-17T02:26:50.848 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2024-08-17T02:26:50.848 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-17T02:26:50.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-17T02:26:50.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-08-17T02:26:50.848 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.1", 2024-08-17T02:26:50.848 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQD8CcBm6iuxMBAAZUapzmHbnkW+kkorhcR7MA==", 2024-08-17T02:26:50.848 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-08-17T02:26:50.848 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2024-08-17T02:26:50.848 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2024-08-17T02:26:50.848 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2024-08-17T02:26:50.848 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2024-08-17T02:26:50.849 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-17T02:26:50.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-17T02:26:50.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-08-17T02:26:50.849 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.2", 2024-08-17T02:26:50.849 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQD8CcBmWH60LRAAVWXjLB37JpBi/+K3bXMesg==", 2024-08-17T02:26:50.849 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-08-17T02:26:50.849 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2024-08-17T02:26:50.849 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2024-08-17T02:26:50.849 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2024-08-17T02:26:50.849 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2024-08-17T02:26:50.849 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-17T02:26:50.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-17T02:26:50.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-08-17T02:26:50.850 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.3", 2024-08-17T02:26:50.850 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQD8CcBmFXZUMxAAzeJqvSL/sTLVMZOdTJk7Cg==", 2024-08-17T02:26:50.850 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-08-17T02:26:50.850 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2024-08-17T02:26:50.850 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2024-08-17T02:26:50.850 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2024-08-17T02:26:50.850 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2024-08-17T02:26:50.850 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-17T02:26:50.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-17T02:26:50.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-08-17T02:26:50.850 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.admin", 2024-08-17T02:26:50.850 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQD8CcBmLkq5CBAAs5aTRb+BoWCF1EPKmiVOFA==", 2024-08-17T02:26:50.851 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-08-17T02:26:50.851 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2024-08-17T02:26:50.851 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2024-08-17T02:26:50.851 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2024-08-17T02:26:50.851 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-08-17T02:26:50.851 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-17T02:26:50.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-17T02:26:50.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-08-17T02:26:50.851 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.bootstrap-mds", 2024-08-17T02:26:50.851 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQArCsBm1qsmLRAAv0O89IaF1cHk9/t3TfPzmA==", 2024-08-17T02:26:50.851 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-08-17T02:26:50.851 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile bootstrap-mds" 2024-08-17T02:26:50.851 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-17T02:26:50.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-17T02:26:50.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-08-17T02:26:50.852 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.bootstrap-mgr", 2024-08-17T02:26:50.852 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQArCsBml8QmLRAAOI9pnq8XCoYlGBliZbS1Tw==", 2024-08-17T02:26:50.852 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-08-17T02:26:50.852 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile bootstrap-mgr" 2024-08-17T02:26:50.852 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-17T02:26:50.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-17T02:26:50.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-08-17T02:26:50.852 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.bootstrap-osd", 2024-08-17T02:26:50.852 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQArCsBmNt4mLRAA830N8jhHAsC1ie9tZaW0AA==", 2024-08-17T02:26:50.852 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-08-17T02:26:50.852 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile bootstrap-osd" 2024-08-17T02:26:50.853 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-17T02:26:50.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-17T02:26:50.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-08-17T02:26:50.853 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.bootstrap-rbd", 2024-08-17T02:26:50.853 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQArCsBmavQmLRAAIoox0gpIvBYN4MwVp2SKvg==", 2024-08-17T02:26:50.853 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-08-17T02:26:50.853 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile bootstrap-rbd" 2024-08-17T02:26:50.853 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-17T02:26:50.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-17T02:26:50.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-08-17T02:26:50.853 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-08-17T02:26:50.853 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQArCsBmBBAnLRAAyspWzzE8XaL71rVkb6DZog==", 2024-08-17T02:26:50.853 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-08-17T02:26:50.854 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-08-17T02:26:50.854 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-17T02:26:50.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-17T02:26:50.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-08-17T02:26:50.854 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.bootstrap-rgw", 2024-08-17T02:26:50.854 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQArCsBm2CYnLRAAUaS5TwnVO0ZguUNpBBlnQw==", 2024-08-17T02:26:50.854 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-08-17T02:26:50.854 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile bootstrap-rgw" 2024-08-17T02:26:50.854 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-17T02:26:50.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-17T02:26:50.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-08-17T02:26:50.854 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mgr.x", 2024-08-17T02:26:50.854 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQD8CcBmgCTrFBAAuuFSiFL5Mys0z2lfN4+tPA==", 2024-08-17T02:26:50.855 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-08-17T02:26:50.855 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2024-08-17T02:26:50.855 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile mgr", 2024-08-17T02:26:50.855 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-08-17T02:26:50.855 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-17T02:26:50.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-17T02:26:50.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-08-17T02:26:50.855 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mgr.y", 2024-08-17T02:26:50.855 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQD8CcBm1lgwEhAAYBzLN+/4eml8Dac0VcnqGA==", 2024-08-17T02:26:50.855 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-08-17T02:26:50.855 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2024-08-17T02:26:50.855 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile mgr", 2024-08-17T02:26:50.855 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-08-17T02:26:50.856 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-17T02:26:50.856 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-17T02:26:50.856 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-08-17T02:26:50.856 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-08-17T02:26:50.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.837+0000 7f06cd2e1700 1 -- 172.21.15.153:0/4158971939 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f06a8060860 msgr2=0x7f06a8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.837+0000 7f06cd2e1700 1 --2- 172.21.15.153:0/4158971939 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f06a8060860 0x7f06a8062d10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f06b8009d80 tx=0x7f06b8008040 comp rx=0 tx=0).stop 2024-08-17T02:26:50.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.837+0000 7f06cd2e1700 1 -- 172.21.15.153:0/4158971939 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06c815c970 msgr2=0x7f06c80c47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.837+0000 7f06cd2e1700 1 --2- 172.21.15.153:0/4158971939 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06c815c970 0x7f06c80c47f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f06c0012000 tx=0x7f06c0018000 comp rx=0 tx=0).stop 2024-08-17T02:26:50.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.837+0000 7f06cd2e1700 1 -- 172.21.15.153:0/4158971939 shutdown_connections 2024-08-17T02:26:50.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.837+0000 7f06cd2e1700 1 --2- 172.21.15.153:0/4158971939 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f06a8060860 0x7f06a8062d10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.837+0000 7f06cd2e1700 1 --2- 172.21.15.153:0/4158971939 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06c815c970 0x7f06c80c47f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.837+0000 7f06cd2e1700 1 --2- 172.21.15.153:0/4158971939 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06c815c5a0 0x7f06c80b04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.837+0000 7f06cd2e1700 1 --2- 172.21.15.153:0/4158971939 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06c80cb000 0x7f06c8157070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.837+0000 7f06cd2e1700 1 -- 172.21.15.153:0/4158971939 >> 172.21.15.153:0/4158971939 conn(0x7f06c80c9c20 msgr2=0x7f06c806e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:50.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.837+0000 7f06cd2e1700 1 -- 172.21.15.153:0/4158971939 shutdown_connections 2024-08-17T02:26:50.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.837+0000 7f06cd2e1700 1 -- 172.21.15.153:0/4158971939 wait complete. 2024-08-17T02:26:50.859 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-08-17T02:26:50.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.965+0000 7ff16ed62700 1 Processor -- start 2024-08-17T02:26:50.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.965+0000 7ff16ed62700 1 -- start start 2024-08-17T02:26:50.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.969+0000 7ff16ed62700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff168155d20 0x7ff1680b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.969+0000 7ff16ed62700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1680af2b0 con 0x7ff16806df10 2024-08-17T02:26:50.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.969+0000 7ff16ed62700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1680af590 con 0x7ff1680ad7c0 2024-08-17T02:26:50.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.969+0000 7ff16ed62700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1680adc10 con 0x7ff168155d20 2024-08-17T02:26:50.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.969+0000 7ff16e561700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ff16806df10 0x7ff1681560f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:55544/0 (socket says 172.21.15.153:55544) 2024-08-17T02:26:50.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.969+0000 7ff16e561700 1 -- 172.21.15.153:0/1901757428 learned_addr learned my addr 172.21.15.153:0/1901757428 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:50.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.969+0000 7ff16dd60700 1 --2- 172.21.15.153:0/1901757428 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff168155d20 0x7ff1680b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.969+0000 7ff16cd5e700 1 -- 172.21.15.153:0/1901757428 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1611367524 0 0) 0x7ff1680af2b0 con 0x7ff16806df10 2024-08-17T02:26:50.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.969+0000 7ff16cd5e700 1 -- 172.21.15.153:0/1901757428 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff150003570 con 0x7ff16806df10 2024-08-17T02:26:50.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.969+0000 7ff16cd5e700 1 -- 172.21.15.153:0/1901757428 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2302697420 0 0) 0x7ff1680af590 con 0x7ff1680ad7c0 2024-08-17T02:26:50.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.969+0000 7ff16cd5e700 1 -- 172.21.15.153:0/1901757428 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1680af2b0 con 0x7ff1680ad7c0 2024-08-17T02:26:50.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.969+0000 7ff16dd60700 1 -- 172.21.15.153:0/1901757428 >> v1:172.21.15.174:6789/0 conn(0x7ff1680ad7c0 legacy=0x7ff1680aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.969+0000 7ff16dd60700 1 -- 172.21.15.153:0/1901757428 >> v1:172.21.15.153:6789/0 conn(0x7ff16806df10 legacy=0x7ff1681560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.969+0000 7ff16dd60700 1 -- 172.21.15.153:0/1901757428 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1680af870 con 0x7ff168155d20 2024-08-17T02:26:50.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.969+0000 7ff16dd60700 1 --2- 172.21.15.153:0/1901757428 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff168155d20 0x7ff1680b0350 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff158009910 tx=0x7ff1580091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c12145d3da6ce82 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:50.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.969+0000 7ff16cd5e700 1 -- 172.21.15.153:0/1901757428 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff158011630 con 0x7ff168155d20 2024-08-17T02:26:50.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.969+0000 7ff16cd5e700 1 -- 172.21.15.153:0/1901757428 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff158011790 con 0x7ff168155d20 2024-08-17T02:26:50.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.969+0000 7ff16cd5e700 1 -- 172.21.15.153:0/1901757428 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff158011b10 con 0x7ff168155d20 2024-08-17T02:26:50.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.969+0000 7ff16ed62700 1 -- 172.21.15.153:0/1901757428 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff168155d20 msgr2=0x7ff1680b0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.969+0000 7ff16ed62700 1 --2- 172.21.15.153:0/1901757428 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff168155d20 0x7ff1680b0350 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff158009910 tx=0x7ff1580091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.969+0000 7ff16ed62700 1 -- 172.21.15.153:0/1901757428 shutdown_connections 2024-08-17T02:26:50.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.969+0000 7ff16ed62700 1 --2- 172.21.15.153:0/1901757428 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff168155d20 0x7ff1680b0350 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.969+0000 7ff16ed62700 1 -- 172.21.15.153:0/1901757428 >> 172.21.15.153:0/1901757428 conn(0x7ff1680678d0 msgr2=0x7ff168067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:50.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.969+0000 7ff16ed62700 1 -- 172.21.15.153:0/1901757428 shutdown_connections 2024-08-17T02:26:50.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.969+0000 7ff16ed62700 1 -- 172.21.15.153:0/1901757428 wait complete. 2024-08-17T02:26:50.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.973+0000 7ff16ed62700 1 Processor -- start 2024-08-17T02:26:50.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.973+0000 7ff16ed62700 1 -- start start 2024-08-17T02:26:50.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.973+0000 7ff16ed62700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff16806df10 0x7ff16806a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.973+0000 7ff16ed62700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1680ad7c0 0x7ff168150640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.977+0000 7ff16ed62700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff168155d20 0x7ff1680aac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.977+0000 7ff16ed62700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16806acc0 con 0x7ff16806df10 2024-08-17T02:26:50.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.977+0000 7ff16ed62700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff168150b80 con 0x7ff168155d20 2024-08-17T02:26:50.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.977+0000 7ff16ed62700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff16814e100 con 0x7ff1680ad7c0 2024-08-17T02:26:50.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.977+0000 7ff16dd60700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff16806df10 0x7ff16806a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.977+0000 7ff16dd60700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff16806df10 0x7ff16806a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55182/0 (socket says 172.21.15.153:55182) 2024-08-17T02:26:50.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.977+0000 7ff16dd60700 1 -- 172.21.15.153:0/784115835 learned_addr learned my addr 172.21.15.153:0/784115835 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:50.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.977+0000 7ff16e561700 1 --2- 172.21.15.153:0/784115835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff168155d20 0x7ff1680aac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.977+0000 7ff16d55f700 1 --2- 172.21.15.153:0/784115835 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1680ad7c0 0x7ff168150640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.977+0000 7ff16dd60700 1 -- 172.21.15.153:0/784115835 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1680ad7c0 msgr2=0x7ff168150640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.977+0000 7ff16dd60700 1 --2- 172.21.15.153:0/784115835 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1680ad7c0 0x7ff168150640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.977+0000 7ff16dd60700 1 -- 172.21.15.153:0/784115835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff168155d20 msgr2=0x7ff1680aac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.977+0000 7ff16dd60700 1 --2- 172.21.15.153:0/784115835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff168155d20 0x7ff1680aac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.977+0000 7ff16dd60700 1 -- 172.21.15.153:0/784115835 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff158009420 con 0x7ff16806df10 2024-08-17T02:26:50.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.977+0000 7ff16dd60700 1 --2- 172.21.15.153:0/784115835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff16806df10 0x7ff16806a780 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff158009f00 tx=0x7ff158017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:50.981 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.977+0000 7ff165ffb700 1 -- 172.21.15.153:0/784115835 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff158011b10 con 0x7ff16806df10 2024-08-17T02:26:50.981 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.977+0000 7ff165ffb700 1 -- 172.21.15.153:0/784115835 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff158000c90 con 0x7ff16806df10 2024-08-17T02:26:50.981 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.977+0000 7ff16ed62700 1 -- 172.21.15.153:0/784115835 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1680ab170 con 0x7ff16806df10 2024-08-17T02:26:50.981 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.977+0000 7ff165ffb700 1 -- 172.21.15.153:0/784115835 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff158025640 con 0x7ff16806df10 2024-08-17T02:26:50.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.977+0000 7ff16ed62700 1 -- 172.21.15.153:0/784115835 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff168150e30 con 0x7ff16806df10 2024-08-17T02:26:50.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.977+0000 7ff165ffb700 1 -- 172.21.15.153:0/784115835 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff158025a30 con 0x7ff16806df10 2024-08-17T02:26:50.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.977+0000 7ff16ed62700 1 -- 172.21.15.153:0/784115835 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1680643a0 con 0x7ff16806df10 2024-08-17T02:26:50.983 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.977+0000 7ff165ffb700 1 --2- 172.21.15.153:0/784115835 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff154060860 0x7ff154062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.983 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.981+0000 7ff165ffb700 1 -- 172.21.15.153:0/784115835 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff15807df60 con 0x7ff16806df10 2024-08-17T02:26:50.983 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.981+0000 7ff16d55f700 1 --2- 172.21.15.153:0/784115835 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff154060860 0x7ff154062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.983 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.981+0000 7ff16d55f700 1 --2- 172.21.15.153:0/784115835 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff154060860 0x7ff154062d10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff16806aff0 tx=0x7ff15c002720 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:50.991 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:50.989+0000 7ff165ffb700 1 -- 172.21.15.153:0/784115835 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff15804e800 con 0x7ff16806df10 2024-08-17T02:26:51.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.213+0000 7ff16ed62700 1 -- 172.21.15.153:0/784115835 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7ff1680acf30 con 0x7ff16806df10 2024-08-17T02:26:51.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.221+0000 7ff165ffb700 1 -- 172.21.15.153:0/784115835 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff1580150a0 con 0x7ff16806df10 2024-08-17T02:26:51.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.221+0000 7ff16ed62700 1 -- 172.21.15.153:0/784115835 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff154060860 msgr2=0x7ff154062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.221+0000 7ff16ed62700 1 --2- 172.21.15.153:0/784115835 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff154060860 0x7ff154062d10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff16806aff0 tx=0x7ff15c002720 comp rx=0 tx=0).stop 2024-08-17T02:26:51.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.221+0000 7ff16ed62700 1 -- 172.21.15.153:0/784115835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff16806df10 msgr2=0x7ff16806a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.221+0000 7ff16ed62700 1 --2- 172.21.15.153:0/784115835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff16806df10 0x7ff16806a780 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff158009f00 tx=0x7ff158017000 comp rx=0 tx=0).stop 2024-08-17T02:26:51.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.221+0000 7ff16ed62700 1 -- 172.21.15.153:0/784115835 shutdown_connections 2024-08-17T02:26:51.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.221+0000 7ff16ed62700 1 --2- 172.21.15.153:0/784115835 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff154060860 0x7ff154062d10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.221+0000 7ff16ed62700 1 --2- 172.21.15.153:0/784115835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff168155d20 0x7ff1680aac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.221+0000 7ff16ed62700 1 --2- 172.21.15.153:0/784115835 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1680ad7c0 0x7ff168150640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.221+0000 7ff16ed62700 1 --2- 172.21.15.153:0/784115835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff16806df10 0x7ff16806a780 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.221+0000 7ff16ed62700 1 -- 172.21.15.153:0/784115835 >> 172.21.15.153:0/784115835 conn(0x7ff1680678d0 msgr2=0x7ff168151a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:51.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.221+0000 7ff16ed62700 1 -- 172.21.15.153:0/784115835 shutdown_connections 2024-08-17T02:26:51.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.221+0000 7ff16ed62700 1 -- 172.21.15.153:0/784115835 wait complete. 2024-08-17T02:26:51.237 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-08-17T02:26:51.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.349+0000 7f943ffff700 1 Processor -- start 2024-08-17T02:26:51.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.349+0000 7f943ffff700 1 -- start start 2024-08-17T02:26:51.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.349+0000 7f943ffff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94400b14a0 0x7f94400cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.349+0000 7f943ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f94400cb390 0x7f9440160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.349+0000 7f943ffff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94400cbaa0 con 0x7f9440154900 2024-08-17T02:26:51.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.349+0000 7f943ffff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9440068790 con 0x7f94400cb390 2024-08-17T02:26:51.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.349+0000 7f943ffff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94401583f0 con 0x7f94400b14a0 2024-08-17T02:26:51.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.349+0000 7f943f7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f94400cb390 0x7f9440160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.349+0000 7f943f7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f94400cb390 0x7f9440160ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55190/0 (socket says 172.21.15.153:55190) 2024-08-17T02:26:51.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.349+0000 7f943f7fe700 1 -- 172.21.15.153:0/2688351542 learned_addr learned my addr 172.21.15.153:0/2688351542 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:51.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.349+0000 7f9437fff700 1 --2- 172.21.15.153:0/2688351542 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94400b14a0 0x7f94400cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.349+0000 7f943f7fe700 1 -- 172.21.15.153:0/2688351542 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94400b14a0 msgr2=0x7f94400cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:51.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.349+0000 7f943f7fe700 1 --2- 172.21.15.153:0/2688351542 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94400b14a0 0x7f94400cae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.349+0000 7f943f7fe700 1 -- 172.21.15.153:0/2688351542 >> v1:172.21.15.174:6789/0 conn(0x7f9440154900 legacy=0x7f94400b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.349+0000 7f943f7fe700 1 -- 172.21.15.153:0/2688351542 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9440157630 con 0x7f94400cb390 2024-08-17T02:26:51.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.349+0000 7f943f7fe700 1 --2- 172.21.15.153:0/2688351542 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94400cb390 0x7f9440160ac0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9438009f20 tx=0x7f9438009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b632fd34c2521867 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:51.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.349+0000 7f943e7fc700 1 -- 172.21.15.153:0/2688351542 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943800e070 con 0x7f94400cb390 2024-08-17T02:26:51.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.349+0000 7f943e7fc700 1 -- 172.21.15.153:0/2688351542 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943800b9d0 con 0x7f94400cb390 2024-08-17T02:26:51.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.349+0000 7f943e7fc700 1 -- 172.21.15.153:0/2688351542 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94380092e0 con 0x7f94400cb390 2024-08-17T02:26:51.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.349+0000 7f943ffff700 1 -- 172.21.15.153:0/2688351542 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94400cb390 msgr2=0x7f9440160ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.349+0000 7f943ffff700 1 --2- 172.21.15.153:0/2688351542 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94400cb390 0x7f9440160ac0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9438009f20 tx=0x7f9438009840 comp rx=0 tx=0).stop 2024-08-17T02:26:51.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.349+0000 7f943ffff700 1 -- 172.21.15.153:0/2688351542 shutdown_connections 2024-08-17T02:26:51.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.349+0000 7f943ffff700 1 --2- 172.21.15.153:0/2688351542 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94400cb390 0x7f9440160ac0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.349+0000 7f943ffff700 1 --2- 172.21.15.153:0/2688351542 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94400b14a0 0x7f94400cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.349+0000 7f943ffff700 1 -- 172.21.15.153:0/2688351542 >> 172.21.15.153:0/2688351542 conn(0x7f94400678d0 msgr2=0x7f9440067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:51.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.349+0000 7f943ffff700 1 -- 172.21.15.153:0/2688351542 shutdown_connections 2024-08-17T02:26:51.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.349+0000 7f943ffff700 1 -- 172.21.15.153:0/2688351542 wait complete. 2024-08-17T02:26:51.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.353+0000 7f943ffff700 1 Processor -- start 2024-08-17T02:26:51.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.353+0000 7f943ffff700 1 -- start start 2024-08-17T02:26:51.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.353+0000 7f943ffff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94400b14a0 0x7f94400a5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.353+0000 7f943ffff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94400cb390 0x7f9440155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.353+0000 7f943ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9440154900 0x7f944014e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.353+0000 7f943ffff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94400a84e0 con 0x7f9440154900 2024-08-17T02:26:51.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.353+0000 7f943ffff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94400a66e0 con 0x7f94400b14a0 2024-08-17T02:26:51.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.353+0000 7f943ffff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94400a6990 con 0x7f94400cb390 2024-08-17T02:26:51.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.353+0000 7f943f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9440154900 0x7f944014e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.353+0000 7f943effd700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94400b14a0 0x7f94400a5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.353+0000 7f943f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9440154900 0x7f944014e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55202/0 (socket says 172.21.15.153:55202) 2024-08-17T02:26:51.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.353+0000 7f943f7fe700 1 -- 172.21.15.153:0/3864629699 learned_addr learned my addr 172.21.15.153:0/3864629699 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:51.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.353+0000 7f9437fff700 1 --2- 172.21.15.153:0/3864629699 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94400cb390 0x7f9440155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.357+0000 7f943f7fe700 1 -- 172.21.15.153:0/3864629699 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94400cb390 msgr2=0x7f9440155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.357+0000 7f943f7fe700 1 --2- 172.21.15.153:0/3864629699 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94400cb390 0x7f9440155ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.357+0000 7f943f7fe700 1 -- 172.21.15.153:0/3864629699 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94400b14a0 msgr2=0x7f94400a5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.357+0000 7f943f7fe700 1 --2- 172.21.15.153:0/3864629699 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94400b14a0 0x7f94400a5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.357+0000 7f943f7fe700 1 -- 172.21.15.153:0/3864629699 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9438009ae0 con 0x7f9440154900 2024-08-17T02:26:51.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.357+0000 7f943f7fe700 1 --2- 172.21.15.153:0/3864629699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9440154900 0x7f944014e020 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f943800b610 tx=0x7f9438018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:51.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.357+0000 7f9436ffd700 1 -- 172.21.15.153:0/3864629699 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9438008ad0 con 0x7f9440154900 2024-08-17T02:26:51.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.357+0000 7f9436ffd700 1 -- 172.21.15.153:0/3864629699 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9438008c30 con 0x7f9440154900 2024-08-17T02:26:51.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.357+0000 7f943ffff700 1 -- 172.21.15.153:0/3864629699 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94400a6c70 con 0x7f9440154900 2024-08-17T02:26:51.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.357+0000 7f9436ffd700 1 -- 172.21.15.153:0/3864629699 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9438025460 con 0x7f9440154900 2024-08-17T02:26:51.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.357+0000 7f943ffff700 1 -- 172.21.15.153:0/3864629699 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94400a63a0 con 0x7f9440154900 2024-08-17T02:26:51.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.357+0000 7f943ffff700 1 -- 172.21.15.153:0/3864629699 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94400a6e60 con 0x7f9440154900 2024-08-17T02:26:51.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.357+0000 7f9436ffd700 1 -- 172.21.15.153:0/3864629699 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9438003040 con 0x7f9440154900 2024-08-17T02:26:51.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.357+0000 7f9436ffd700 1 --2- 172.21.15.153:0/3864629699 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9420060860 0x7f9420062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.357+0000 7f9436ffd700 1 -- 172.21.15.153:0/3864629699 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f943807e3b0 con 0x7f9440154900 2024-08-17T02:26:51.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.357+0000 7f943effd700 1 --2- 172.21.15.153:0/3864629699 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9420060860 0x7f9420062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.357+0000 7f943effd700 1 --2- 172.21.15.153:0/3864629699 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9420060860 0x7f9420062d10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f944006b210 tx=0x7f9430009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:51.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.365+0000 7f9436ffd700 1 -- 172.21.15.153:0/3864629699 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f943804eb50 con 0x7f9440154900 2024-08-17T02:26:51.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.589+0000 7f943ffff700 1 -- 172.21.15.153:0/3864629699 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f94400a7060 con 0x7f9440154900 2024-08-17T02:26:51.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.593+0000 7f9436ffd700 1 -- 172.21.15.153:0/3864629699 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f9438052170 con 0x7f9440154900 2024-08-17T02:26:51.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.597+0000 7f943ffff700 1 -- 172.21.15.153:0/3864629699 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9420060860 msgr2=0x7f9420062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.597+0000 7f943ffff700 1 --2- 172.21.15.153:0/3864629699 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9420060860 0x7f9420062d10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f944006b210 tx=0x7f9430009040 comp rx=0 tx=0).stop 2024-08-17T02:26:51.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.597+0000 7f943ffff700 1 -- 172.21.15.153:0/3864629699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9440154900 msgr2=0x7f944014e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.597+0000 7f943ffff700 1 --2- 172.21.15.153:0/3864629699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9440154900 0x7f944014e020 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f943800b610 tx=0x7f9438018000 comp rx=0 tx=0).stop 2024-08-17T02:26:51.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.597+0000 7f943ffff700 1 -- 172.21.15.153:0/3864629699 shutdown_connections 2024-08-17T02:26:51.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.597+0000 7f943ffff700 1 --2- 172.21.15.153:0/3864629699 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9420060860 0x7f9420062d10 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.597+0000 7f943ffff700 1 --2- 172.21.15.153:0/3864629699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9440154900 0x7f944014e020 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.597+0000 7f943ffff700 1 --2- 172.21.15.153:0/3864629699 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94400cb390 0x7f9440155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.597+0000 7f943ffff700 1 --2- 172.21.15.153:0/3864629699 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94400b14a0 0x7f94400a5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.597+0000 7f943ffff700 1 -- 172.21.15.153:0/3864629699 >> 172.21.15.153:0/3864629699 conn(0x7f94400678d0 msgr2=0x7f9440153bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:51.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.597+0000 7f943ffff700 1 -- 172.21.15.153:0/3864629699 shutdown_connections 2024-08-17T02:26:51.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.597+0000 7f943ffff700 1 -- 172.21.15.153:0/3864629699 wait complete. 2024-08-17T02:26:51.616 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-08-17T02:26:51.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.721+0000 7f66492ca700 1 Processor -- start 2024-08-17T02:26:51.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.721+0000 7f66492ca700 1 -- start start 2024-08-17T02:26:51.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.721+0000 7f66492ca700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6644153a70 0x7f6644159c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.721+0000 7f66492ca700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f664406e9c0 0x7f6644158260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.721+0000 7f66492ca700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6644157810 con 0x7f6644153e40 2024-08-17T02:26:51.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.721+0000 7f66492ca700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6644157dd0 con 0x7f6644153a70 2024-08-17T02:26:51.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.721+0000 7f66492ca700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f664415a700 con 0x7f664406e9c0 2024-08-17T02:26:51.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.721+0000 7f6642ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6644153a70 0x7f6644159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.725+0000 7f6642ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6644153a70 0x7f6644159c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55214/0 (socket says 172.21.15.153:55214) 2024-08-17T02:26:51.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.725+0000 7f6642ffd700 1 -- 172.21.15.153:0/2476968163 learned_addr learned my addr 172.21.15.153:0/2476968163 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:51.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.725+0000 7f66437fe700 1 --2- 172.21.15.153:0/2476968163 >> v2:172.21.15.174:3300/0 conn(0x7f664406e9c0 0x7f6644158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.728 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.725+0000 7f6642ffd700 1 -- 172.21.15.153:0/2476968163 >> v2:172.21.15.174:3300/0 conn(0x7f664406e9c0 msgr2=0x7f6644158260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:51.728 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.725+0000 7f6642ffd700 1 --2- 172.21.15.153:0/2476968163 >> v2:172.21.15.174:3300/0 conn(0x7f664406e9c0 0x7f6644158260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.728 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.725+0000 7f6642ffd700 1 -- 172.21.15.153:0/2476968163 >> v1:172.21.15.174:6789/0 conn(0x7f6644153e40 legacy=0x7f664406e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.728 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.725+0000 7f6642ffd700 1 -- 172.21.15.153:0/2476968163 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f664415a9e0 con 0x7f6644153a70 2024-08-17T02:26:51.728 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.725+0000 7f6642ffd700 1 --2- 172.21.15.153:0/2476968163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6644153a70 0x7f6644159c40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6644157d40 tx=0x7f6638009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f823cd360c683ab server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:51.728 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.725+0000 7f6641ffb700 1 -- 172.21.15.153:0/2476968163 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6638009e70 con 0x7f6644153a70 2024-08-17T02:26:51.728 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.725+0000 7f6641ffb700 1 -- 172.21.15.153:0/2476968163 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f663800b860 con 0x7f6644153a70 2024-08-17T02:26:51.728 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.725+0000 7f6641ffb700 1 -- 172.21.15.153:0/2476968163 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663800bc00 con 0x7f6644153a70 2024-08-17T02:26:51.729 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.725+0000 7f66492ca700 1 -- 172.21.15.153:0/2476968163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6644153a70 msgr2=0x7f6644159c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.729 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.725+0000 7f66492ca700 1 --2- 172.21.15.153:0/2476968163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6644153a70 0x7f6644159c40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6644157d40 tx=0x7f6638009250 comp rx=0 tx=0).stop 2024-08-17T02:26:51.729 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.725+0000 7f66492ca700 1 -- 172.21.15.153:0/2476968163 shutdown_connections 2024-08-17T02:26:51.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.725+0000 7f66492ca700 1 --2- 172.21.15.153:0/2476968163 >> v2:172.21.15.174:3300/0 conn(0x7f664406e9c0 0x7f6644158260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.725+0000 7f66492ca700 1 --2- 172.21.15.153:0/2476968163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6644153a70 0x7f6644159c40 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.725+0000 7f66492ca700 1 -- 172.21.15.153:0/2476968163 >> 172.21.15.153:0/2476968163 conn(0x7f6644067810 msgr2=0x7f6644067c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:51.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.725+0000 7f66492ca700 1 -- 172.21.15.153:0/2476968163 shutdown_connections 2024-08-17T02:26:51.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.725+0000 7f66492ca700 1 -- 172.21.15.153:0/2476968163 wait complete. 2024-08-17T02:26:51.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.729+0000 7f66492ca700 1 Processor -- start 2024-08-17T02:26:51.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.729+0000 7f66492ca700 1 -- start start 2024-08-17T02:26:51.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.733+0000 7f66492ca700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f664406e9c0 0x7f66440969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.733+0000 7f66492ca700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6644153a70 0x7f6644141830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.733+0000 7f66492ca700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6644153e40 0x7f66440ad3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.733+0000 7f66492ca700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66440acf20 con 0x7f6644153a70 2024-08-17T02:26:51.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.733+0000 7f66492ca700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6644097240 con 0x7f6644153e40 2024-08-17T02:26:51.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.733+0000 7f66492ca700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6644097520 con 0x7f664406e9c0 2024-08-17T02:26:51.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.733+0000 7f66427fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6644153a70 0x7f6644141830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.733+0000 7f6642ffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f664406e9c0 0x7f66440969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.733+0000 7f66427fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6644153a70 0x7f6644141830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55222/0 (socket says 172.21.15.153:55222) 2024-08-17T02:26:51.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.733+0000 7f66427fc700 1 -- 172.21.15.153:0/589534525 learned_addr learned my addr 172.21.15.153:0/589534525 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:51.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.733+0000 7f66437fe700 1 --2- 172.21.15.153:0/589534525 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6644153e40 0x7f66440ad3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.733+0000 7f66427fc700 1 -- 172.21.15.153:0/589534525 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f664406e9c0 msgr2=0x7f66440969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.733+0000 7f66427fc700 1 --2- 172.21.15.153:0/589534525 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f664406e9c0 0x7f66440969f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.733+0000 7f66427fc700 1 -- 172.21.15.153:0/589534525 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6644153e40 msgr2=0x7f66440ad3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.733+0000 7f66427fc700 1 --2- 172.21.15.153:0/589534525 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6644153e40 0x7f66440ad3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.733+0000 7f66427fc700 1 -- 172.21.15.153:0/589534525 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66380094f0 con 0x7f6644153a70 2024-08-17T02:26:51.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.733+0000 7f66427fc700 1 --2- 172.21.15.153:0/589534525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6644153a70 0x7f6644141830 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f663c00cb40 tx=0x7f663c001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:51.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.733+0000 7f662affd700 1 -- 172.21.15.153:0/589534525 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663c002060 con 0x7f6644153a70 2024-08-17T02:26:51.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.733+0000 7f66492ca700 1 -- 172.21.15.153:0/589534525 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6644097800 con 0x7f6644153a70 2024-08-17T02:26:51.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.733+0000 7f662affd700 1 -- 172.21.15.153:0/589534525 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f663c00a7e0 con 0x7f6644153a70 2024-08-17T02:26:51.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.733+0000 7f662affd700 1 -- 172.21.15.153:0/589534525 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663c00aba0 con 0x7f6644153a70 2024-08-17T02:26:51.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.733+0000 7f66492ca700 1 -- 172.21.15.153:0/589534525 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6644141d70 con 0x7f6644153a70 2024-08-17T02:26:51.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.733+0000 7f66492ca700 1 -- 172.21.15.153:0/589534525 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66440ad0d0 con 0x7f6644153a70 2024-08-17T02:26:51.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.737+0000 7f662affd700 1 -- 172.21.15.153:0/589534525 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f663c003030 con 0x7f6644153a70 2024-08-17T02:26:51.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.737+0000 7f662affd700 1 --2- 172.21.15.153:0/589534525 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6630060860 0x7f6630062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.737+0000 7f662affd700 1 -- 172.21.15.153:0/589534525 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f663c07c820 con 0x7f6644153a70 2024-08-17T02:26:51.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.737+0000 7f6642ffd700 1 --2- 172.21.15.153:0/589534525 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6630060860 0x7f6630062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.737+0000 7f6642ffd700 1 --2- 172.21.15.153:0/589534525 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6630060860 0x7f6630062d10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6644157d40 tx=0x7f6638017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:51.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.745+0000 7f662affd700 1 -- 172.21.15.153:0/589534525 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f66440ad0d0 con 0x7f6644153a70 2024-08-17T02:26:51.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.961+0000 7f66492ca700 1 -- 172.21.15.153:0/589534525 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f66440645c0 con 0x7f6644153a70 2024-08-17T02:26:51.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.969+0000 7f662affd700 1 -- 172.21.15.153:0/589534525 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f663c04cfc0 con 0x7f6644153a70 2024-08-17T02:26:51.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.969+0000 7f66492ca700 1 -- 172.21.15.153:0/589534525 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6630060860 msgr2=0x7f6630062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.969+0000 7f66492ca700 1 --2- 172.21.15.153:0/589534525 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6630060860 0x7f6630062d10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6644157d40 tx=0x7f6638017000 comp rx=0 tx=0).stop 2024-08-17T02:26:51.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.969+0000 7f66492ca700 1 -- 172.21.15.153:0/589534525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6644153a70 msgr2=0x7f6644141830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.969+0000 7f66492ca700 1 --2- 172.21.15.153:0/589534525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6644153a70 0x7f6644141830 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f663c00cb40 tx=0x7f663c001770 comp rx=0 tx=0).stop 2024-08-17T02:26:51.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.969+0000 7f66492ca700 1 -- 172.21.15.153:0/589534525 shutdown_connections 2024-08-17T02:26:51.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.969+0000 7f66492ca700 1 --2- 172.21.15.153:0/589534525 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6630060860 0x7f6630062d10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.969+0000 7f66492ca700 1 --2- 172.21.15.153:0/589534525 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6644153e40 0x7f66440ad3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.969+0000 7f66492ca700 1 --2- 172.21.15.153:0/589534525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6644153a70 0x7f6644141830 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.969+0000 7f66492ca700 1 --2- 172.21.15.153:0/589534525 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f664406e9c0 0x7f66440969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.969+0000 7f66492ca700 1 -- 172.21.15.153:0/589534525 >> 172.21.15.153:0/589534525 conn(0x7f6644067810 msgr2=0x7f6644150a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:51.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.969+0000 7f66492ca700 1 -- 172.21.15.153:0/589534525 shutdown_connections 2024-08-17T02:26:51.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:51.969+0000 7f66492ca700 1 -- 172.21.15.153:0/589534525 wait complete. 2024-08-17T02:26:51.991 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-08-17T02:26:52.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.093+0000 7f5305b89700 1 Processor -- start 2024-08-17T02:26:52.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.093+0000 7f5305b89700 1 -- start start 2024-08-17T02:26:52.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.093+0000 7f5305b89700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5300153320 0x7f53001536f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.093+0000 7f5305b89700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f530015dbd0 con 0x7f530015a190 2024-08-17T02:26:52.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.093+0000 7f5305b89700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f530015d370 con 0x7f53000cd1b0 2024-08-17T02:26:52.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.093+0000 7f5305b89700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53000ce430 con 0x7f5300153320 2024-08-17T02:26:52.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.093+0000 7f52fffff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f530015a190 0x7f53000ccaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:55546/0 (socket says 172.21.15.153:55546) 2024-08-17T02:26:52.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.093+0000 7f52fffff700 1 -- 172.21.15.153:0/3016771983 learned_addr learned my addr 172.21.15.153:0/3016771983 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:52.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.093+0000 7f5304b87700 1 --2- 172.21.15.153:0/3016771983 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5300153320 0x7f53001536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.093+0000 7f52ff7fe700 1 -- 172.21.15.153:0/3016771983 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1168795955 0 0) 0x7f530015dbd0 con 0x7f530015a190 2024-08-17T02:26:52.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.093+0000 7f52ff7fe700 1 -- 172.21.15.153:0/3016771983 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52e8003570 con 0x7f530015a190 2024-08-17T02:26:52.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.093+0000 7f52ff7fe700 1 -- 172.21.15.153:0/3016771983 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3810991975 0 0) 0x7f52e8003570 con 0x7f530015a190 2024-08-17T02:26:52.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.093+0000 7f52ff7fe700 1 -- 172.21.15.153:0/3016771983 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5300153320 msgr2=0x7f53001536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:52.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.093+0000 7f52ff7fe700 1 --2- 172.21.15.153:0/3016771983 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5300153320 0x7f53001536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.093+0000 7f52ff7fe700 1 -- 172.21.15.153:0/3016771983 >> v1:172.21.15.174:6789/0 conn(0x7f53000cd1b0 legacy=0x7f53000ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.093+0000 7f52ff7fe700 1 -- 172.21.15.153:0/3016771983 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f530015d610 con 0x7f530015a190 2024-08-17T02:26:52.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.093+0000 7f52ff7fe700 1 -- 172.21.15.153:0/3016771983 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3701463666 0 0) 0x7f52f4001470 con 0x7f530015a190 2024-08-17T02:26:52.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.093+0000 7f52ff7fe700 1 -- 172.21.15.153:0/3016771983 >> v1:172.21.15.153:6789/0 conn(0x7f530015a190 legacy=0x7f53000ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.093+0000 7f52ff7fe700 1 --2- 172.21.15.153:0/3016771983 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52e8003a90 0x7f52e8003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.097+0000 7f52ff7fe700 1 --2- 172.21.15.153:0/3016771983 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5300153320 0x7f52e8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.097+0000 7f52ff7fe700 1 --2- 172.21.15.153:0/3016771983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52e8004d50 0x7f52e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.097+0000 7f52ff7fe700 1 -- 172.21.15.153:0/3016771983 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53000ce430 con 0x7f52e8004d50 2024-08-17T02:26:52.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.097+0000 7f52ff7fe700 1 -- 172.21.15.153:0/3016771983 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e800bb10 con 0x7f52e8003a90 2024-08-17T02:26:52.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.097+0000 7f52ff7fe700 1 -- 172.21.15.153:0/3016771983 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52e800bcd0 con 0x7f5300153320 2024-08-17T02:26:52.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.097+0000 7f5305388700 1 --2- 172.21.15.153:0/3016771983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52e8004d50 0x7f52e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.097+0000 7f5304b87700 1 --2- 172.21.15.153:0/3016771983 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52e8003a90 0x7f52e8003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.097+0000 7f52fffff700 1 --2- 172.21.15.153:0/3016771983 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5300153320 0x7f52e8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.097+0000 7f5305388700 1 -- 172.21.15.153:0/3016771983 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5300153320 msgr2=0x7f52e8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:52.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.097+0000 7f5305388700 1 --2- 172.21.15.153:0/3016771983 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5300153320 0x7f52e8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.097+0000 7f5305388700 1 -- 172.21.15.153:0/3016771983 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52e8003a90 msgr2=0x7f52e8003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:52.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.097+0000 7f5305388700 1 --2- 172.21.15.153:0/3016771983 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52e8003a90 0x7f52e8003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.097+0000 7f5305388700 1 -- 172.21.15.153:0/3016771983 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e8003570 con 0x7f52e8004d50 2024-08-17T02:26:52.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.097+0000 7f5305388700 1 --2- 172.21.15.153:0/3016771983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52e8004d50 0x7f52e80051c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f53000ce3e0 tx=0x7f52f80016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71309bdc17d05df1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:52.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.097+0000 7f52ff7fe700 1 -- 172.21.15.153:0/3016771983 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f80019e0 con 0x7f52e8004d50 2024-08-17T02:26:52.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.097+0000 7f52ff7fe700 1 -- 172.21.15.153:0/3016771983 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f800c8b0 con 0x7f52e8004d50 2024-08-17T02:26:52.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.097+0000 7f52ff7fe700 1 -- 172.21.15.153:0/3016771983 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f800cc50 con 0x7f52e8004d50 2024-08-17T02:26:52.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.097+0000 7f5305b89700 1 -- 172.21.15.153:0/3016771983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52e8004d50 msgr2=0x7f52e80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.097+0000 7f5305b89700 1 --2- 172.21.15.153:0/3016771983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52e8004d50 0x7f52e80051c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f53000ce3e0 tx=0x7f52f80016d0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.097+0000 7f5305388700 1 -- 172.21.15.153:0/3016771983 reap_dead start 2024-08-17T02:26:52.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.097+0000 7f5305b89700 1 -- 172.21.15.153:0/3016771983 shutdown_connections 2024-08-17T02:26:52.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.097+0000 7f5305b89700 1 -- 172.21.15.153:0/3016771983 >> 172.21.15.153:0/3016771983 conn(0x7f53000d00a0 msgr2=0x7f53000d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:52.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.097+0000 7f5305b89700 1 -- 172.21.15.153:0/3016771983 shutdown_connections 2024-08-17T02:26:52.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.097+0000 7f5305b89700 1 -- 172.21.15.153:0/3016771983 wait complete. 2024-08-17T02:26:52.104 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.101+0000 7f5305b89700 1 Processor -- start 2024-08-17T02:26:52.104 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.101+0000 7f5305b89700 1 -- start start 2024-08-17T02:26:52.104 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.101+0000 7f5305b89700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5300152220 0x7f53000c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.104 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.101+0000 7f5305b89700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53001525f0 0x7f53001584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.101+0000 7f5305b89700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53001589e0 0x7f53000b1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.101+0000 7f5305b89700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53000c8810 con 0x7f53001589e0 2024-08-17T02:26:52.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.101+0000 7f5305b89700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53000c91e0 con 0x7f5300152220 2024-08-17T02:26:52.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.101+0000 7f5305b89700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53000c7c00 con 0x7f53001525f0 2024-08-17T02:26:52.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.101+0000 7f5304b87700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5300152220 0x7f53000c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.101+0000 7f5305388700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53001589e0 0x7f53000b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.101+0000 7f5304b87700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5300152220 0x7f53000c8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.153:43840/0 (socket says 172.21.15.153:43840) 2024-08-17T02:26:52.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.101+0000 7f5304b87700 1 -- 172.21.15.153:0/4159350141 learned_addr learned my addr 172.21.15.153:0/4159350141 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:52.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.101+0000 7f52fffff700 1 --2- 172.21.15.153:0/4159350141 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53001525f0 0x7f53001584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.101+0000 7f5305388700 1 -- 172.21.15.153:0/4159350141 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53001525f0 msgr2=0x7f53001584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.101+0000 7f5305388700 1 --2- 172.21.15.153:0/4159350141 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53001525f0 0x7f53001584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.101+0000 7f5305388700 1 -- 172.21.15.153:0/4159350141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5300152220 msgr2=0x7f53000c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.101+0000 7f5305388700 1 --2- 172.21.15.153:0/4159350141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5300152220 0x7f53000c8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.101+0000 7f5305388700 1 -- 172.21.15.153:0/4159350141 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53000c7ee0 con 0x7f53001589e0 2024-08-17T02:26:52.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.101+0000 7f5305388700 1 --2- 172.21.15.153:0/4159350141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53001589e0 0x7f53000b1170 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f52f8014000 tx=0x7f52f8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:52.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.101+0000 7f52fcff9700 1 -- 172.21.15.153:0/4159350141 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f80019e0 con 0x7f53001589e0 2024-08-17T02:26:52.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.101+0000 7f52fcff9700 1 -- 172.21.15.153:0/4159350141 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f800c6d0 con 0x7f53001589e0 2024-08-17T02:26:52.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.101+0000 7f5305b89700 1 -- 172.21.15.153:0/4159350141 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53000c81c0 con 0x7f53001589e0 2024-08-17T02:26:52.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.101+0000 7f52fcff9700 1 -- 172.21.15.153:0/4159350141 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f801e630 con 0x7f53001589e0 2024-08-17T02:26:52.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.101+0000 7f5305b89700 1 -- 172.21.15.153:0/4159350141 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5300152c90 con 0x7f53001589e0 2024-08-17T02:26:52.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.105+0000 7f5305b89700 1 -- 172.21.15.153:0/4159350141 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53000c8980 con 0x7f53001589e0 2024-08-17T02:26:52.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.105+0000 7f52fcff9700 1 -- 172.21.15.153:0/4159350141 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f52f8019030 con 0x7f53001589e0 2024-08-17T02:26:52.108 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.105+0000 7f52fcff9700 1 --2- 172.21.15.153:0/4159350141 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f52ec060890 0x7f52ec062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.108 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.105+0000 7f52fcff9700 1 -- 172.21.15.153:0/4159350141 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f52f807e020 con 0x7f53001589e0 2024-08-17T02:26:52.109 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.105+0000 7f5304b87700 1 --2- 172.21.15.153:0/4159350141 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f52ec060890 0x7f52ec062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.109 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.105+0000 7f5304b87700 1 --2- 172.21.15.153:0/4159350141 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f52ec060890 0x7f52ec062d40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f53001532a0 tx=0x7f52f00091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:52.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.113+0000 7f52fcff9700 1 -- 172.21.15.153:0/4159350141 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f52f804e7c0 con 0x7f53001589e0 2024-08-17T02:26:52.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.337+0000 7f5305b89700 1 -- 172.21.15.153:0/4159350141 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f53000638f0 con 0x7f53001589e0 2024-08-17T02:26:52.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.341+0000 7f52fcff9700 1 -- 172.21.15.153:0/4159350141 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f52f8017020 con 0x7f53001589e0 2024-08-17T02:26:52.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.345+0000 7f5305b89700 1 -- 172.21.15.153:0/4159350141 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f52ec060890 msgr2=0x7f52ec062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.345+0000 7f5305b89700 1 --2- 172.21.15.153:0/4159350141 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f52ec060890 0x7f52ec062d40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f53001532a0 tx=0x7f52f00091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.345+0000 7f5305b89700 1 -- 172.21.15.153:0/4159350141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53001589e0 msgr2=0x7f53000b1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.345+0000 7f5305b89700 1 --2- 172.21.15.153:0/4159350141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53001589e0 0x7f53000b1170 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f52f8014000 tx=0x7f52f8015000 comp rx=0 tx=0).stop 2024-08-17T02:26:52.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.345+0000 7f5305b89700 1 -- 172.21.15.153:0/4159350141 shutdown_connections 2024-08-17T02:26:52.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.345+0000 7f5305b89700 1 --2- 172.21.15.153:0/4159350141 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f52ec060890 0x7f52ec062d40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.345+0000 7f5305b89700 1 --2- 172.21.15.153:0/4159350141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53001589e0 0x7f53000b1170 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.345+0000 7f5305b89700 1 --2- 172.21.15.153:0/4159350141 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53001525f0 0x7f53001584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.345+0000 7f5305b89700 1 --2- 172.21.15.153:0/4159350141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5300152220 0x7f53000c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.345+0000 7f5305b89700 1 -- 172.21.15.153:0/4159350141 >> 172.21.15.153:0/4159350141 conn(0x7f53000d00a0 msgr2=0x7f530015bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:52.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.345+0000 7f5305b89700 1 -- 172.21.15.153:0/4159350141 shutdown_connections 2024-08-17T02:26:52.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.345+0000 7f5305b89700 1 -- 172.21.15.153:0/4159350141 wait complete. 2024-08-17T02:26:52.362 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-08-17T02:26:52.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.465+0000 7ff795d54700 1 Processor -- start 2024-08-17T02:26:52.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.465+0000 7ff795d54700 1 -- start start 2024-08-17T02:26:52.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.469+0000 7ff795d54700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff790155ef0 0x7ff7900686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.469+0000 7ff795d54700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff790068be0 0x7ff7900aca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.469+0000 7ff795d54700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7900c9520 con 0x7ff7900acfb0 2024-08-17T02:26:52.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.469+0000 7ff795d54700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff79006e840 con 0x7ff790068be0 2024-08-17T02:26:52.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.469+0000 7ff795d54700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff790069010 con 0x7ff790155ef0 2024-08-17T02:26:52.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.469+0000 7ff78ffff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ff7900acfb0 0x7ff7900b07e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50812/0 (socket says 172.21.15.153:50812) 2024-08-17T02:26:52.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.469+0000 7ff78ffff700 1 -- 172.21.15.153:0/1901932772 learned_addr learned my addr 172.21.15.153:0/1901932772 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:52.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.469+0000 7ff78f7fe700 1 --2- 172.21.15.153:0/1901932772 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff790155ef0 0x7ff7900686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.469+0000 7ff78effd700 1 --2- 172.21.15.153:0/1901932772 >> v2:172.21.15.174:3300/0 conn(0x7ff790068be0 0x7ff7900aca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.469+0000 7ff78e7fc700 1 -- 172.21.15.153:0/1901932772 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1051515854 0 0) 0x7ff7900c9520 con 0x7ff7900acfb0 2024-08-17T02:26:52.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.469+0000 7ff78e7fc700 1 -- 172.21.15.153:0/1901932772 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff778003570 con 0x7ff7900acfb0 2024-08-17T02:26:52.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.469+0000 7ff78f7fe700 1 -- 172.21.15.153:0/1901932772 >> v2:172.21.15.174:3300/0 conn(0x7ff790068be0 msgr2=0x7ff7900aca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:52.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.469+0000 7ff78f7fe700 1 --2- 172.21.15.153:0/1901932772 >> v2:172.21.15.174:3300/0 conn(0x7ff790068be0 0x7ff7900aca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.469+0000 7ff78f7fe700 1 -- 172.21.15.153:0/1901932772 >> v1:172.21.15.153:6789/0 conn(0x7ff7900acfb0 legacy=0x7ff7900b07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.469+0000 7ff78f7fe700 1 -- 172.21.15.153:0/1901932772 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7900ad430 con 0x7ff790155ef0 2024-08-17T02:26:52.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.469+0000 7ff78f7fe700 1 --2- 172.21.15.153:0/1901932772 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff790155ef0 0x7ff7900686a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff7800098e0 tx=0x7ff7800091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14f86cc62f795c0b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:52.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.469+0000 7ff78e7fc700 1 -- 172.21.15.153:0/1901932772 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff780011630 con 0x7ff790155ef0 2024-08-17T02:26:52.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.469+0000 7ff78e7fc700 1 -- 172.21.15.153:0/1901932772 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff780011790 con 0x7ff790155ef0 2024-08-17T02:26:52.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.469+0000 7ff78e7fc700 1 -- 172.21.15.153:0/1901932772 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff780011b30 con 0x7ff790155ef0 2024-08-17T02:26:52.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.469+0000 7ff795d54700 1 -- 172.21.15.153:0/1901932772 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff790155ef0 msgr2=0x7ff7900686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.469+0000 7ff795d54700 1 --2- 172.21.15.153:0/1901932772 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff790155ef0 0x7ff7900686a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff7800098e0 tx=0x7ff7800091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.469+0000 7ff795d54700 1 -- 172.21.15.153:0/1901932772 shutdown_connections 2024-08-17T02:26:52.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.469+0000 7ff795d54700 1 --2- 172.21.15.153:0/1901932772 >> v2:172.21.15.174:3300/0 conn(0x7ff790068be0 0x7ff7900aca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.469+0000 7ff795d54700 1 --2- 172.21.15.153:0/1901932772 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff790155ef0 0x7ff7900686a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.469+0000 7ff795d54700 1 -- 172.21.15.153:0/1901932772 >> 172.21.15.153:0/1901932772 conn(0x7ff7900cd160 msgr2=0x7ff79006d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:52.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.469+0000 7ff795d54700 1 -- 172.21.15.153:0/1901932772 shutdown_connections 2024-08-17T02:26:52.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.469+0000 7ff795d54700 1 -- 172.21.15.153:0/1901932772 wait complete. 2024-08-17T02:26:52.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.473+0000 7ff795d54700 1 Processor -- start 2024-08-17T02:26:52.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.473+0000 7ff795d54700 1 -- start start 2024-08-17T02:26:52.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.473+0000 7ff795d54700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff790068be0 0x7ff7900a5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.473+0000 7ff795d54700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7900acfb0 0x7ff7901536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.473+0000 7ff795d54700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff790155ef0 0x7ff7901658a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.473+0000 7ff795d54700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff790153bf0 con 0x7ff7900acfb0 2024-08-17T02:26:52.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.473+0000 7ff795d54700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79014d890 con 0x7ff790155ef0 2024-08-17T02:26:52.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.473+0000 7ff795d54700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff790165de0 con 0x7ff790068be0 2024-08-17T02:26:52.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.473+0000 7ff78effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7900acfb0 0x7ff7901536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.473+0000 7ff78effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7900acfb0 0x7ff7901536b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59532/0 (socket says 172.21.15.153:59532) 2024-08-17T02:26:52.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.473+0000 7ff78effd700 1 -- 172.21.15.153:0/3154958488 learned_addr learned my addr 172.21.15.153:0/3154958488 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:52.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.473+0000 7ff78f7fe700 1 --2- 172.21.15.153:0/3154958488 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff790068be0 0x7ff7900a5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.473+0000 7ff78ffff700 1 --2- 172.21.15.153:0/3154958488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff790155ef0 0x7ff7901658a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.473+0000 7ff78effd700 1 -- 172.21.15.153:0/3154958488 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff790068be0 msgr2=0x7ff7900a5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.473+0000 7ff78effd700 1 --2- 172.21.15.153:0/3154958488 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff790068be0 0x7ff7900a5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.473+0000 7ff78effd700 1 -- 172.21.15.153:0/3154958488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff790155ef0 msgr2=0x7ff7901658a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.473+0000 7ff78effd700 1 --2- 172.21.15.153:0/3154958488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff790155ef0 0x7ff7901658a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.473+0000 7ff78effd700 1 -- 172.21.15.153:0/3154958488 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff780009420 con 0x7ff7900acfb0 2024-08-17T02:26:52.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.473+0000 7ff78effd700 1 --2- 172.21.15.153:0/3154958488 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7900acfb0 0x7ff7901536b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff78400e930 tx=0x7ff7840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:52.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.473+0000 7ff7777fe700 1 -- 172.21.15.153:0/3154958488 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff784013680 con 0x7ff7900acfb0 2024-08-17T02:26:52.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.473+0000 7ff7777fe700 1 -- 172.21.15.153:0/3154958488 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7840137e0 con 0x7ff7900acfb0 2024-08-17T02:26:52.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.473+0000 7ff795d54700 1 -- 172.21.15.153:0/3154958488 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7901663c0 con 0x7ff7900acfb0 2024-08-17T02:26:52.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.473+0000 7ff7777fe700 1 -- 172.21.15.153:0/3154958488 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff784013b80 con 0x7ff7900acfb0 2024-08-17T02:26:52.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.473+0000 7ff795d54700 1 -- 172.21.15.153:0/3154958488 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7900afd00 con 0x7ff7900acfb0 2024-08-17T02:26:52.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.473+0000 7ff795d54700 1 -- 172.21.15.153:0/3154958488 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff790166550 con 0x7ff7900acfb0 2024-08-17T02:26:52.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.477+0000 7ff7777fe700 1 -- 172.21.15.153:0/3154958488 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff78400c3e0 con 0x7ff7900acfb0 2024-08-17T02:26:52.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.477+0000 7ff7777fe700 1 --2- 172.21.15.153:0/3154958488 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff77c060860 0x7ff77c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.477+0000 7ff7777fe700 1 -- 172.21.15.153:0/3154958488 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff78407c9b0 con 0x7ff7900acfb0 2024-08-17T02:26:52.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.477+0000 7ff78f7fe700 1 --2- 172.21.15.153:0/3154958488 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff77c060860 0x7ff77c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.477+0000 7ff78f7fe700 1 --2- 172.21.15.153:0/3154958488 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff77c060860 0x7ff77c062d10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff7800091e0 tx=0x7ff780017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:52.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.481+0000 7ff7777fe700 1 -- 172.21.15.153:0/3154958488 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff78404d0b0 con 0x7ff7900acfb0 2024-08-17T02:26:52.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.705+0000 7ff795d54700 1 -- 172.21.15.153:0/3154958488 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7ff7900645c0 con 0x7ff7900acfb0 2024-08-17T02:26:52.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.713+0000 7ff7777fe700 1 -- 172.21.15.153:0/3154958488 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff7840506d0 con 0x7ff7900acfb0 2024-08-17T02:26:52.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.713+0000 7ff795d54700 1 -- 172.21.15.153:0/3154958488 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff77c060860 msgr2=0x7ff77c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.713+0000 7ff795d54700 1 --2- 172.21.15.153:0/3154958488 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff77c060860 0x7ff77c062d10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff7800091e0 tx=0x7ff780017000 comp rx=0 tx=0).stop 2024-08-17T02:26:52.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.713+0000 7ff795d54700 1 -- 172.21.15.153:0/3154958488 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7900acfb0 msgr2=0x7ff7901536b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.713+0000 7ff795d54700 1 --2- 172.21.15.153:0/3154958488 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7900acfb0 0x7ff7901536b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff78400e930 tx=0x7ff7840091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.717+0000 7ff795d54700 1 -- 172.21.15.153:0/3154958488 shutdown_connections 2024-08-17T02:26:52.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.717+0000 7ff795d54700 1 --2- 172.21.15.153:0/3154958488 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff77c060860 0x7ff77c062d10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.717+0000 7ff795d54700 1 --2- 172.21.15.153:0/3154958488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff790155ef0 0x7ff7901658a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.717+0000 7ff795d54700 1 --2- 172.21.15.153:0/3154958488 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7900acfb0 0x7ff7901536b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.717+0000 7ff795d54700 1 --2- 172.21.15.153:0/3154958488 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff790068be0 0x7ff7900a5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.717+0000 7ff795d54700 1 -- 172.21.15.153:0/3154958488 >> 172.21.15.153:0/3154958488 conn(0x7ff7900cd160 msgr2=0x7ff7900b06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:52.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.717+0000 7ff795d54700 1 -- 172.21.15.153:0/3154958488 shutdown_connections 2024-08-17T02:26:52.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.717+0000 7ff795d54700 1 -- 172.21.15.153:0/3154958488 wait complete. 2024-08-17T02:26:52.733 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-08-17T02:26:52.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.841+0000 7fd1b759e700 1 Processor -- start 2024-08-17T02:26:52.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.841+0000 7fd1b759e700 1 -- start start 2024-08-17T02:26:52.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.841+0000 7fd1b759e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd1b8154900 0x7fd1b80b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.841+0000 7fd1b759e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd1b80b12d0 0x7fd1b80cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.841+0000 7fd1b759e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1b80b1730 con 0x7fd1b80cb390 2024-08-17T02:26:52.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.841+0000 7fd1b759e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1b8068790 con 0x7fd1b80b12d0 2024-08-17T02:26:52.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.841+0000 7fd1b759e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1b81583f0 con 0x7fd1b8154900 2024-08-17T02:26:52.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.841+0000 7fd1b6d9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fd1b80cb390 0x7fd1b806df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50826/0 (socket says 172.21.15.153:50826) 2024-08-17T02:26:52.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.841+0000 7fd1b6d9d700 1 -- 172.21.15.153:0/3934208295 learned_addr learned my addr 172.21.15.153:0/3934208295 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:52.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.841+0000 7fd1b5d9b700 1 --2- 172.21.15.153:0/3934208295 >> v2:172.21.15.153:3300/0 conn(0x7fd1b80b12d0 0x7fd1b80cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.841+0000 7fd1b659c700 1 --2- 172.21.15.153:0/3934208295 >> v2:172.21.15.174:3300/0 conn(0x7fd1b8154900 0x7fd1b80b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.841+0000 7fd1b559a700 1 -- 172.21.15.153:0/3934208295 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1956643313 0 0) 0x7fd1b0001490 con 0x7fd1b80cb390 2024-08-17T02:26:52.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.841+0000 7fd1b559a700 1 -- 172.21.15.153:0/3934208295 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1a0003570 con 0x7fd1b80cb390 2024-08-17T02:26:52.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.841+0000 7fd1b5d9b700 1 -- 172.21.15.153:0/3934208295 >> v2:172.21.15.174:3300/0 conn(0x7fd1b8154900 msgr2=0x7fd1b80b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:52.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.841+0000 7fd1b5d9b700 1 --2- 172.21.15.153:0/3934208295 >> v2:172.21.15.174:3300/0 conn(0x7fd1b8154900 0x7fd1b80b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.841+0000 7fd1b5d9b700 1 -- 172.21.15.153:0/3934208295 >> v1:172.21.15.153:6789/0 conn(0x7fd1b80cb390 legacy=0x7fd1b806df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.841+0000 7fd1b5d9b700 1 -- 172.21.15.153:0/3934208295 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b80cbaa0 con 0x7fd1b80b12d0 2024-08-17T02:26:52.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.841+0000 7fd1b659c700 1 --2- 172.21.15.153:0/3934208295 >> v2:172.21.15.174:3300/0 conn(0x7fd1b8154900 0x7fd1b80b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:52.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.845+0000 7fd1b5d9b700 1 --2- 172.21.15.153:0/3934208295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1b80b12d0 0x7fd1b80cae50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8064e60 tx=0x7fd1a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c52bfbba837383 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:52.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.845+0000 7fd1b559a700 1 -- 172.21.15.153:0/3934208295 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a8011630 con 0x7fd1b80b12d0 2024-08-17T02:26:52.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.845+0000 7fd1b559a700 1 -- 172.21.15.153:0/3934208295 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a8011790 con 0x7fd1b80b12d0 2024-08-17T02:26:52.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.845+0000 7fd1b559a700 1 -- 172.21.15.153:0/3934208295 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a8011b30 con 0x7fd1b80b12d0 2024-08-17T02:26:52.849 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.845+0000 7fd1b759e700 1 -- 172.21.15.153:0/3934208295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1b80b12d0 msgr2=0x7fd1b80cae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.849 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.845+0000 7fd1b759e700 1 --2- 172.21.15.153:0/3934208295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1b80b12d0 0x7fd1b80cae50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8064e60 tx=0x7fd1a80091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.849 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.845+0000 7fd1b759e700 1 -- 172.21.15.153:0/3934208295 shutdown_connections 2024-08-17T02:26:52.849 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.845+0000 7fd1b759e700 1 --2- 172.21.15.153:0/3934208295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1b80b12d0 0x7fd1b80cae50 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.849 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.845+0000 7fd1b759e700 1 --2- 172.21.15.153:0/3934208295 >> v2:172.21.15.174:3300/0 conn(0x7fd1b8154900 0x7fd1b80b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.849 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.845+0000 7fd1b759e700 1 -- 172.21.15.153:0/3934208295 >> 172.21.15.153:0/3934208295 conn(0x7fd1b80678d0 msgr2=0x7fd1b8067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:52.849 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.845+0000 7fd1b759e700 1 -- 172.21.15.153:0/3934208295 shutdown_connections 2024-08-17T02:26:52.849 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.845+0000 7fd1b759e700 1 -- 172.21.15.153:0/3934208295 wait complete. 2024-08-17T02:26:52.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.845+0000 7fd1b759e700 1 Processor -- start 2024-08-17T02:26:52.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.845+0000 7fd1b759e700 1 -- start start 2024-08-17T02:26:52.852 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.849+0000 7fd1b759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1b80b12d0 0x7fd1b80afba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.852 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.849+0000 7fd1b759e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1b80cb390 0x7fd1b813ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.852 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.849+0000 7fd1b759e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1b8154900 0x7fd1b813ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.852 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.849+0000 7fd1b759e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b8145260 con 0x7fd1b80b12d0 2024-08-17T02:26:52.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.849+0000 7fd1b759e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b8145b00 con 0x7fd1b8154900 2024-08-17T02:26:52.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.849+0000 7fd1b759e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b80b00e0 con 0x7fd1b80cb390 2024-08-17T02:26:52.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.849+0000 7fd1b659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1b80b12d0 0x7fd1b80afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.849+0000 7fd1b659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1b80b12d0 0x7fd1b80afba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59548/0 (socket says 172.21.15.153:59548) 2024-08-17T02:26:52.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.849+0000 7fd1b659c700 1 -- 172.21.15.153:0/4017406915 learned_addr learned my addr 172.21.15.153:0/4017406915 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:52.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.849+0000 7fd1b6d9d700 1 --2- 172.21.15.153:0/4017406915 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1b8154900 0x7fd1b813ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.849+0000 7fd1b5d9b700 1 --2- 172.21.15.153:0/4017406915 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1b80cb390 0x7fd1b813ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.849+0000 7fd1b659c700 1 -- 172.21.15.153:0/4017406915 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1b80cb390 msgr2=0x7fd1b813ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.849+0000 7fd1b659c700 1 --2- 172.21.15.153:0/4017406915 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1b80cb390 0x7fd1b813ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.849+0000 7fd1b659c700 1 -- 172.21.15.153:0/4017406915 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1b8154900 msgr2=0x7fd1b813ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.849+0000 7fd1b659c700 1 --2- 172.21.15.153:0/4017406915 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1b8154900 0x7fd1b813ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.849+0000 7fd1b659c700 1 -- 172.21.15.153:0/4017406915 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a8009420 con 0x7fd1b80b12d0 2024-08-17T02:26:52.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.849+0000 7fd1b6d9d700 1 --2- 172.21.15.153:0/4017406915 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1b8154900 0x7fd1b813ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:52.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.849+0000 7fd1b659c700 1 --2- 172.21.15.153:0/4017406915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1b80b12d0 0x7fd1b80afba0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00e900 tx=0x7fd1ac008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:52.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.849+0000 7fd1a67fc700 1 -- 172.21.15.153:0/4017406915 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac00eea0 con 0x7fd1b80b12d0 2024-08-17T02:26:52.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.849+0000 7fd1a67fc700 1 -- 172.21.15.153:0/4017406915 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1ac00c580 con 0x7fd1b80b12d0 2024-08-17T02:26:52.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.849+0000 7fd1a67fc700 1 -- 172.21.15.153:0/4017406915 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac00c920 con 0x7fd1b80b12d0 2024-08-17T02:26:52.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.849+0000 7fd1b759e700 1 -- 172.21.15.153:0/4017406915 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1b80b0340 con 0x7fd1b80b12d0 2024-08-17T02:26:52.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.849+0000 7fd1b759e700 1 -- 172.21.15.153:0/4017406915 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1b8145790 con 0x7fd1b80b12d0 2024-08-17T02:26:52.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.853+0000 7fd1a67fc700 1 -- 172.21.15.153:0/4017406915 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd1ac00ccd0 con 0x7fd1b80b12d0 2024-08-17T02:26:52.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.853+0000 7fd1a67fc700 1 --2- 172.21.15.153:0/4017406915 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd198060860 0x7fd198062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.853+0000 7fd1a67fc700 1 -- 172.21.15.153:0/4017406915 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd1ac07c680 con 0x7fd1b80b12d0 2024-08-17T02:26:52.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.853+0000 7fd1b5d9b700 1 --2- 172.21.15.153:0/4017406915 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd198060860 0x7fd198062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.853+0000 7fd1b759e700 1 -- 172.21.15.153:0/4017406915 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1b80643a0 con 0x7fd1b80b12d0 2024-08-17T02:26:52.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.853+0000 7fd1b5d9b700 1 --2- 172.21.15.153:0/4017406915 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd198060860 0x7fd198062d10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8157bc0 tx=0x7fd1a8017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:52.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:52.865+0000 7fd1a67fc700 1 -- 172.21.15.153:0/4017406915 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd1ac050850 con 0x7fd1b80b12d0 2024-08-17T02:26:53.082 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.077+0000 7fd1b759e700 1 -- 172.21.15.153:0/4017406915 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fd1b806f5f0 con 0x7fd1b80b12d0 2024-08-17T02:26:53.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.085+0000 7fd1a67fc700 1 -- 172.21.15.153:0/4017406915 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd1ac020030 con 0x7fd1b80b12d0 2024-08-17T02:26:53.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.089+0000 7fd1b759e700 1 -- 172.21.15.153:0/4017406915 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd198060860 msgr2=0x7fd198062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.089+0000 7fd1b759e700 1 --2- 172.21.15.153:0/4017406915 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd198060860 0x7fd198062d10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8157bc0 tx=0x7fd1a8017000 comp rx=0 tx=0).stop 2024-08-17T02:26:53.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.089+0000 7fd1b759e700 1 -- 172.21.15.153:0/4017406915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1b80b12d0 msgr2=0x7fd1b80afba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.089+0000 7fd1b759e700 1 --2- 172.21.15.153:0/4017406915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1b80b12d0 0x7fd1b80afba0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00e900 tx=0x7fd1ac008040 comp rx=0 tx=0).stop 2024-08-17T02:26:53.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.089+0000 7fd1b759e700 1 -- 172.21.15.153:0/4017406915 shutdown_connections 2024-08-17T02:26:53.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.089+0000 7fd1b759e700 1 --2- 172.21.15.153:0/4017406915 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd198060860 0x7fd198062d10 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.089+0000 7fd1b759e700 1 --2- 172.21.15.153:0/4017406915 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1b8154900 0x7fd1b813ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.089+0000 7fd1b759e700 1 --2- 172.21.15.153:0/4017406915 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1b80cb390 0x7fd1b813ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.089+0000 7fd1b759e700 1 --2- 172.21.15.153:0/4017406915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1b80b12d0 0x7fd1b80afba0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.089+0000 7fd1b759e700 1 -- 172.21.15.153:0/4017406915 >> 172.21.15.153:0/4017406915 conn(0x7fd1b80678d0 msgr2=0x7fd1b8151900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:53.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.089+0000 7fd1b759e700 1 -- 172.21.15.153:0/4017406915 shutdown_connections 2024-08-17T02:26:53.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.089+0000 7fd1b759e700 1 -- 172.21.15.153:0/4017406915 wait complete. 2024-08-17T02:26:53.104 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:53.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.205+0000 7f5725fef700 1 Processor -- start 2024-08-17T02:26:53.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.205+0000 7f5725fef700 1 -- start start 2024-08-17T02:26:53.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.205+0000 7f5725fef700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f57200ab540 0x7f572006eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.205+0000 7f5725fef700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5720155720 0x7f57200b1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.205+0000 7f5725fef700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57200aba70 con 0x7f572006e9d0 2024-08-17T02:26:53.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.205+0000 7f5725fef700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57200abd50 con 0x7f57200ab540 2024-08-17T02:26:53.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.205+0000 7f5725fef700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57200ac030 con 0x7f5720155720 2024-08-17T02:26:53.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.205+0000 7f571ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f57200ab540 0x7f572006eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.205+0000 7f5724fed700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f572006e9d0 0x7f5720155010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50840/0 (socket says 172.21.15.153:50840) 2024-08-17T02:26:53.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.205+0000 7f571ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f57200ab540 0x7f572006eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59562/0 (socket says 172.21.15.153:59562) 2024-08-17T02:26:53.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.205+0000 7f5724fed700 1 -- 172.21.15.153:0/3053771674 learned_addr learned my addr 172.21.15.153:0/3053771674 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:53.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.205+0000 7f57257ee700 1 --2- 172.21.15.153:0/3053771674 >> v2:172.21.15.174:3300/0 conn(0x7f5720155720 0x7f57200b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.205+0000 7f571ffff700 1 -- 172.21.15.153:0/3053771674 >> v2:172.21.15.174:3300/0 conn(0x7f5720155720 msgr2=0x7f57200b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:53.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.205+0000 7f571ffff700 1 --2- 172.21.15.153:0/3053771674 >> v2:172.21.15.174:3300/0 conn(0x7f5720155720 0x7f57200b1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.205+0000 7f571ffff700 1 -- 172.21.15.153:0/3053771674 >> v1:172.21.15.153:6789/0 conn(0x7f572006e9d0 legacy=0x7f5720155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.205+0000 7f571ffff700 1 -- 172.21.15.153:0/3053771674 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57200ac310 con 0x7f57200ab540 2024-08-17T02:26:53.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.205+0000 7f571ffff700 1 --2- 172.21.15.153:0/3053771674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57200ab540 0x7f572006eda0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f572006b070 tx=0x7f571000a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a02688ea039569 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:53.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.205+0000 7f571f7fe700 1 -- 172.21.15.153:0/3053771674 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571000c970 con 0x7f57200ab540 2024-08-17T02:26:53.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.205+0000 7f571f7fe700 1 -- 172.21.15.153:0/3053771674 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571000cad0 con 0x7f57200ab540 2024-08-17T02:26:53.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.205+0000 7f571f7fe700 1 -- 172.21.15.153:0/3053771674 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571000ce70 con 0x7f57200ab540 2024-08-17T02:26:53.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.209+0000 7f5725fef700 1 -- 172.21.15.153:0/3053771674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57200ab540 msgr2=0x7f572006eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.209+0000 7f5725fef700 1 --2- 172.21.15.153:0/3053771674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57200ab540 0x7f572006eda0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f572006b070 tx=0x7f571000a330 comp rx=0 tx=0).stop 2024-08-17T02:26:53.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.209+0000 7f5725fef700 1 -- 172.21.15.153:0/3053771674 shutdown_connections 2024-08-17T02:26:53.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.209+0000 7f5725fef700 1 --2- 172.21.15.153:0/3053771674 >> v2:172.21.15.174:3300/0 conn(0x7f5720155720 0x7f57200b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.209+0000 7f5725fef700 1 --2- 172.21.15.153:0/3053771674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57200ab540 0x7f572006eda0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.209+0000 7f5725fef700 1 -- 172.21.15.153:0/3053771674 >> 172.21.15.153:0/3053771674 conn(0x7f57200678d0 msgr2=0x7f5720067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:53.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.209+0000 7f5725fef700 1 -- 172.21.15.153:0/3053771674 shutdown_connections 2024-08-17T02:26:53.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.209+0000 7f5725fef700 1 -- 172.21.15.153:0/3053771674 wait complete. 2024-08-17T02:26:53.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.209+0000 7f5725fef700 1 Processor -- start 2024-08-17T02:26:53.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.209+0000 7f5725fef700 1 -- start start 2024-08-17T02:26:53.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.209+0000 7f5725fef700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f572006e9d0 0x7f572014e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.209+0000 7f5725fef700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f57200ab540 0x7f5720068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.209+0000 7f5725fef700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5720155720 0x7f5720171140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.209+0000 7f5725fef700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5720069480 con 0x7f5720155720 2024-08-17T02:26:53.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.209+0000 7f5725fef700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5720168070 con 0x7f572006e9d0 2024-08-17T02:26:53.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.209+0000 7f5725fef700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572014b380 con 0x7f57200ab540 2024-08-17T02:26:53.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.209+0000 7f57257ee700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5720155720 0x7f5720171140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.209+0000 7f57257ee700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5720155720 0x7f5720171140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59574/0 (socket says 172.21.15.153:59574) 2024-08-17T02:26:53.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.209+0000 7f57257ee700 1 -- 172.21.15.153:0/186364540 learned_addr learned my addr 172.21.15.153:0/186364540 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:53.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.209+0000 7f5724fed700 1 --2- 172.21.15.153:0/186364540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f572006e9d0 0x7f572014e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.209+0000 7f571ffff700 1 --2- 172.21.15.153:0/186364540 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f57200ab540 0x7f5720068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.209+0000 7f57257ee700 1 -- 172.21.15.153:0/186364540 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f57200ab540 msgr2=0x7f5720068f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.209+0000 7f57257ee700 1 --2- 172.21.15.153:0/186364540 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f57200ab540 0x7f5720068f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.209+0000 7f57257ee700 1 -- 172.21.15.153:0/186364540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f572006e9d0 msgr2=0x7f572014e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.209+0000 7f57257ee700 1 --2- 172.21.15.153:0/186364540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f572006e9d0 0x7f572014e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.209+0000 7f57257ee700 1 -- 172.21.15.153:0/186364540 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f571000a5d0 con 0x7f5720155720 2024-08-17T02:26:53.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.209+0000 7f5724fed700 1 --2- 172.21.15.153:0/186364540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f572006e9d0 0x7f572014e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:53.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.209+0000 7f57257ee700 1 --2- 172.21.15.153:0/186364540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5720155720 0x7f5720171140 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5718007f50 tx=0x7f5718009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:53.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.213+0000 7f571cff9700 1 -- 172.21.15.153:0/186364540 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571800ecd0 con 0x7f5720155720 2024-08-17T02:26:53.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.213+0000 7f571cff9700 1 -- 172.21.15.153:0/186364540 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571800ee50 con 0x7f5720155720 2024-08-17T02:26:53.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.213+0000 7f5725fef700 1 -- 172.21.15.153:0/186364540 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5720069670 con 0x7f5720155720 2024-08-17T02:26:53.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.213+0000 7f571cff9700 1 -- 172.21.15.153:0/186364540 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5718014670 con 0x7f5720155720 2024-08-17T02:26:53.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.213+0000 7f5725fef700 1 -- 172.21.15.153:0/186364540 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5720069a00 con 0x7f5720155720 2024-08-17T02:26:53.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.213+0000 7f5725fef700 1 -- 172.21.15.153:0/186364540 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57200643a0 con 0x7f5720155720 2024-08-17T02:26:53.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.213+0000 7f571cff9700 1 -- 172.21.15.153:0/186364540 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f57180149e0 con 0x7f5720155720 2024-08-17T02:26:53.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.213+0000 7f571cff9700 1 --2- 172.21.15.153:0/186364540 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f570c060890 0x7f570c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.213+0000 7f571cff9700 1 -- 172.21.15.153:0/186364540 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f571807cf20 con 0x7f5720155720 2024-08-17T02:26:53.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.213+0000 7f5724fed700 1 --2- 172.21.15.153:0/186364540 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f570c060890 0x7f570c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.217+0000 7f5724fed700 1 --2- 172.21.15.153:0/186364540 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f570c060890 0x7f570c062d40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5714007fd0 tx=0x7f5714009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:53.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.221+0000 7f571cff9700 1 -- 172.21.15.153:0/186364540 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f571804d6c0 con 0x7f5720155720 2024-08-17T02:26:53.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.385+0000 7f5725fef700 1 -- 172.21.15.153:0/186364540 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5720159e50 con 0x7f5720155720 2024-08-17T02:26:53.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.389+0000 7f571cff9700 1 -- 172.21.15.153:0/186364540 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+12182 (secure 0 0 0) 0x7f5718050ce0 con 0x7f5720155720 2024-08-17T02:26:53.392 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:53.392 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":28,"fsid":"56d41c33-b929-456d-96be-2aac4ecd299d","created":"2024-08-17T02:25:47.756085+0000","modified":"2024-08-17T02:26:50.473273+0000","last_up_change":"2024-08-17T02:25:58.643690+0000","last_in_change":"2024-08-17T02:25:49.809186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:58.093273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"0736f8e6-818e-42e6-a0dc-8aaf813315d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":24234},{"type":"v1","addr":"172.21.15.153:6817","nonce":24234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":24234},{"type":"v1","addr":"172.21.15.153:6819","nonce":24234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":24234},{"type":"v1","addr":"172.21.15.153:6823","nonce":24234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":24234},{"type":"v1","addr":"172.21.15.153:6821","nonce":24234}]},"public_addr":"172.21.15.153:6817/24234","cluster_addr":"172.21.15.153:6819/24234","heartbeat_back_addr":"172.21.15.153:6823/24234","heartbeat_front_addr":"172.21.15.153:6821/24234","state":["exists","up"]},{"osd":1,"uuid":"011762e9-6c2d-441a-aa56-68474639d72f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":24232},{"type":"v1","addr":"172.21.15.153:6801","nonce":24232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":24232},{"type":"v1","addr":"172.21.15.153:6803","nonce":24232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":24232},{"type":"v1","addr":"172.21.15.153:6809","nonce":24232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":24232},{"type":"v1","addr":"172.21.15.153:6806","nonce":24232}]},"public_addr":"172.21.15.153:6801/24232","cluster_addr":"172.21.15.153:6803/24232","heartbeat_back_addr":"172.21.15.153:6809/24232","heartbeat_front_addr":"172.21.15.153:6806/24232","state":["exists","up"]},{"osd":2,"uuid":"b562cd97-aa12-455e-b46a-e720a2ec9d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":24235},{"type":"v1","addr":"172.21.15.153:6808","nonce":24235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":24235},{"type":"v1","addr":"172.21.15.153:6811","nonce":24235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":24235},{"type":"v1","addr":"172.21.15.153:6815","nonce":24235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":24235},{"type":"v1","addr":"172.21.15.153:6813","nonce":24235}]},"public_addr":"172.21.15.153:6808/24235","cluster_addr":"172.21.15.153:6811/24235","heartbeat_back_addr":"172.21.15.153:6815/24235","heartbeat_front_addr":"172.21.15.153:6813/24235","state":["exists","up"]},{"osd":3,"uuid":"222da52f-90c2-4132-a5d2-6f6cf83d4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":24236},{"type":"v1","addr":"172.21.15.153:6825","nonce":24236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":24236},{"type":"v1","addr":"172.21.15.153:6827","nonce":24236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":24236},{"type":"v1","addr":"172.21.15.153:6831","nonce":24236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":24236},{"type":"v1","addr":"172.21.15.153:6829","nonce":24236}]},"public_addr":"172.21.15.153:6825/24236","cluster_addr":"172.21.15.153:6827/24236","heartbeat_back_addr":"172.21.15.153:6831/24236","heartbeat_front_addr":"172.21.15.153:6829/24236","state":["exists","up"]},{"osd":4,"uuid":"a38a04cd-032b-4977-a260-1ef3567d0c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24456},{"type":"v1","addr":"172.21.15.174:6809","nonce":24456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24456},{"type":"v1","addr":"172.21.15.174:6811","nonce":24456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24456},{"type":"v1","addr":"172.21.15.174:6815","nonce":24456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24456},{"type":"v1","addr":"172.21.15.174:6813","nonce":24456}]},"public_addr":"172.21.15.174:6809/24456","cluster_addr":"172.21.15.174:6811/24456","heartbeat_back_addr":"172.21.15.174:6815/24456","heartbeat_front_addr":"172.21.15.174:6813/24456","state":["exists","up"]},{"osd":5,"uuid":"c7778084-e751-48da-87a1-ab8bbe85aa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24457},{"type":"v1","addr":"172.21.15.174:6825","nonce":24457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24457},{"type":"v1","addr":"172.21.15.174:6827","nonce":24457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24457},{"type":"v1","addr":"172.21.15.174:6831","nonce":24457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24457},{"type":"v1","addr":"172.21.15.174:6829","nonce":24457}]},"public_addr":"172.21.15.174:6825/24457","cluster_addr":"172.21.15.174:6827/24457","heartbeat_back_addr":"172.21.15.174:6831/24457","heartbeat_front_addr":"172.21.15.174:6829/24457","state":["exists","up"]},{"osd":6,"uuid":"2d8e0715-254f-442c-9625-50721d0bc858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24477},{"type":"v1","addr":"172.21.15.174:6801","nonce":24477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24477},{"type":"v1","addr":"172.21.15.174:6803","nonce":24477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24477},{"type":"v1","addr":"172.21.15.174:6807","nonce":24477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24477},{"type":"v1","addr":"172.21.15.174:6805","nonce":24477}]},"public_addr":"172.21.15.174:6801/24477","cluster_addr":"172.21.15.174:6803/24477","heartbeat_back_addr":"172.21.15.174:6807/24477","heartbeat_front_addr":"172.21.15.174:6805/24477","state":["exists","up"]},{"osd":7,"uuid":"dffda25a-4601-4ddb-9a27-b0be1cadde27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24455},{"type":"v1","addr":"172.21.15.174:6817","nonce":24455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24455},{"type":"v1","addr":"172.21.15.174:6819","nonce":24455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24455},{"type":"v1","addr":"172.21.15.174:6823","nonce":24455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24455},{"type":"v1","addr":"172.21.15.174:6821","nonce":24455}]},"public_addr":"172.21.15.174:6817/24455","cluster_addr":"172.21.15.174:6819/24455","heartbeat_back_addr":"172.21.15.174:6823/24455","heartbeat_front_addr":"172.21.15.174:6821/24455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.990117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.033862+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.748087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.112877+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.070448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.360961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.110940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.226377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:53.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.389+0000 7f5725fef700 1 -- 172.21.15.153:0/186364540 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f570c060890 msgr2=0x7f570c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.389+0000 7f5725fef700 1 --2- 172.21.15.153:0/186364540 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f570c060890 0x7f570c062d40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5714007fd0 tx=0x7f5714009040 comp rx=0 tx=0).stop 2024-08-17T02:26:53.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.389+0000 7f5725fef700 1 -- 172.21.15.153:0/186364540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5720155720 msgr2=0x7f5720171140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.389+0000 7f5725fef700 1 --2- 172.21.15.153:0/186364540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5720155720 0x7f5720171140 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5718007f50 tx=0x7f5718009860 comp rx=0 tx=0).stop 2024-08-17T02:26:53.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.389+0000 7f5725fef700 1 -- 172.21.15.153:0/186364540 shutdown_connections 2024-08-17T02:26:53.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.389+0000 7f5725fef700 1 --2- 172.21.15.153:0/186364540 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f570c060890 0x7f570c062d40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.393+0000 7f5725fef700 1 --2- 172.21.15.153:0/186364540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5720155720 0x7f5720171140 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.393+0000 7f5725fef700 1 --2- 172.21.15.153:0/186364540 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f57200ab540 0x7f5720068f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.393+0000 7f5725fef700 1 --2- 172.21.15.153:0/186364540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f572006e9d0 0x7f572014e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.393+0000 7f5725fef700 1 -- 172.21.15.153:0/186364540 >> 172.21.15.153:0/186364540 conn(0x7f57200678d0 msgr2=0x7f5720154130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:53.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.393+0000 7f5725fef700 1 -- 172.21.15.153:0/186364540 shutdown_connections 2024-08-17T02:26:53.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.393+0000 7f5725fef700 1 -- 172.21.15.153:0/186364540 wait complete. 2024-08-17T02:26:53.406 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:58.093273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:26:53.407 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:53.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.517+0000 7fe34359e700 1 Processor -- start 2024-08-17T02:26:53.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.517+0000 7fe34359e700 1 -- start start 2024-08-17T02:26:53.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.517+0000 7fe34359e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe34413f680 0x7fe3440aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.517+0000 7fe34359e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe34413fa50 0x7fe3440ad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.517+0000 7fe34359e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe3440b0100 0x7fe34406e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.517+0000 7fe34359e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3440afc70 con 0x7fe3440b0100 2024-08-17T02:26:53.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.517+0000 7fe34359e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3440adc00 con 0x7fe34413fa50 2024-08-17T02:26:53.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.517+0000 7fe34359e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3440af060 con 0x7fe34413f680 2024-08-17T02:26:53.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.517+0000 7fe342d9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe3440b0100 0x7fe34406e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.517+0000 7fe342d9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe3440b0100 0x7fe34406e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59592/0 (socket says 172.21.15.153:59592) 2024-08-17T02:26:53.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.517+0000 7fe342d9d700 1 -- 172.21.15.153:0/1501994716 learned_addr learned my addr 172.21.15.153:0/1501994716 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:53.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.517+0000 7fe34259c700 1 --2- 172.21.15.153:0/1501994716 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe34413f680 0x7fe3440aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.517+0000 7fe341d9b700 1 --2- 172.21.15.153:0/1501994716 >> v2:172.21.15.174:3300/0 conn(0x7fe34413fa50 0x7fe3440ad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.517+0000 7fe342d9d700 1 -- 172.21.15.153:0/1501994716 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe34413f680 msgr2=0x7fe3440aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:53.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.517+0000 7fe342d9d700 1 --2- 172.21.15.153:0/1501994716 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe34413f680 0x7fe3440aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.517+0000 7fe342d9d700 1 -- 172.21.15.153:0/1501994716 >> v2:172.21.15.174:3300/0 conn(0x7fe34413fa50 msgr2=0x7fe3440ad6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:53.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.517+0000 7fe342d9d700 1 --2- 172.21.15.153:0/1501994716 >> v2:172.21.15.174:3300/0 conn(0x7fe34413fa50 0x7fe3440ad6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.517+0000 7fe342d9d700 1 -- 172.21.15.153:0/1501994716 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3440af340 con 0x7fe3440b0100 2024-08-17T02:26:53.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.517+0000 7fe342d9d700 1 --2- 172.21.15.153:0/1501994716 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3440b0100 0x7fe34406e010 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe344068b40 tx=0x7fe33c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cacbebf478b3b2af server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:53.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.521+0000 7fe34159a700 1 -- 172.21.15.153:0/1501994716 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33c00b640 con 0x7fe3440b0100 2024-08-17T02:26:53.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.521+0000 7fe34159a700 1 -- 172.21.15.153:0/1501994716 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe33c00b7a0 con 0x7fe3440b0100 2024-08-17T02:26:53.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.521+0000 7fe34159a700 1 -- 172.21.15.153:0/1501994716 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33c00bb60 con 0x7fe3440b0100 2024-08-17T02:26:53.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.521+0000 7fe34359e700 1 -- 172.21.15.153:0/1501994716 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3440b0100 msgr2=0x7fe34406e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.521+0000 7fe34359e700 1 --2- 172.21.15.153:0/1501994716 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3440b0100 0x7fe34406e010 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe344068b40 tx=0x7fe33c009250 comp rx=0 tx=0).stop 2024-08-17T02:26:53.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.521+0000 7fe34359e700 1 -- 172.21.15.153:0/1501994716 shutdown_connections 2024-08-17T02:26:53.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.521+0000 7fe34359e700 1 --2- 172.21.15.153:0/1501994716 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3440b0100 0x7fe34406e010 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.521+0000 7fe34359e700 1 --2- 172.21.15.153:0/1501994716 >> v2:172.21.15.174:3300/0 conn(0x7fe34413fa50 0x7fe3440ad6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.521+0000 7fe34359e700 1 --2- 172.21.15.153:0/1501994716 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe34413f680 0x7fe3440aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.521+0000 7fe34359e700 1 -- 172.21.15.153:0/1501994716 >> 172.21.15.153:0/1501994716 conn(0x7fe3440678a0 msgr2=0x7fe344067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:53.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.521+0000 7fe34359e700 1 -- 172.21.15.153:0/1501994716 shutdown_connections 2024-08-17T02:26:53.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.521+0000 7fe34359e700 1 -- 172.21.15.153:0/1501994716 wait complete. 2024-08-17T02:26:53.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.521+0000 7fe34359e700 1 Processor -- start 2024-08-17T02:26:53.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.521+0000 7fe34359e700 1 -- start start 2024-08-17T02:26:53.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.525+0000 7fe34359e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3440b0100 0x7fe344158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.525+0000 7fe34359e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe34413f680 0x7fe344140d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.525+0000 7fe34359e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe34413fa50 0x7fe3441412b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.525+0000 7fe34359e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe344140200 con 0x7fe34413fa50 2024-08-17T02:26:53.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.525+0000 7fe34359e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3441541c0 con 0x7fe34413f680 2024-08-17T02:26:53.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.525+0000 7fe34359e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe344156b10 con 0x7fe3440b0100 2024-08-17T02:26:53.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.525+0000 7fe342d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe34413fa50 0x7fe3441412b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.525+0000 7fe342d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe34413fa50 0x7fe3441412b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59600/0 (socket says 172.21.15.153:59600) 2024-08-17T02:26:53.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.525+0000 7fe342d9d700 1 -- 172.21.15.153:0/2113848896 learned_addr learned my addr 172.21.15.153:0/2113848896 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:53.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.525+0000 7fe34259c700 1 --2- 172.21.15.153:0/2113848896 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3440b0100 0x7fe344158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.525+0000 7fe341d9b700 1 --2- 172.21.15.153:0/2113848896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe34413f680 0x7fe344140d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.525+0000 7fe342d9d700 1 -- 172.21.15.153:0/2113848896 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3440b0100 msgr2=0x7fe344158ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.525+0000 7fe342d9d700 1 --2- 172.21.15.153:0/2113848896 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3440b0100 0x7fe344158ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.525+0000 7fe342d9d700 1 -- 172.21.15.153:0/2113848896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe34413f680 msgr2=0x7fe344140d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.525+0000 7fe342d9d700 1 --2- 172.21.15.153:0/2113848896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe34413f680 0x7fe344140d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.525+0000 7fe342d9d700 1 -- 172.21.15.153:0/2113848896 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe33c0094f0 con 0x7fe34413fa50 2024-08-17T02:26:53.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.525+0000 7fe341d9b700 1 --2- 172.21.15.153:0/2113848896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe34413f680 0x7fe344140d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:53.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.525+0000 7fe342d9d700 1 --2- 172.21.15.153:0/2113848896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe34413fa50 0x7fe3441412b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe33c006fd0 tx=0x7fe33c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:53.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.525+0000 7fe33a7fc700 1 -- 172.21.15.153:0/2113848896 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33c00bb20 con 0x7fe34413fa50 2024-08-17T02:26:53.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.525+0000 7fe33a7fc700 1 -- 172.21.15.153:0/2113848896 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe33c011420 con 0x7fe34413fa50 2024-08-17T02:26:53.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.525+0000 7fe34359e700 1 -- 172.21.15.153:0/2113848896 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3441591e0 con 0x7fe34413fa50 2024-08-17T02:26:53.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.525+0000 7fe33a7fc700 1 -- 172.21.15.153:0/2113848896 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33c011800 con 0x7fe34413fa50 2024-08-17T02:26:53.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.525+0000 7fe34359e700 1 -- 172.21.15.153:0/2113848896 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe344156500 con 0x7fe34413fa50 2024-08-17T02:26:53.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.525+0000 7fe34359e700 1 -- 172.21.15.153:0/2113848896 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe344064330 con 0x7fe34413fa50 2024-08-17T02:26:53.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.529+0000 7fe33a7fc700 1 -- 172.21.15.153:0/2113848896 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe33c011b70 con 0x7fe34413fa50 2024-08-17T02:26:53.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.529+0000 7fe33a7fc700 1 --2- 172.21.15.153:0/2113848896 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fe324060860 0x7fe324062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.529+0000 7fe33a7fc700 1 -- 172.21.15.153:0/2113848896 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe33c07e200 con 0x7fe34413fa50 2024-08-17T02:26:53.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.529+0000 7fe34259c700 1 --2- 172.21.15.153:0/2113848896 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fe324060860 0x7fe324062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.529+0000 7fe34259c700 1 --2- 172.21.15.153:0/2113848896 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fe324060860 0x7fe324062d10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe32c009d90 tx=0x7fe32c0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:53.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.537+0000 7fe33a7fc700 1 -- 172.21.15.153:0/2113848896 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe33c04e900 con 0x7fe34413fa50 2024-08-17T02:26:53.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.697+0000 7fe34359e700 1 -- 172.21.15.153:0/2113848896 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe34406ed70 con 0x7fe34413fa50 2024-08-17T02:26:53.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.701+0000 7fe33a7fc700 1 -- 172.21.15.153:0/2113848896 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe33c051f20 con 0x7fe34413fa50 2024-08-17T02:26:53.703 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2024-08-17T02:26:53.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.701+0000 7fe34359e700 1 -- 172.21.15.153:0/2113848896 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fe324060860 msgr2=0x7fe324062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.701+0000 7fe34359e700 1 --2- 172.21.15.153:0/2113848896 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fe324060860 0x7fe324062d10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe32c009d90 tx=0x7fe32c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.701+0000 7fe34359e700 1 -- 172.21.15.153:0/2113848896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe34413fa50 msgr2=0x7fe3441412b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.701+0000 7fe34359e700 1 --2- 172.21.15.153:0/2113848896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe34413fa50 0x7fe3441412b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe33c006fd0 tx=0x7fe33c017000 comp rx=0 tx=0).stop 2024-08-17T02:26:53.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.701+0000 7fe34359e700 1 -- 172.21.15.153:0/2113848896 shutdown_connections 2024-08-17T02:26:53.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.701+0000 7fe34359e700 1 --2- 172.21.15.153:0/2113848896 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fe324060860 0x7fe324062d10 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.701+0000 7fe34359e700 1 --2- 172.21.15.153:0/2113848896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe34413fa50 0x7fe3441412b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.701+0000 7fe34359e700 1 --2- 172.21.15.153:0/2113848896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe34413f680 0x7fe344140d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.701+0000 7fe34359e700 1 --2- 172.21.15.153:0/2113848896 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3440b0100 0x7fe344158ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.701+0000 7fe34359e700 1 -- 172.21.15.153:0/2113848896 >> 172.21.15.153:0/2113848896 conn(0x7fe3440678a0 msgr2=0x7fe344135ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:53.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.701+0000 7fe34359e700 1 -- 172.21.15.153:0/2113848896 shutdown_connections 2024-08-17T02:26:53.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.701+0000 7fe34359e700 1 -- 172.21.15.153:0/2113848896 wait complete. 2024-08-17T02:26:53.718 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:26:53.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.817+0000 7f63d6ebd700 1 Processor -- start 2024-08-17T02:26:53.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.821+0000 7f63d6ebd700 1 -- start start 2024-08-17T02:26:53.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.821+0000 7f63d6ebd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f63d0155e50 0x7f63d00a9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.821+0000 7f63d6ebd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f63d0156220 0x7f63d00aa420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.821+0000 7f63d6ebd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63d006ebe0 0x7f63d006f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.821+0000 7f63d6ebd700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63d00afc10 con 0x7f63d0156220 2024-08-17T02:26:53.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.821+0000 7f63d6ebd700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63d006f570 con 0x7f63d0155e50 2024-08-17T02:26:53.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.821+0000 7f63d6ebd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d00aed20 con 0x7f63d006ebe0 2024-08-17T02:26:53.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.821+0000 7f63cffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f63d0156220 0x7f63d00aa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.821+0000 7f63cffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f63d0156220 0x7f63d00aa420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59602/0 (socket says 172.21.15.153:59602) 2024-08-17T02:26:53.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.821+0000 7f63cffff700 1 -- 172.21.15.153:0/1433908956 learned_addr learned my addr 172.21.15.153:0/1433908956 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:53.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.821+0000 7f63d4c59700 1 --2- 172.21.15.153:0/1433908956 >> v2:172.21.15.174:3300/0 conn(0x7f63d0155e50 0x7f63d00a9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.821+0000 7f63d545a700 1 --2- 172.21.15.153:0/1433908956 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63d006ebe0 0x7f63d006f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.821+0000 7f63cffff700 1 -- 172.21.15.153:0/1433908956 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63d006ebe0 msgr2=0x7f63d006f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:53.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.821+0000 7f63cffff700 1 --2- 172.21.15.153:0/1433908956 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63d006ebe0 0x7f63d006f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.821+0000 7f63cffff700 1 -- 172.21.15.153:0/1433908956 >> v2:172.21.15.174:3300/0 conn(0x7f63d0155e50 msgr2=0x7f63d00a9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:53.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.821+0000 7f63cffff700 1 --2- 172.21.15.153:0/1433908956 >> v2:172.21.15.174:3300/0 conn(0x7f63d0155e50 0x7f63d00a9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.821+0000 7f63cffff700 1 -- 172.21.15.153:0/1433908956 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d00af000 con 0x7f63d0156220 2024-08-17T02:26:53.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.821+0000 7f63d545a700 1 --2- 172.21.15.153:0/1433908956 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63d006ebe0 0x7f63d006f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:53.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.821+0000 7f63cffff700 1 --2- 172.21.15.153:0/1433908956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63d0156220 0x7f63d00aa420 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f63d0070220 tx=0x7f63c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6bbccf9cc2fa4d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:53.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.821+0000 7f63cf7fe700 1 -- 172.21.15.153:0/1433908956 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c0009e70 con 0x7f63d0156220 2024-08-17T02:26:53.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.821+0000 7f63cf7fe700 1 -- 172.21.15.153:0/1433908956 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c000b860 con 0x7f63d0156220 2024-08-17T02:26:53.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.821+0000 7f63cf7fe700 1 -- 172.21.15.153:0/1433908956 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c000bc00 con 0x7f63d0156220 2024-08-17T02:26:53.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.825+0000 7f63d6ebd700 1 -- 172.21.15.153:0/1433908956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63d0156220 msgr2=0x7f63d00aa420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.825+0000 7f63d6ebd700 1 --2- 172.21.15.153:0/1433908956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63d0156220 0x7f63d00aa420 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f63d0070220 tx=0x7f63c0009250 comp rx=0 tx=0).stop 2024-08-17T02:26:53.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.825+0000 7f63d6ebd700 1 -- 172.21.15.153:0/1433908956 shutdown_connections 2024-08-17T02:26:53.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.825+0000 7f63d6ebd700 1 --2- 172.21.15.153:0/1433908956 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63d006ebe0 0x7f63d006f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.825+0000 7f63d6ebd700 1 --2- 172.21.15.153:0/1433908956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63d0156220 0x7f63d00aa420 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.825+0000 7f63d6ebd700 1 --2- 172.21.15.153:0/1433908956 >> v2:172.21.15.174:3300/0 conn(0x7f63d0155e50 0x7f63d00a9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.825+0000 7f63d6ebd700 1 -- 172.21.15.153:0/1433908956 >> 172.21.15.153:0/1433908956 conn(0x7f63d0066e00 msgr2=0x7f63d0067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:53.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.825+0000 7f63d6ebd700 1 -- 172.21.15.153:0/1433908956 shutdown_connections 2024-08-17T02:26:53.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.825+0000 7f63d6ebd700 1 -- 172.21.15.153:0/1433908956 wait complete. 2024-08-17T02:26:53.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.825+0000 7f63d6ebd700 1 Processor -- start 2024-08-17T02:26:53.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.825+0000 7f63d6ebd700 1 -- start start 2024-08-17T02:26:53.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.825+0000 7f63d6ebd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63d006ebe0 0x7f63d00969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.825+0000 7f63d6ebd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63d0155e50 0x7f63d016a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.825+0000 7f63d6ebd700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63d0156220 0x7f63d0098960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.825+0000 7f63d6ebd700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d0099120 con 0x7f63d0155e50 2024-08-17T02:26:53.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.825+0000 7f63d6ebd700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d0156740 con 0x7f63d0156220 2024-08-17T02:26:53.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.825+0000 7f63d6ebd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d0098ea0 con 0x7f63d006ebe0 2024-08-17T02:26:53.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.825+0000 7f63cffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63d0155e50 0x7f63d016a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.825+0000 7f63cffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63d0155e50 0x7f63d016a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59616/0 (socket says 172.21.15.153:59616) 2024-08-17T02:26:53.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.825+0000 7f63cffff700 1 -- 172.21.15.153:0/826921184 learned_addr learned my addr 172.21.15.153:0/826921184 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:53.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.829+0000 7f63d545a700 1 --2- 172.21.15.153:0/826921184 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63d0156220 0x7f63d0098960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.829+0000 7f63d4c59700 1 --2- 172.21.15.153:0/826921184 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63d006ebe0 0x7f63d00969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.829+0000 7f63cffff700 1 -- 172.21.15.153:0/826921184 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63d006ebe0 msgr2=0x7f63d00969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.829+0000 7f63cffff700 1 --2- 172.21.15.153:0/826921184 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63d006ebe0 0x7f63d00969f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.829+0000 7f63cffff700 1 -- 172.21.15.153:0/826921184 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63d0156220 msgr2=0x7f63d0098960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.829+0000 7f63cffff700 1 --2- 172.21.15.153:0/826921184 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63d0156220 0x7f63d0098960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.829+0000 7f63cffff700 1 -- 172.21.15.153:0/826921184 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c00094f0 con 0x7f63d0155e50 2024-08-17T02:26:53.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.829+0000 7f63d545a700 1 --2- 172.21.15.153:0/826921184 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63d0156220 0x7f63d0098960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:53.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.829+0000 7f63cffff700 1 --2- 172.21.15.153:0/826921184 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63d0155e50 0x7f63d016a680 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f63d006f870 tx=0x7f63c0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:53.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.829+0000 7f63ccff9700 1 -- 172.21.15.153:0/826921184 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c000bbe0 con 0x7f63d0155e50 2024-08-17T02:26:53.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.829+0000 7f63ccff9700 1 -- 172.21.15.153:0/826921184 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c0000c90 con 0x7f63d0155e50 2024-08-17T02:26:53.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.829+0000 7f63ccff9700 1 -- 172.21.15.153:0/826921184 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c0011650 con 0x7f63d0155e50 2024-08-17T02:26:53.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.829+0000 7f63d6ebd700 1 -- 172.21.15.153:0/826921184 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d0159b90 con 0x7f63d0155e50 2024-08-17T02:26:53.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.829+0000 7f63d6ebd700 1 -- 172.21.15.153:0/826921184 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d015a190 con 0x7f63d0155e50 2024-08-17T02:26:53.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.829+0000 7f63d6ebd700 1 -- 172.21.15.153:0/826921184 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63d015a4b0 con 0x7f63d0155e50 2024-08-17T02:26:53.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.829+0000 7f63ccff9700 1 -- 172.21.15.153:0/826921184 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f63c0011a80 con 0x7f63d0155e50 2024-08-17T02:26:53.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.833+0000 7f63ccff9700 1 --2- 172.21.15.153:0/826921184 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f63bc060860 0x7f63bc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.833+0000 7f63ccff9700 1 -- 172.21.15.153:0/826921184 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f63c007dbc0 con 0x7f63d0155e50 2024-08-17T02:26:53.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.833+0000 7f63d4c59700 1 --2- 172.21.15.153:0/826921184 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f63bc060860 0x7f63bc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.833+0000 7f63d4c59700 1 --2- 172.21.15.153:0/826921184 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f63bc060860 0x7f63bc062d10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f63c4009db0 tx=0x7f63c40091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:53.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:53.837+0000 7f63ccff9700 1 -- 172.21.15.153:0/826921184 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f63d015a4b0 con 0x7f63d0155e50 2024-08-17T02:26:54.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.005+0000 7f63d6ebd700 1 -- 172.21.15.153:0/826921184 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f63d015a4b0 con 0x7f63d0155e50 2024-08-17T02:26:54.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.009+0000 7f63ccff9700 1 -- 172.21.15.153:0/826921184 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) v1 ==== 84+0+65 (secure 0 0 0) 0x7f63c0028060 con 0x7f63d0155e50 2024-08-17T02:26:54.010 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:54.011 INFO:teuthology.orchestra.run.smithi153.stdout:[ 2024-08-17T02:26:54.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-08-17T02:26:54.011 INFO:teuthology.orchestra.run.smithi153.stdout: "poolnum": 1, 2024-08-17T02:26:54.011 INFO:teuthology.orchestra.run.smithi153.stdout: "poolname": ".mgr" 2024-08-17T02:26:54.011 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-17T02:26:54.011 INFO:teuthology.orchestra.run.smithi153.stdout:] 2024-08-17T02:26:54.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.009+0000 7f63d6ebd700 1 -- 172.21.15.153:0/826921184 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f63bc060860 msgr2=0x7f63bc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.009+0000 7f63d6ebd700 1 --2- 172.21.15.153:0/826921184 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f63bc060860 0x7f63bc062d10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f63c4009db0 tx=0x7f63c40091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.009+0000 7f63d6ebd700 1 -- 172.21.15.153:0/826921184 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63d0155e50 msgr2=0x7f63d016a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.009+0000 7f63d6ebd700 1 --2- 172.21.15.153:0/826921184 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63d0155e50 0x7f63d016a680 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f63d006f870 tx=0x7f63c0017000 comp rx=0 tx=0).stop 2024-08-17T02:26:54.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.009+0000 7f63d6ebd700 1 -- 172.21.15.153:0/826921184 shutdown_connections 2024-08-17T02:26:54.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.009+0000 7f63d6ebd700 1 --2- 172.21.15.153:0/826921184 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f63bc060860 0x7f63bc062d10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.009+0000 7f63d6ebd700 1 --2- 172.21.15.153:0/826921184 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63d0156220 0x7f63d0098960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.009+0000 7f63d6ebd700 1 --2- 172.21.15.153:0/826921184 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63d0155e50 0x7f63d016a680 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.009+0000 7f63d6ebd700 1 --2- 172.21.15.153:0/826921184 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63d006ebe0 0x7f63d00969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.009+0000 7f63d6ebd700 1 -- 172.21.15.153:0/826921184 >> 172.21.15.153:0/826921184 conn(0x7f63d0066e00 msgr2=0x7f63d0153e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:54.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.009+0000 7f63d6ebd700 1 -- 172.21.15.153:0/826921184 shutdown_connections 2024-08-17T02:26:54.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.009+0000 7f63d6ebd700 1 -- 172.21.15.153:0/826921184 wait complete. 2024-08-17T02:26:54.025 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:26:54.025 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:26:54.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.133+0000 7f2744ef2700 1 Processor -- start 2024-08-17T02:26:54.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.133+0000 7f2744ef2700 1 -- start start 2024-08-17T02:26:54.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.133+0000 7f2744ef2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2740159d90 0x7f274015a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.133+0000 7f2744ef2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f27401560d0 0x7f27400c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.133+0000 7f2744ef2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27400cb0c0 con 0x7f27400c99d0 2024-08-17T02:26:54.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.133+0000 7f2744ef2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27400ca4b0 con 0x7f27401560d0 2024-08-17T02:26:54.138 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.133+0000 7f2744ef2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27400ca790 con 0x7f2740159d90 2024-08-17T02:26:54.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.133+0000 7f273e59c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2740159d90 0x7f274015a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.133+0000 7f273ed9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f27401560d0 0x7f27400c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.133+0000 7f273dd9b700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f27400c99d0 0x7f27401559c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.153:39388/0 (socket says 172.21.15.153:39388) 2024-08-17T02:26:54.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.133+0000 7f273ed9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f27401560d0 0x7f27400c9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.153:55166/0 (socket says 172.21.15.153:55166) 2024-08-17T02:26:54.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.133+0000 7f273e59c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2740159d90 0x7f274015a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.153:59070/0 (socket says 172.21.15.153:59070) 2024-08-17T02:26:54.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.133+0000 7f273dd9b700 1 -- 172.21.15.153:0/3959783615 learned_addr learned my addr 172.21.15.153:0/3959783615 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:54.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.137+0000 7f273ed9d700 1 -- 172.21.15.153:0/3959783615 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2740159d90 msgr2=0x7f274015a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:54.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.137+0000 7f273ed9d700 1 --2- 172.21.15.153:0/3959783615 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2740159d90 0x7f274015a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.137+0000 7f273ed9d700 1 -- 172.21.15.153:0/3959783615 >> v1:172.21.15.174:6789/0 conn(0x7f27400c99d0 legacy=0x7f27401559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.137+0000 7f273d59a700 1 -- 172.21.15.153:0/3959783615 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2842718843 0 0) 0x7f27400cb0c0 con 0x7f27400c99d0 2024-08-17T02:26:54.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.137+0000 7f273ed9d700 1 -- 172.21.15.153:0/3959783615 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27400caa70 con 0x7f27401560d0 2024-08-17T02:26:54.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.137+0000 7f273ed9d700 1 --2- 172.21.15.153:0/3959783615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27401560d0 0x7f27400c9e20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f27380098e0 tx=0x7f27380091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=973772df95d1f9c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:54.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.137+0000 7f273d59a700 1 -- 172.21.15.153:0/3959783615 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273800b640 con 0x7f27401560d0 2024-08-17T02:26:54.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.137+0000 7f273d59a700 1 -- 172.21.15.153:0/3959783615 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273800b7a0 con 0x7f27401560d0 2024-08-17T02:26:54.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.137+0000 7f273d59a700 1 -- 172.21.15.153:0/3959783615 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273800bb40 con 0x7f27401560d0 2024-08-17T02:26:54.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.137+0000 7f2744ef2700 1 -- 172.21.15.153:0/3959783615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27401560d0 msgr2=0x7f27400c9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.137+0000 7f2744ef2700 1 --2- 172.21.15.153:0/3959783615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27401560d0 0x7f27400c9e20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f27380098e0 tx=0x7f27380091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.137+0000 7f2744ef2700 1 -- 172.21.15.153:0/3959783615 shutdown_connections 2024-08-17T02:26:54.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.137+0000 7f2744ef2700 1 --2- 172.21.15.153:0/3959783615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27401560d0 0x7f27400c9e20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.137+0000 7f2744ef2700 1 --2- 172.21.15.153:0/3959783615 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2740159d90 0x7f274015a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.137+0000 7f2744ef2700 1 -- 172.21.15.153:0/3959783615 >> 172.21.15.153:0/3959783615 conn(0x7f274006e270 msgr2=0x7f27400b1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:54.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.137+0000 7f2744ef2700 1 -- 172.21.15.153:0/3959783615 shutdown_connections 2024-08-17T02:26:54.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.137+0000 7f2744ef2700 1 -- 172.21.15.153:0/3959783615 wait complete. 2024-08-17T02:26:54.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.137+0000 7f2744ef2700 1 Processor -- start 2024-08-17T02:26:54.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.141+0000 7f2744ef2700 1 -- start start 2024-08-17T02:26:54.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.141+0000 7f2744ef2700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27400c99d0 0x7f274014e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.141+0000 7f2744ef2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27401560d0 0x7f274014ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.141+0000 7f2744ef2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2740159d90 0x7f27401409a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.141+0000 7f2744ef2700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2740167350 con 0x7f2740159d90 2024-08-17T02:26:54.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.141+0000 7f2744ef2700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274014f6f0 con 0x7f27400c99d0 2024-08-17T02:26:54.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.141+0000 7f2744ef2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2740150450 con 0x7f27401560d0 2024-08-17T02:26:54.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.141+0000 7f273ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2740159d90 0x7f27401409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.141+0000 7f273ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2740159d90 0x7f27401409a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59626/0 (socket says 172.21.15.153:59626) 2024-08-17T02:26:54.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.141+0000 7f273ed9d700 1 -- 172.21.15.153:0/2078490242 learned_addr learned my addr 172.21.15.153:0/2078490242 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:54.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.141+0000 7f273e59c700 1 --2- 172.21.15.153:0/2078490242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27400c99d0 0x7f274014e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.141+0000 7f273dd9b700 1 --2- 172.21.15.153:0/2078490242 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27401560d0 0x7f274014ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.141+0000 7f273ed9d700 1 -- 172.21.15.153:0/2078490242 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27401560d0 msgr2=0x7f274014ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.141+0000 7f273ed9d700 1 --2- 172.21.15.153:0/2078490242 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27401560d0 0x7f274014ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.141+0000 7f273ed9d700 1 -- 172.21.15.153:0/2078490242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27400c99d0 msgr2=0x7f274014e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.141+0000 7f273ed9d700 1 --2- 172.21.15.153:0/2078490242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27400c99d0 0x7f274014e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.141+0000 7f273ed9d700 1 -- 172.21.15.153:0/2078490242 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2738009420 con 0x7f2740159d90 2024-08-17T02:26:54.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.141+0000 7f273dd9b700 1 --2- 172.21.15.153:0/2078490242 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27401560d0 0x7f274014ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:54.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.141+0000 7f273ed9d700 1 --2- 172.21.15.153:0/2078490242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2740159d90 0x7f27401409a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f274006d880 tx=0x7f2738017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:54.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.141+0000 7f27367fc700 1 -- 172.21.15.153:0/2078490242 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2738011420 con 0x7f2740159d90 2024-08-17T02:26:54.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.141+0000 7f27367fc700 1 -- 172.21.15.153:0/2078490242 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2738011580 con 0x7f2740159d90 2024-08-17T02:26:54.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.141+0000 7f2744ef2700 1 -- 172.21.15.153:0/2078490242 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2740140ee0 con 0x7f2740159d90 2024-08-17T02:26:54.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.141+0000 7f27367fc700 1 -- 172.21.15.153:0/2078490242 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2738011920 con 0x7f2740159d90 2024-08-17T02:26:54.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.141+0000 7f2744ef2700 1 -- 172.21.15.153:0/2078490242 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f274014ee50 con 0x7f2740159d90 2024-08-17T02:26:54.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.145+0000 7f2744ef2700 1 -- 172.21.15.153:0/2078490242 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2740167490 con 0x7f2740159d90 2024-08-17T02:26:54.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.145+0000 7f27367fc700 1 -- 172.21.15.153:0/2078490242 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2738011c90 con 0x7f2740159d90 2024-08-17T02:26:54.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.145+0000 7f27367fc700 1 --2- 172.21.15.153:0/2078490242 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2720060860 0x7f2720062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.145+0000 7f27367fc700 1 -- 172.21.15.153:0/2078490242 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f273807de60 con 0x7f2740159d90 2024-08-17T02:26:54.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.145+0000 7f273e59c700 1 --2- 172.21.15.153:0/2078490242 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2720060860 0x7f2720062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.145+0000 7f273e59c700 1 --2- 172.21.15.153:0/2078490242 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2720060860 0x7f2720062d10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2730009d10 tx=0x7f27300091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:54.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.153+0000 7f27367fc700 1 -- 172.21.15.153:0/2078490242 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f273804e600 con 0x7f2740159d90 2024-08-17T02:26:54.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.317+0000 7f2744ef2700 1 -- 172.21.15.153:0/2078490242 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f27400638f0 con 0x7f2740159d90 2024-08-17T02:26:54.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.473+0000 7f27367fc700 1 -- 172.21.15.153:0/2078490242 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2738051c20 con 0x7f2740159d90 2024-08-17T02:26:54.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.477+0000 7f2744ef2700 1 -- 172.21.15.153:0/2078490242 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2720060860 msgr2=0x7f2720062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.477+0000 7f2744ef2700 1 --2- 172.21.15.153:0/2078490242 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2720060860 0x7f2720062d10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2730009d10 tx=0x7f27300091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.477+0000 7f2744ef2700 1 -- 172.21.15.153:0/2078490242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2740159d90 msgr2=0x7f27401409a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.477+0000 7f2744ef2700 1 --2- 172.21.15.153:0/2078490242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2740159d90 0x7f27401409a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f274006d880 tx=0x7f2738017000 comp rx=0 tx=0).stop 2024-08-17T02:26:54.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.481+0000 7f2744ef2700 1 -- 172.21.15.153:0/2078490242 shutdown_connections 2024-08-17T02:26:54.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.481+0000 7f2744ef2700 1 --2- 172.21.15.153:0/2078490242 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2720060860 0x7f2720062d10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.481+0000 7f2744ef2700 1 --2- 172.21.15.153:0/2078490242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2740159d90 0x7f27401409a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.481+0000 7f2744ef2700 1 --2- 172.21.15.153:0/2078490242 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27401560d0 0x7f274014ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.481+0000 7f2744ef2700 1 --2- 172.21.15.153:0/2078490242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27400c99d0 0x7f274014e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.481+0000 7f2744ef2700 1 -- 172.21.15.153:0/2078490242 >> 172.21.15.153:0/2078490242 conn(0x7f274006e270 msgr2=0x7f27400afeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:54.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.481+0000 7f2744ef2700 1 -- 172.21.15.153:0/2078490242 shutdown_connections 2024-08-17T02:26:54.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.481+0000 7f2744ef2700 1 -- 172.21.15.153:0/2078490242 wait complete. 2024-08-17T02:26:54.487 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' created 2024-08-17T02:26:54.498 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:26:54.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.609+0000 7f8377120700 1 Processor -- start 2024-08-17T02:26:54.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.609+0000 7f8377120700 1 -- start start 2024-08-17T02:26:54.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.609+0000 7f8377120700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8370068650 0x7f8370068a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.609+0000 7f8377120700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83700cfd00 con 0x7f83701593b0 2024-08-17T02:26:54.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.609+0000 7f8377120700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83700cf460 con 0x7f83700ce880 2024-08-17T02:26:54.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.609+0000 7f8377120700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83700cf740 con 0x7f8370068650 2024-08-17T02:26:54.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.609+0000 7f83756bd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f83701593b0 0x7f83700b4070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50854/0 (socket says 172.21.15.153:50854) 2024-08-17T02:26:54.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.609+0000 7f8374ebc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8370068650 0x7f8370068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.609+0000 7f83756bd700 1 -- 172.21.15.153:0/818101858 learned_addr learned my addr 172.21.15.153:0/818101858 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:54.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.613+0000 7f836f7fe700 1 -- 172.21.15.153:0/818101858 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2680714775 0 0) 0x7f83700cfd00 con 0x7f83701593b0 2024-08-17T02:26:54.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.613+0000 7f836f7fe700 1 -- 172.21.15.153:0/818101858 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8358003570 con 0x7f83701593b0 2024-08-17T02:26:54.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.613+0000 7f836f7fe700 1 -- 172.21.15.153:0/818101858 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1966111761 0 0) 0x7f83700cf460 con 0x7f83700ce880 2024-08-17T02:26:54.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.613+0000 7f836f7fe700 1 -- 172.21.15.153:0/818101858 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83700cfd00 con 0x7f83700ce880 2024-08-17T02:26:54.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.613+0000 7f8374ebc700 1 -- 172.21.15.153:0/818101858 >> v1:172.21.15.174:6789/0 conn(0x7f83700ce880 legacy=0x7f8370158ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.613+0000 7f836f7fe700 1 -- 172.21.15.153:0/818101858 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3956853335 0 0) 0x7f8358003570 con 0x7f83701593b0 2024-08-17T02:26:54.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.613+0000 7f8374ebc700 1 -- 172.21.15.153:0/818101858 >> v1:172.21.15.153:6789/0 conn(0x7f83701593b0 legacy=0x7f83700b4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.613+0000 7f8374ebc700 1 -- 172.21.15.153:0/818101858 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83700cfa20 con 0x7f8370068650 2024-08-17T02:26:54.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.613+0000 7f8374ebc700 1 --2- 172.21.15.153:0/818101858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8370068650 0x7f8370068a20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f83640098e0 tx=0x7f83640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e721fa4b32ffc2c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:54.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.613+0000 7f836f7fe700 1 -- 172.21.15.153:0/818101858 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83680017f0 con 0x7f8370068650 2024-08-17T02:26:54.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.613+0000 7f836f7fe700 1 -- 172.21.15.153:0/818101858 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8364011420 con 0x7f8370068650 2024-08-17T02:26:54.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.613+0000 7f836f7fe700 1 -- 172.21.15.153:0/818101858 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83640117a0 con 0x7f8370068650 2024-08-17T02:26:54.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.613+0000 7f8377120700 1 -- 172.21.15.153:0/818101858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8370068650 msgr2=0x7f8370068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.613+0000 7f8377120700 1 --2- 172.21.15.153:0/818101858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8370068650 0x7f8370068a20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f83640098e0 tx=0x7f83640091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.613+0000 7f8377120700 1 -- 172.21.15.153:0/818101858 shutdown_connections 2024-08-17T02:26:54.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.613+0000 7f8377120700 1 --2- 172.21.15.153:0/818101858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8370068650 0x7f8370068a20 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.613+0000 7f8377120700 1 -- 172.21.15.153:0/818101858 >> 172.21.15.153:0/818101858 conn(0x7f8370066e00 msgr2=0x7f8370067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:54.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.613+0000 7f8377120700 1 -- 172.21.15.153:0/818101858 shutdown_connections 2024-08-17T02:26:54.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.613+0000 7f8377120700 1 -- 172.21.15.153:0/818101858 wait complete. 2024-08-17T02:26:54.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.617+0000 7f8377120700 1 Processor -- start 2024-08-17T02:26:54.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.617+0000 7f8377120700 1 -- start start 2024-08-17T02:26:54.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.617+0000 7f8377120700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8370068650 0x7f837013ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.617+0000 7f8377120700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83700ce880 0x7f837015bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.617+0000 7f8377120700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83701593b0 0x7f83700b1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.617+0000 7f8377120700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837015d1f0 con 0x7f83700ce880 2024-08-17T02:26:54.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.617+0000 7f8377120700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837015c5e0 con 0x7f8370068650 2024-08-17T02:26:54.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.617+0000 7f8377120700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f837015c8c0 con 0x7f83701593b0 2024-08-17T02:26:54.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.617+0000 7f836ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83700ce880 0x7f837015bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.617+0000 7f836ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83700ce880 0x7f837015bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59638/0 (socket says 172.21.15.153:59638) 2024-08-17T02:26:54.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.617+0000 7f836ffff700 1 -- 172.21.15.153:0/1595340427 learned_addr learned my addr 172.21.15.153:0/1595340427 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:54.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.617+0000 7f8374ebc700 1 --2- 172.21.15.153:0/1595340427 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8370068650 0x7f837013ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.617+0000 7f83756bd700 1 --2- 172.21.15.153:0/1595340427 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83701593b0 0x7f83700b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.617+0000 7f836ffff700 1 -- 172.21.15.153:0/1595340427 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83701593b0 msgr2=0x7f83700b1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.617+0000 7f836ffff700 1 --2- 172.21.15.153:0/1595340427 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83701593b0 0x7f83700b1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.617+0000 7f836ffff700 1 -- 172.21.15.153:0/1595340427 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8370068650 msgr2=0x7f837013ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.617+0000 7f836ffff700 1 --2- 172.21.15.153:0/1595340427 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8370068650 0x7f837013ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.617+0000 7f836ffff700 1 -- 172.21.15.153:0/1595340427 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8364009420 con 0x7f83700ce880 2024-08-17T02:26:54.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.617+0000 7f836ffff700 1 --2- 172.21.15.153:0/1595340427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83700ce880 0x7f837015bd00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f836000c790 tx=0x7f8360007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:54.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.617+0000 7f836cff9700 1 -- 172.21.15.153:0/1595340427 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8360010510 con 0x7f83700ce880 2024-08-17T02:26:54.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.617+0000 7f836cff9700 1 -- 172.21.15.153:0/1595340427 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8360010670 con 0x7f83700ce880 2024-08-17T02:26:54.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.617+0000 7f8377120700 1 -- 172.21.15.153:0/1595340427 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f837015cba0 con 0x7f83700ce880 2024-08-17T02:26:54.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.617+0000 7f836cff9700 1 -- 172.21.15.153:0/1595340427 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8360010a10 con 0x7f83700ce880 2024-08-17T02:26:54.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.617+0000 7f8377120700 1 -- 172.21.15.153:0/1595340427 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f837013f150 con 0x7f83700ce880 2024-08-17T02:26:54.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.621+0000 7f8377120700 1 -- 172.21.15.153:0/1595340427 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83700645c0 con 0x7f83700ce880 2024-08-17T02:26:54.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.621+0000 7f836cff9700 1 -- 172.21.15.153:0/1595340427 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f836001b3b0 con 0x7f83700ce880 2024-08-17T02:26:54.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.621+0000 7f836cff9700 1 --2- 172.21.15.153:0/1595340427 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f835c060860 0x7f835c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.621+0000 7f836cff9700 1 -- 172.21.15.153:0/1595340427 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f836007c230 con 0x7f83700ce880 2024-08-17T02:26:54.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.621+0000 7f8374ebc700 1 --2- 172.21.15.153:0/1595340427 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f835c060860 0x7f835c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.621+0000 7f8374ebc700 1 --2- 172.21.15.153:0/1595340427 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f835c060860 0x7f835c062d10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f83640093f0 tx=0x7f8364016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:54.633 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.629+0000 7f836cff9700 1 -- 172.21.15.153:0/1595340427 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f836004c860 con 0x7f83700ce880 2024-08-17T02:26:54.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:54.793+0000 7f8377120700 1 -- 172.21.15.153:0/1595340427 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f83700b3750 con 0x7f83700ce880 2024-08-17T02:26:55.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.485+0000 7f836cff9700 1 -- 172.21.15.153:0/1595340427 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) v1 ==== 170+0+0 (secure 0 0 0) 0x7f836004fe80 con 0x7f83700ce880 2024-08-17T02:26:55.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.501+0000 7f8377120700 1 -- 172.21.15.153:0/1595340427 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f835c060860 msgr2=0x7f835c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.501+0000 7f8377120700 1 --2- 172.21.15.153:0/1595340427 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f835c060860 0x7f835c062d10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f83640093f0 tx=0x7f8364016000 comp rx=0 tx=0).stop 2024-08-17T02:26:55.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.501+0000 7f8377120700 1 -- 172.21.15.153:0/1595340427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83700ce880 msgr2=0x7f837015bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.501+0000 7f8377120700 1 --2- 172.21.15.153:0/1595340427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83700ce880 0x7f837015bd00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f836000c790 tx=0x7f8360007e10 comp rx=0 tx=0).stop 2024-08-17T02:26:55.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.501+0000 7f8377120700 1 -- 172.21.15.153:0/1595340427 shutdown_connections 2024-08-17T02:26:55.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.501+0000 7f8377120700 1 --2- 172.21.15.153:0/1595340427 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f835c060860 0x7f835c062d10 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.501+0000 7f8377120700 1 --2- 172.21.15.153:0/1595340427 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83701593b0 0x7f83700b1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.501+0000 7f8377120700 1 --2- 172.21.15.153:0/1595340427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83700ce880 0x7f837015bd00 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.501+0000 7f8377120700 1 --2- 172.21.15.153:0/1595340427 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8370068650 0x7f837013ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.501+0000 7f8377120700 1 -- 172.21.15.153:0/1595340427 >> 172.21.15.153:0/1595340427 conn(0x7f8370066e00 msgr2=0x7f8370158000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:55.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.501+0000 7f8377120700 1 -- 172.21.15.153:0/1595340427 shutdown_connections 2024-08-17T02:26:55.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.501+0000 7f8377120700 1 -- 172.21.15.153:0/1595340427 wait complete. 2024-08-17T02:26:55.509 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' created 2024-08-17T02:26:55.521 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:26:55.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.625+0000 7f05dc188700 1 Processor -- start 2024-08-17T02:26:55.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.625+0000 7f05dc188700 1 -- start start 2024-08-17T02:26:55.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.625+0000 7f05dc188700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05d4159300 0x7f05d40b2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.625+0000 7f05dc188700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f05d41596d0 0x7f05d4066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.625+0000 7f05dc188700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f05d415dbc0 0x7f05d4067340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.625+0000 7f05dc188700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d40b2b60 con 0x7f05d41596d0 2024-08-17T02:26:55.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.625+0000 7f05dc188700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d40cba90 con 0x7f05d415dbc0 2024-08-17T02:26:55.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.625+0000 7f05dc188700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d40cb160 con 0x7f05d4159300 2024-08-17T02:26:55.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.625+0000 7f05d9723700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f05d41596d0 0x7f05d4066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.625+0000 7f05d9723700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f05d41596d0 0x7f05d4066e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59642/0 (socket says 172.21.15.153:59642) 2024-08-17T02:26:55.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.625+0000 7f05d9723700 1 -- 172.21.15.153:0/1697008025 learned_addr learned my addr 172.21.15.153:0/1697008025 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:55.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.625+0000 7f05da725700 1 --2- 172.21.15.153:0/1697008025 >> v2:172.21.15.174:3300/0 conn(0x7f05d415dbc0 0x7f05d4067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.625+0000 7f05d9f24700 1 --2- 172.21.15.153:0/1697008025 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05d4159300 0x7f05d40b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.629+0000 7f05d9723700 1 -- 172.21.15.153:0/1697008025 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05d4159300 msgr2=0x7f05d40b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:55.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.629+0000 7f05d9723700 1 --2- 172.21.15.153:0/1697008025 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05d4159300 0x7f05d40b2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.629+0000 7f05d9723700 1 -- 172.21.15.153:0/1697008025 >> v2:172.21.15.174:3300/0 conn(0x7f05d415dbc0 msgr2=0x7f05d4067340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:55.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.629+0000 7f05d9723700 1 --2- 172.21.15.153:0/1697008025 >> v2:172.21.15.174:3300/0 conn(0x7f05d415dbc0 0x7f05d4067340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.629+0000 7f05d9723700 1 -- 172.21.15.153:0/1697008025 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d40cb440 con 0x7f05d41596d0 2024-08-17T02:26:55.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.629+0000 7f05d9723700 1 --2- 172.21.15.153:0/1697008025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05d41596d0 0x7f05d4066e00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f05d40b2d70 tx=0x7f05c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a6cd40953f68401 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:55.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.629+0000 7f05d8f22700 1 -- 172.21.15.153:0/1697008025 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c800b640 con 0x7f05d41596d0 2024-08-17T02:26:55.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.629+0000 7f05d8f22700 1 -- 172.21.15.153:0/1697008025 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c800b7a0 con 0x7f05d41596d0 2024-08-17T02:26:55.633 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.629+0000 7f05d8f22700 1 -- 172.21.15.153:0/1697008025 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c800bb40 con 0x7f05d41596d0 2024-08-17T02:26:55.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.629+0000 7f05dc188700 1 -- 172.21.15.153:0/1697008025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05d41596d0 msgr2=0x7f05d4066e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.629+0000 7f05dc188700 1 --2- 172.21.15.153:0/1697008025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05d41596d0 0x7f05d4066e00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f05d40b2d70 tx=0x7f05c8009250 comp rx=0 tx=0).stop 2024-08-17T02:26:55.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.629+0000 7f05dc188700 1 -- 172.21.15.153:0/1697008025 shutdown_connections 2024-08-17T02:26:55.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.629+0000 7f05dc188700 1 --2- 172.21.15.153:0/1697008025 >> v2:172.21.15.174:3300/0 conn(0x7f05d415dbc0 0x7f05d4067340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.629+0000 7f05dc188700 1 --2- 172.21.15.153:0/1697008025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05d41596d0 0x7f05d4066e00 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.629+0000 7f05dc188700 1 --2- 172.21.15.153:0/1697008025 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05d4159300 0x7f05d40b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.629+0000 7f05dc188700 1 -- 172.21.15.153:0/1697008025 >> 172.21.15.153:0/1697008025 conn(0x7f05d40682c0 msgr2=0x7f05d40686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:55.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.629+0000 7f05dc188700 1 -- 172.21.15.153:0/1697008025 shutdown_connections 2024-08-17T02:26:55.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.629+0000 7f05dc188700 1 -- 172.21.15.153:0/1697008025 wait complete. 2024-08-17T02:26:55.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.629+0000 7f05dc188700 1 Processor -- start 2024-08-17T02:26:55.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.629+0000 7f05dc188700 1 -- start start 2024-08-17T02:26:55.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.629+0000 7f05dc188700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05d4159300 0x7f05d41562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.629+0000 7f05dc188700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05d41596d0 0x7f05d40b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.629+0000 7f05dc188700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05d415dbc0 0x7f05d40b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.629+0000 7f05dc188700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d4156830 con 0x7f05d415dbc0 2024-08-17T02:26:55.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.629+0000 7f05dc188700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d40c4bf0 con 0x7f05d41596d0 2024-08-17T02:26:55.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.629+0000 7f05dc188700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d40c4ed0 con 0x7f05d4159300 2024-08-17T02:26:55.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.633+0000 7f05da725700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05d415dbc0 0x7f05d40b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.633+0000 7f05d9723700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05d41596d0 0x7f05d40b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.633+0000 7f05da725700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05d415dbc0 0x7f05d40b4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59646/0 (socket says 172.21.15.153:59646) 2024-08-17T02:26:55.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.633+0000 7f05d9723700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05d41596d0 0x7f05d40b44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.153:55220/0 (socket says 172.21.15.153:55220) 2024-08-17T02:26:55.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.633+0000 7f05da725700 1 -- 172.21.15.153:0/2118431115 learned_addr learned my addr 172.21.15.153:0/2118431115 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:55.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.633+0000 7f05d9f24700 1 --2- 172.21.15.153:0/2118431115 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05d4159300 0x7f05d41562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.633+0000 7f05da725700 1 -- 172.21.15.153:0/2118431115 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05d4159300 msgr2=0x7f05d41562f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.633+0000 7f05da725700 1 --2- 172.21.15.153:0/2118431115 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05d4159300 0x7f05d41562f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.633+0000 7f05da725700 1 -- 172.21.15.153:0/2118431115 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05d41596d0 msgr2=0x7f05d40b44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.633+0000 7f05da725700 1 --2- 172.21.15.153:0/2118431115 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05d41596d0 0x7f05d40b44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.633+0000 7f05da725700 1 -- 172.21.15.153:0/2118431115 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c80094f0 con 0x7f05d415dbc0 2024-08-17T02:26:55.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.633+0000 7f05d9723700 1 --2- 172.21.15.153:0/2118431115 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05d41596d0 0x7f05d40b44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:55.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.633+0000 7f05da725700 1 --2- 172.21.15.153:0/2118431115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05d415dbc0 0x7f05d40b4a20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f05cc009e90 tx=0x7f05cc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:55.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.633+0000 7f05c5ffb700 1 -- 172.21.15.153:0/2118431115 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc00cb70 con 0x7f05d415dbc0 2024-08-17T02:26:55.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.633+0000 7f05c5ffb700 1 -- 172.21.15.153:0/2118431115 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05cc00f040 con 0x7f05d415dbc0 2024-08-17T02:26:55.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.633+0000 7f05dc188700 1 -- 172.21.15.153:0/2118431115 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d40c51b0 con 0x7f05d415dbc0 2024-08-17T02:26:55.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.633+0000 7f05c5ffb700 1 -- 172.21.15.153:0/2118431115 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc014480 con 0x7f05d415dbc0 2024-08-17T02:26:55.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.633+0000 7f05dc188700 1 -- 172.21.15.153:0/2118431115 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d40c5770 con 0x7f05d415dbc0 2024-08-17T02:26:55.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.633+0000 7f05dc188700 1 -- 172.21.15.153:0/2118431115 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05d40c5960 con 0x7f05d415dbc0 2024-08-17T02:26:55.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.637+0000 7f05c5ffb700 1 -- 172.21.15.153:0/2118431115 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f05cc014830 con 0x7f05d415dbc0 2024-08-17T02:26:55.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.637+0000 7f05c5ffb700 1 --2- 172.21.15.153:0/2118431115 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f05b8060860 0x7f05b8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.637+0000 7f05c5ffb700 1 -- 172.21.15.153:0/2118431115 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f05cc07d5b0 con 0x7f05d415dbc0 2024-08-17T02:26:55.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.637+0000 7f05d9f24700 1 --2- 172.21.15.153:0/2118431115 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f05b8060860 0x7f05b8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.637+0000 7f05d9f24700 1 --2- 172.21.15.153:0/2118431115 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f05b8060860 0x7f05b8062d10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f05d4070c70 tx=0x7f05d00091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:55.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.645+0000 7f05c5ffb700 1 -- 172.21.15.153:0/2118431115 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f05cc04d9c0 con 0x7f05d415dbc0 2024-08-17T02:26:55.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:55.845+0000 7f05dc188700 1 -- 172.21.15.153:0/2118431115 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f05d40645c0 con 0x7f05d415dbc0 2024-08-17T02:26:56.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.509+0000 7f05c5ffb700 1 -- 172.21.15.153:0/2118431115 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7f05cc050fe0 con 0x7f05d415dbc0 2024-08-17T02:26:56.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.521+0000 7f05dc188700 1 -- 172.21.15.153:0/2118431115 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f05b8060860 msgr2=0x7f05b8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.521+0000 7f05dc188700 1 --2- 172.21.15.153:0/2118431115 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f05b8060860 0x7f05b8062d10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f05d4070c70 tx=0x7f05d00091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.521+0000 7f05dc188700 1 -- 172.21.15.153:0/2118431115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05d415dbc0 msgr2=0x7f05d40b4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.521+0000 7f05dc188700 1 --2- 172.21.15.153:0/2118431115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05d415dbc0 0x7f05d40b4a20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f05cc009e90 tx=0x7f05cc00b040 comp rx=0 tx=0).stop 2024-08-17T02:26:56.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.521+0000 7f05dc188700 1 -- 172.21.15.153:0/2118431115 shutdown_connections 2024-08-17T02:26:56.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.521+0000 7f05dc188700 1 --2- 172.21.15.153:0/2118431115 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f05b8060860 0x7f05b8062d10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.521+0000 7f05dc188700 1 --2- 172.21.15.153:0/2118431115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05d415dbc0 0x7f05d40b4a20 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.521+0000 7f05dc188700 1 --2- 172.21.15.153:0/2118431115 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05d41596d0 0x7f05d40b44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.521+0000 7f05dc188700 1 --2- 172.21.15.153:0/2118431115 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05d4159300 0x7f05d41562f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.521+0000 7f05dc188700 1 -- 172.21.15.153:0/2118431115 >> 172.21.15.153:0/2118431115 conn(0x7f05d40682c0 msgr2=0x7f05d40ce150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:56.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.521+0000 7f05dc188700 1 -- 172.21.15.153:0/2118431115 shutdown_connections 2024-08-17T02:26:56.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.521+0000 7f05dc188700 1 -- 172.21.15.153:0/2118431115 wait complete. 2024-08-17T02:26:56.527 INFO:teuthology.orchestra.run.smithi153.stderr:new fs with metadata pool 4 and data pool 5 2024-08-17T02:26:56.536 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:56.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.633+0000 7fe60db76700 1 Processor -- start 2024-08-17T02:26:56.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.633+0000 7fe60db76700 1 -- start start 2024-08-17T02:26:56.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.637+0000 7fe60db76700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe608155d80 0x7fe6080aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.637+0000 7fe60db76700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe6080af420 0x7fe6080acb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.637+0000 7fe60db76700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe6080ad090 0x7fe6081599d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.637+0000 7fe60db76700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6080af850 con 0x7fe6080af420 2024-08-17T02:26:56.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.637+0000 7fe60db76700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6080ad8a0 con 0x7fe6080ad090 2024-08-17T02:26:56.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.637+0000 7fe60db76700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6080adb80 con 0x7fe608155d80 2024-08-17T02:26:56.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.637+0000 7fe607fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe6080af420 0x7fe6080acb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.637+0000 7fe60d375700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe6080ad090 0x7fe6081599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.637+0000 7fe607fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe6080af420 0x7fe6080acb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59652/0 (socket says 172.21.15.153:59652) 2024-08-17T02:26:56.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.637+0000 7fe60d375700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe6080ad090 0x7fe6081599d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.153:55226/0 (socket says 172.21.15.153:55226) 2024-08-17T02:26:56.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.637+0000 7fe607fff700 1 -- 172.21.15.153:0/776684412 learned_addr learned my addr 172.21.15.153:0/776684412 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:56.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.637+0000 7fe60cb74700 1 --2- 172.21.15.153:0/776684412 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe608155d80 0x7fe6080aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.637+0000 7fe607fff700 1 -- 172.21.15.153:0/776684412 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe608155d80 msgr2=0x7fe6080aeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:56.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.637+0000 7fe607fff700 1 --2- 172.21.15.153:0/776684412 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe608155d80 0x7fe6080aeee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.637+0000 7fe607fff700 1 -- 172.21.15.153:0/776684412 >> v2:172.21.15.174:3300/0 conn(0x7fe6080ad090 msgr2=0x7fe6081599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:56.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.637+0000 7fe607fff700 1 --2- 172.21.15.153:0/776684412 >> v2:172.21.15.174:3300/0 conn(0x7fe6080ad090 0x7fe6081599d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.637+0000 7fe607fff700 1 -- 172.21.15.153:0/776684412 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6080ade60 con 0x7fe6080af420 2024-08-17T02:26:56.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.637+0000 7fe60d375700 1 --2- 172.21.15.153:0/776684412 >> v2:172.21.15.174:3300/0 conn(0x7fe6080ad090 0x7fe6081599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:56.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.637+0000 7fe607fff700 1 --2- 172.21.15.153:0/776684412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6080af420 0x7fe6080acb50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe6080af9f0 tx=0x7fe5fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49d881c1a2fcd8c7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:56.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.637+0000 7fe6077fe700 1 -- 172.21.15.153:0/776684412 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc011630 con 0x7fe6080af420 2024-08-17T02:26:56.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.637+0000 7fe6077fe700 1 -- 172.21.15.153:0/776684412 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5fc011790 con 0x7fe6080af420 2024-08-17T02:26:56.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.637+0000 7fe6077fe700 1 -- 172.21.15.153:0/776684412 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc011b30 con 0x7fe6080af420 2024-08-17T02:26:56.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.637+0000 7fe60db76700 1 -- 172.21.15.153:0/776684412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6080af420 msgr2=0x7fe6080acb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.637+0000 7fe60db76700 1 --2- 172.21.15.153:0/776684412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6080af420 0x7fe6080acb50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe6080af9f0 tx=0x7fe5fc009250 comp rx=0 tx=0).stop 2024-08-17T02:26:56.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.637+0000 7fe60db76700 1 -- 172.21.15.153:0/776684412 shutdown_connections 2024-08-17T02:26:56.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.637+0000 7fe60db76700 1 --2- 172.21.15.153:0/776684412 >> v2:172.21.15.174:3300/0 conn(0x7fe6080ad090 0x7fe6081599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.637+0000 7fe60db76700 1 --2- 172.21.15.153:0/776684412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6080af420 0x7fe6080acb50 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.637+0000 7fe60db76700 1 --2- 172.21.15.153:0/776684412 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe608155d80 0x7fe6080aeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.637+0000 7fe60db76700 1 -- 172.21.15.153:0/776684412 >> 172.21.15.153:0/776684412 conn(0x7fe60806e070 msgr2=0x7fe6080b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:56.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.637+0000 7fe60db76700 1 -- 172.21.15.153:0/776684412 shutdown_connections 2024-08-17T02:26:56.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.637+0000 7fe60db76700 1 -- 172.21.15.153:0/776684412 wait complete. 2024-08-17T02:26:56.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.641+0000 7fe60db76700 1 Processor -- start 2024-08-17T02:26:56.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.641+0000 7fe60db76700 1 -- start start 2024-08-17T02:26:56.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.641+0000 7fe60db76700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe6080ad090 0x7fe6081548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.641+0000 7fe60db76700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe608155d80 0x7fe608144750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.641+0000 7fe60db76700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe60812c1c0 0x7fe608147140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.641+0000 7fe60db76700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe608146060 con 0x7fe608155d80 2024-08-17T02:26:56.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.641+0000 7fe60db76700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe608143c10 con 0x7fe6080ad090 2024-08-17T02:26:56.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.641+0000 7fe60db76700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe608145450 con 0x7fe60812c1c0 2024-08-17T02:26:56.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.641+0000 7fe607fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe608155d80 0x7fe608144750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.641+0000 7fe60cb74700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe6080ad090 0x7fe6081548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.641+0000 7fe607fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe608155d80 0x7fe608144750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59660/0 (socket says 172.21.15.153:59660) 2024-08-17T02:26:56.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.641+0000 7fe607fff700 1 -- 172.21.15.153:0/1850936102 learned_addr learned my addr 172.21.15.153:0/1850936102 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:56.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.641+0000 7fe60d375700 1 --2- 172.21.15.153:0/1850936102 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe60812c1c0 0x7fe608147140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.641+0000 7fe60cb74700 1 -- 172.21.15.153:0/1850936102 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe60812c1c0 msgr2=0x7fe608147140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.641+0000 7fe60cb74700 1 --2- 172.21.15.153:0/1850936102 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe60812c1c0 0x7fe608147140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.641+0000 7fe60cb74700 1 -- 172.21.15.153:0/1850936102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe608155d80 msgr2=0x7fe608144750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.641+0000 7fe60cb74700 1 --2- 172.21.15.153:0/1850936102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe608155d80 0x7fe608144750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.641+0000 7fe60cb74700 1 -- 172.21.15.153:0/1850936102 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f8009420 con 0x7fe6080ad090 2024-08-17T02:26:56.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.641+0000 7fe607fff700 1 --2- 172.21.15.153:0/1850936102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe608155d80 0x7fe608144750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:56.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.641+0000 7fe60cb74700 1 --2- 172.21.15.153:0/1850936102 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe6080ad090 0x7fe6081548d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe60000ed60 tx=0x7fe60000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:56.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.645+0000 7fe604ff9700 1 -- 172.21.15.153:0/1850936102 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60000eec0 con 0x7fe6080ad090 2024-08-17T02:26:56.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.645+0000 7fe604ff9700 1 -- 172.21.15.153:0/1850936102 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60000f040 con 0x7fe6080ad090 2024-08-17T02:26:56.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.645+0000 7fe60db76700 1 -- 172.21.15.153:0/1850936102 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5fc0094f0 con 0x7fe6080ad090 2024-08-17T02:26:56.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.645+0000 7fe604ff9700 1 -- 172.21.15.153:0/1850936102 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60000cd80 con 0x7fe6080ad090 2024-08-17T02:26:56.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.645+0000 7fe60db76700 1 -- 172.21.15.153:0/1850936102 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe608145a10 con 0x7fe6080ad090 2024-08-17T02:26:56.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.645+0000 7fe60db76700 1 -- 172.21.15.153:0/1850936102 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6080638f0 con 0x7fe6080ad090 2024-08-17T02:26:56.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.645+0000 7fe604ff9700 1 -- 172.21.15.153:0/1850936102 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe600014690 con 0x7fe6080ad090 2024-08-17T02:26:56.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.645+0000 7fe604ff9700 1 --2- 172.21.15.153:0/1850936102 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fe5f4060860 0x7fe5f4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.645+0000 7fe604ff9700 1 -- 172.21.15.153:0/1850936102 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe60007dc80 con 0x7fe6080ad090 2024-08-17T02:26:56.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.645+0000 7fe607fff700 1 --2- 172.21.15.153:0/1850936102 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fe5f4060860 0x7fe5f4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.649+0000 7fe607fff700 1 --2- 172.21.15.153:0/1850936102 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fe5f4060860 0x7fe5f4062d10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe608151520 tx=0x7fe5fc016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:56.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.653+0000 7fe604ff9700 1 -- 172.21.15.153:0/1850936102 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe60004e0f0 con 0x7fe6080ad090 2024-08-17T02:26:56.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.817+0000 7fe60db76700 1 -- 172.21.15.153:0/1850936102 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6080712a0 con 0x7fe6080ad090 2024-08-17T02:26:56.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.821+0000 7fe604ff9700 1 -- 172.21.15.153:0/1850936102 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15411 (secure 0 0 0) 0x7fe600051710 con 0x7fe6080ad090 2024-08-17T02:26:56.824 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:56.824 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":31,"fsid":"56d41c33-b929-456d-96be-2aac4ecd299d","created":"2024-08-17T02:25:47.756085+0000","modified":"2024-08-17T02:26:55.848519+0000","last_up_change":"2024-08-17T02:25:58.643690+0000","last_in_change":"2024-08-17T02:25:49.809186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:58.093273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:54.363196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:54.837150+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0736f8e6-818e-42e6-a0dc-8aaf813315d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":24234},{"type":"v1","addr":"172.21.15.153:6817","nonce":24234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":24234},{"type":"v1","addr":"172.21.15.153:6819","nonce":24234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":24234},{"type":"v1","addr":"172.21.15.153:6823","nonce":24234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":24234},{"type":"v1","addr":"172.21.15.153:6821","nonce":24234}]},"public_addr":"172.21.15.153:6817/24234","cluster_addr":"172.21.15.153:6819/24234","heartbeat_back_addr":"172.21.15.153:6823/24234","heartbeat_front_addr":"172.21.15.153:6821/24234","state":["exists","up"]},{"osd":1,"uuid":"011762e9-6c2d-441a-aa56-68474639d72f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":24232},{"type":"v1","addr":"172.21.15.153:6801","nonce":24232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":24232},{"type":"v1","addr":"172.21.15.153:6803","nonce":24232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":24232},{"type":"v1","addr":"172.21.15.153:6809","nonce":24232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":24232},{"type":"v1","addr":"172.21.15.153:6806","nonce":24232}]},"public_addr":"172.21.15.153:6801/24232","cluster_addr":"172.21.15.153:6803/24232","heartbeat_back_addr":"172.21.15.153:6809/24232","heartbeat_front_addr":"172.21.15.153:6806/24232","state":["exists","up"]},{"osd":2,"uuid":"b562cd97-aa12-455e-b46a-e720a2ec9d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":24235},{"type":"v1","addr":"172.21.15.153:6808","nonce":24235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":24235},{"type":"v1","addr":"172.21.15.153:6811","nonce":24235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":24235},{"type":"v1","addr":"172.21.15.153:6815","nonce":24235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":24235},{"type":"v1","addr":"172.21.15.153:6813","nonce":24235}]},"public_addr":"172.21.15.153:6808/24235","cluster_addr":"172.21.15.153:6811/24235","heartbeat_back_addr":"172.21.15.153:6815/24235","heartbeat_front_addr":"172.21.15.153:6813/24235","state":["exists","up"]},{"osd":3,"uuid":"222da52f-90c2-4132-a5d2-6f6cf83d4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":24236},{"type":"v1","addr":"172.21.15.153:6825","nonce":24236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":24236},{"type":"v1","addr":"172.21.15.153:6827","nonce":24236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":24236},{"type":"v1","addr":"172.21.15.153:6831","nonce":24236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":24236},{"type":"v1","addr":"172.21.15.153:6829","nonce":24236}]},"public_addr":"172.21.15.153:6825/24236","cluster_addr":"172.21.15.153:6827/24236","heartbeat_back_addr":"172.21.15.153:6831/24236","heartbeat_front_addr":"172.21.15.153:6829/24236","state":["exists","up"]},{"osd":4,"uuid":"a38a04cd-032b-4977-a260-1ef3567d0c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24456},{"type":"v1","addr":"172.21.15.174:6809","nonce":24456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24456},{"type":"v1","addr":"172.21.15.174:6811","nonce":24456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24456},{"type":"v1","addr":"172.21.15.174:6815","nonce":24456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24456},{"type":"v1","addr":"172.21.15.174:6813","nonce":24456}]},"public_addr":"172.21.15.174:6809/24456","cluster_addr":"172.21.15.174:6811/24456","heartbeat_back_addr":"172.21.15.174:6815/24456","heartbeat_front_addr":"172.21.15.174:6813/24456","state":["exists","up"]},{"osd":5,"uuid":"c7778084-e751-48da-87a1-ab8bbe85aa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24457},{"type":"v1","addr":"172.21.15.174:6825","nonce":24457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24457},{"type":"v1","addr":"172.21.15.174:6827","nonce":24457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24457},{"type":"v1","addr":"172.21.15.174:6831","nonce":24457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24457},{"type":"v1","addr":"172.21.15.174:6829","nonce":24457}]},"public_addr":"172.21.15.174:6825/24457","cluster_addr":"172.21.15.174:6827/24457","heartbeat_back_addr":"172.21.15.174:6831/24457","heartbeat_front_addr":"172.21.15.174:6829/24457","state":["exists","up"]},{"osd":6,"uuid":"2d8e0715-254f-442c-9625-50721d0bc858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24477},{"type":"v1","addr":"172.21.15.174:6801","nonce":24477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24477},{"type":"v1","addr":"172.21.15.174:6803","nonce":24477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24477},{"type":"v1","addr":"172.21.15.174:6807","nonce":24477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24477},{"type":"v1","addr":"172.21.15.174:6805","nonce":24477}]},"public_addr":"172.21.15.174:6801/24477","cluster_addr":"172.21.15.174:6803/24477","heartbeat_back_addr":"172.21.15.174:6807/24477","heartbeat_front_addr":"172.21.15.174:6805/24477","state":["exists","up"]},{"osd":7,"uuid":"dffda25a-4601-4ddb-9a27-b0be1cadde27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24455},{"type":"v1","addr":"172.21.15.174:6817","nonce":24455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24455},{"type":"v1","addr":"172.21.15.174:6819","nonce":24455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24455},{"type":"v1","addr":"172.21.15.174:6823","nonce":24455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24455},{"type":"v1","addr":"172.21.15.174:6821","nonce":24455}]},"public_addr":"172.21.15.174:6817/24455","cluster_addr":"172.21.15.174:6819/24455","heartbeat_back_addr":"172.21.15.174:6823/24455","heartbeat_front_addr":"172.21.15.174:6821/24455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.990117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.033862+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.748087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.112877+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.070448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.360961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.110940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.226377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:56.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.821+0000 7fe60db76700 1 -- 172.21.15.153:0/1850936102 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fe5f4060860 msgr2=0x7fe5f4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.821+0000 7fe60db76700 1 --2- 172.21.15.153:0/1850936102 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fe5f4060860 0x7fe5f4062d10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe608151520 tx=0x7fe5fc016000 comp rx=0 tx=0).stop 2024-08-17T02:26:56.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.825+0000 7fe60db76700 1 -- 172.21.15.153:0/1850936102 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe6080ad090 msgr2=0x7fe6081548d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.825+0000 7fe60db76700 1 --2- 172.21.15.153:0/1850936102 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe6080ad090 0x7fe6081548d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe60000ed60 tx=0x7fe60000b040 comp rx=0 tx=0).stop 2024-08-17T02:26:56.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.825+0000 7fe60db76700 1 -- 172.21.15.153:0/1850936102 shutdown_connections 2024-08-17T02:26:56.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.825+0000 7fe60db76700 1 --2- 172.21.15.153:0/1850936102 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fe5f4060860 0x7fe5f4062d10 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.825+0000 7fe60db76700 1 --2- 172.21.15.153:0/1850936102 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe60812c1c0 0x7fe608147140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.825+0000 7fe60db76700 1 --2- 172.21.15.153:0/1850936102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe608155d80 0x7fe608144750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.825+0000 7fe60db76700 1 --2- 172.21.15.153:0/1850936102 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe6080ad090 0x7fe6081548d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.825+0000 7fe60db76700 1 -- 172.21.15.153:0/1850936102 >> 172.21.15.153:0/1850936102 conn(0x7fe60806e070 msgr2=0x7fe6080b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:56.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.825+0000 7fe60db76700 1 -- 172.21.15.153:0/1850936102 shutdown_connections 2024-08-17T02:26:56.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.825+0000 7fe60db76700 1 -- 172.21.15.153:0/1850936102 wait complete. 2024-08-17T02:26:56.841 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:56.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.945+0000 7f802b0d2700 1 Processor -- start 2024-08-17T02:26:56.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.945+0000 7f802b0d2700 1 -- start start 2024-08-17T02:26:56.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.949+0000 7f802b0d2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f80240b14a0 0x7f80240cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.949+0000 7f802b0d2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80240cb390 0x7f8024160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.949+0000 7f802b0d2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80240cbaa0 con 0x7f8024154900 2024-08-17T02:26:56.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.949+0000 7f802b0d2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8024068790 con 0x7f80240b14a0 2024-08-17T02:26:56.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.949+0000 7f802b0d2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80241583f0 con 0x7f80240cb390 2024-08-17T02:26:56.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.949+0000 7f80298cf700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f80240b14a0 0x7f80240cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.949+0000 7f802a8d1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80240cb390 0x7f8024160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.949+0000 7f80298cf700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f80240b14a0 0x7f80240cae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.153:55256/0 (socket says 172.21.15.153:55256) 2024-08-17T02:26:56.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.949+0000 7f80298cf700 1 -- 172.21.15.153:0/4198126433 learned_addr learned my addr 172.21.15.153:0/4198126433 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:56.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.949+0000 7f802a0d0700 1 --1- 172.21.15.153:0/4198126433 >> v1:172.21.15.174:6789/0 conn(0x7f8024154900 0x7f80240b0d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.153:39402/0 (socket says 172.21.15.153:39402) 2024-08-17T02:26:56.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.949+0000 7f80298cf700 1 -- 172.21.15.153:0/4198126433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80240cb390 msgr2=0x7f8024160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:56.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.949+0000 7f80298cf700 1 --2- 172.21.15.153:0/4198126433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80240cb390 0x7f8024160ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.949+0000 7f80298cf700 1 -- 172.21.15.153:0/4198126433 >> v1:172.21.15.174:6789/0 conn(0x7f8024154900 legacy=0x7f80240b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.949+0000 7f80298cf700 1 -- 172.21.15.153:0/4198126433 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80240cb7d0 con 0x7f80240b14a0 2024-08-17T02:26:56.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.949+0000 7f802a8d1700 1 --2- 172.21.15.153:0/4198126433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80240cb390 0x7f8024160ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:56.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.949+0000 7f80298cf700 1 --2- 172.21.15.153:0/4198126433 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80240b14a0 0x7f80240cae50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f80240688d0 tx=0x7f8020009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a4460845529fcd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:56.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.949+0000 7f80290ce700 1 -- 172.21.15.153:0/4198126433 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802000e070 con 0x7f80240b14a0 2024-08-17T02:26:56.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.949+0000 7f80290ce700 1 -- 172.21.15.153:0/4198126433 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802000ba20 con 0x7f80240b14a0 2024-08-17T02:26:56.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.949+0000 7f80290ce700 1 -- 172.21.15.153:0/4198126433 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802000bde0 con 0x7f80240b14a0 2024-08-17T02:26:56.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.949+0000 7f802b0d2700 1 -- 172.21.15.153:0/4198126433 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80240b14a0 msgr2=0x7f80240cae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.949+0000 7f802b0d2700 1 --2- 172.21.15.153:0/4198126433 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80240b14a0 0x7f80240cae50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f80240688d0 tx=0x7f8020009840 comp rx=0 tx=0).stop 2024-08-17T02:26:56.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.949+0000 7f802b0d2700 1 -- 172.21.15.153:0/4198126433 shutdown_connections 2024-08-17T02:26:56.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.949+0000 7f802b0d2700 1 --2- 172.21.15.153:0/4198126433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80240cb390 0x7f8024160ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.949+0000 7f802b0d2700 1 --2- 172.21.15.153:0/4198126433 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80240b14a0 0x7f80240cae50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.949+0000 7f802b0d2700 1 -- 172.21.15.153:0/4198126433 >> 172.21.15.153:0/4198126433 conn(0x7f80240678d0 msgr2=0x7f8024067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:56.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.949+0000 7f802b0d2700 1 -- 172.21.15.153:0/4198126433 shutdown_connections 2024-08-17T02:26:56.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.949+0000 7f802b0d2700 1 -- 172.21.15.153:0/4198126433 wait complete. 2024-08-17T02:26:56.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.953+0000 7f802b0d2700 1 Processor -- start 2024-08-17T02:26:56.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.953+0000 7f802b0d2700 1 -- start start 2024-08-17T02:26:56.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.953+0000 7f802b0d2700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80240b14a0 0x7f80241501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.953+0000 7f802b0d2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80240cb390 0x7f80240aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.953+0000 7f802b0d2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8024154900 0x7f8024063230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.953+0000 7f802b0d2700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802416cbc0 con 0x7f8024154900 2024-08-17T02:26:56.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.953+0000 7f802b0d2700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802416cea0 con 0x7f80240b14a0 2024-08-17T02:26:56.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.953+0000 7f802b0d2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802416d180 con 0x7f80240cb390 2024-08-17T02:26:56.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.953+0000 7f802a8d1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8024154900 0x7f8024063230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.953+0000 7f802a8d1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8024154900 0x7f8024063230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59662/0 (socket says 172.21.15.153:59662) 2024-08-17T02:26:56.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.953+0000 7f802a8d1700 1 -- 172.21.15.153:0/3673897919 learned_addr learned my addr 172.21.15.153:0/3673897919 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:56.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.953+0000 7f802a0d0700 1 --2- 172.21.15.153:0/3673897919 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80240b14a0 0x7f80241501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.953+0000 7f80298cf700 1 --2- 172.21.15.153:0/3673897919 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80240cb390 0x7f80240aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.953+0000 7f802a8d1700 1 -- 172.21.15.153:0/3673897919 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80240cb390 msgr2=0x7f80240aa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.953+0000 7f802a8d1700 1 --2- 172.21.15.153:0/3673897919 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80240cb390 0x7f80240aa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.953+0000 7f802a8d1700 1 -- 172.21.15.153:0/3673897919 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80240b14a0 msgr2=0x7f80241501f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.953+0000 7f802a8d1700 1 --2- 172.21.15.153:0/3673897919 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80240b14a0 0x7f80241501f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.953+0000 7f802a8d1700 1 -- 172.21.15.153:0/3673897919 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f801c009420 con 0x7f8024154900 2024-08-17T02:26:56.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.953+0000 7f802a8d1700 1 --2- 172.21.15.153:0/3673897919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8024154900 0x7f8024063230 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f801c00ec80 tx=0x7f801c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:56.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.953+0000 7f801a7fc700 1 -- 172.21.15.153:0/3673897919 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c00c850 con 0x7f8024154900 2024-08-17T02:26:56.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.953+0000 7f801a7fc700 1 -- 172.21.15.153:0/3673897919 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801c00c9b0 con 0x7f8024154900 2024-08-17T02:26:56.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.953+0000 7f802b0d2700 1 -- 172.21.15.153:0/3673897919 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8020009ae0 con 0x7f8024154900 2024-08-17T02:26:56.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.953+0000 7f801a7fc700 1 -- 172.21.15.153:0/3673897919 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c00cd50 con 0x7f8024154900 2024-08-17T02:26:56.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.953+0000 7f802b0d2700 1 -- 172.21.15.153:0/3673897919 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80240aa930 con 0x7f8024154900 2024-08-17T02:26:56.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.957+0000 7f802b0d2700 1 -- 172.21.15.153:0/3673897919 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80240643a0 con 0x7f8024154900 2024-08-17T02:26:56.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.957+0000 7f801a7fc700 1 -- 172.21.15.153:0/3673897919 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f801c013680 con 0x7f8024154900 2024-08-17T02:26:56.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.957+0000 7f801a7fc700 1 --2- 172.21.15.153:0/3673897919 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8010060890 0x7f8010062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.957+0000 7f801a7fc700 1 -- 172.21.15.153:0/3673897919 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f801c07cb70 con 0x7f8024154900 2024-08-17T02:26:56.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.957+0000 7f802a0d0700 1 --2- 172.21.15.153:0/3673897919 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8010060890 0x7f8010062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.957+0000 7f802a0d0700 1 --2- 172.21.15.153:0/3673897919 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8010060890 0x7f8010062d40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8014004fd0 tx=0x7f8014007eb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:56.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:56.969+0000 7f801a7fc700 1 -- 172.21.15.153:0/3673897919 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f801c04cfc0 con 0x7f8024154900 2024-08-17T02:26:57.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.137+0000 7f802b0d2700 1 -- 172.21.15.153:0/3673897919 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f802406f5f0 con 0x7f8024154900 2024-08-17T02:26:57.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.137+0000 7f801a7fc700 1 -- 172.21.15.153:0/3673897919 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15411 (secure 0 0 0) 0x7f801c0505e0 con 0x7f8024154900 2024-08-17T02:26:57.141 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:57.142 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":31,"fsid":"56d41c33-b929-456d-96be-2aac4ecd299d","created":"2024-08-17T02:25:47.756085+0000","modified":"2024-08-17T02:26:55.848519+0000","last_up_change":"2024-08-17T02:25:58.643690+0000","last_in_change":"2024-08-17T02:25:49.809186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:58.093273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:54.363196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:54.837150+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0736f8e6-818e-42e6-a0dc-8aaf813315d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":24234},{"type":"v1","addr":"172.21.15.153:6817","nonce":24234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":24234},{"type":"v1","addr":"172.21.15.153:6819","nonce":24234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":24234},{"type":"v1","addr":"172.21.15.153:6823","nonce":24234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":24234},{"type":"v1","addr":"172.21.15.153:6821","nonce":24234}]},"public_addr":"172.21.15.153:6817/24234","cluster_addr":"172.21.15.153:6819/24234","heartbeat_back_addr":"172.21.15.153:6823/24234","heartbeat_front_addr":"172.21.15.153:6821/24234","state":["exists","up"]},{"osd":1,"uuid":"011762e9-6c2d-441a-aa56-68474639d72f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":24232},{"type":"v1","addr":"172.21.15.153:6801","nonce":24232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":24232},{"type":"v1","addr":"172.21.15.153:6803","nonce":24232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":24232},{"type":"v1","addr":"172.21.15.153:6809","nonce":24232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":24232},{"type":"v1","addr":"172.21.15.153:6806","nonce":24232}]},"public_addr":"172.21.15.153:6801/24232","cluster_addr":"172.21.15.153:6803/24232","heartbeat_back_addr":"172.21.15.153:6809/24232","heartbeat_front_addr":"172.21.15.153:6806/24232","state":["exists","up"]},{"osd":2,"uuid":"b562cd97-aa12-455e-b46a-e720a2ec9d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":24235},{"type":"v1","addr":"172.21.15.153:6808","nonce":24235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":24235},{"type":"v1","addr":"172.21.15.153:6811","nonce":24235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":24235},{"type":"v1","addr":"172.21.15.153:6815","nonce":24235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":24235},{"type":"v1","addr":"172.21.15.153:6813","nonce":24235}]},"public_addr":"172.21.15.153:6808/24235","cluster_addr":"172.21.15.153:6811/24235","heartbeat_back_addr":"172.21.15.153:6815/24235","heartbeat_front_addr":"172.21.15.153:6813/24235","state":["exists","up"]},{"osd":3,"uuid":"222da52f-90c2-4132-a5d2-6f6cf83d4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":24236},{"type":"v1","addr":"172.21.15.153:6825","nonce":24236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":24236},{"type":"v1","addr":"172.21.15.153:6827","nonce":24236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":24236},{"type":"v1","addr":"172.21.15.153:6831","nonce":24236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":24236},{"type":"v1","addr":"172.21.15.153:6829","nonce":24236}]},"public_addr":"172.21.15.153:6825/24236","cluster_addr":"172.21.15.153:6827/24236","heartbeat_back_addr":"172.21.15.153:6831/24236","heartbeat_front_addr":"172.21.15.153:6829/24236","state":["exists","up"]},{"osd":4,"uuid":"a38a04cd-032b-4977-a260-1ef3567d0c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24456},{"type":"v1","addr":"172.21.15.174:6809","nonce":24456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24456},{"type":"v1","addr":"172.21.15.174:6811","nonce":24456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24456},{"type":"v1","addr":"172.21.15.174:6815","nonce":24456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24456},{"type":"v1","addr":"172.21.15.174:6813","nonce":24456}]},"public_addr":"172.21.15.174:6809/24456","cluster_addr":"172.21.15.174:6811/24456","heartbeat_back_addr":"172.21.15.174:6815/24456","heartbeat_front_addr":"172.21.15.174:6813/24456","state":["exists","up"]},{"osd":5,"uuid":"c7778084-e751-48da-87a1-ab8bbe85aa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24457},{"type":"v1","addr":"172.21.15.174:6825","nonce":24457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24457},{"type":"v1","addr":"172.21.15.174:6827","nonce":24457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24457},{"type":"v1","addr":"172.21.15.174:6831","nonce":24457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24457},{"type":"v1","addr":"172.21.15.174:6829","nonce":24457}]},"public_addr":"172.21.15.174:6825/24457","cluster_addr":"172.21.15.174:6827/24457","heartbeat_back_addr":"172.21.15.174:6831/24457","heartbeat_front_addr":"172.21.15.174:6829/24457","state":["exists","up"]},{"osd":6,"uuid":"2d8e0715-254f-442c-9625-50721d0bc858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24477},{"type":"v1","addr":"172.21.15.174:6801","nonce":24477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24477},{"type":"v1","addr":"172.21.15.174:6803","nonce":24477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24477},{"type":"v1","addr":"172.21.15.174:6807","nonce":24477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24477},{"type":"v1","addr":"172.21.15.174:6805","nonce":24477}]},"public_addr":"172.21.15.174:6801/24477","cluster_addr":"172.21.15.174:6803/24477","heartbeat_back_addr":"172.21.15.174:6807/24477","heartbeat_front_addr":"172.21.15.174:6805/24477","state":["exists","up"]},{"osd":7,"uuid":"dffda25a-4601-4ddb-9a27-b0be1cadde27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24455},{"type":"v1","addr":"172.21.15.174:6817","nonce":24455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24455},{"type":"v1","addr":"172.21.15.174:6819","nonce":24455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24455},{"type":"v1","addr":"172.21.15.174:6823","nonce":24455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24455},{"type":"v1","addr":"172.21.15.174:6821","nonce":24455}]},"public_addr":"172.21.15.174:6817/24455","cluster_addr":"172.21.15.174:6819/24455","heartbeat_back_addr":"172.21.15.174:6823/24455","heartbeat_front_addr":"172.21.15.174:6821/24455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.990117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.033862+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.748087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.112877+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.070448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.360961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.110940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.226377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:57.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.141+0000 7f802b0d2700 1 -- 172.21.15.153:0/3673897919 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8010060890 msgr2=0x7f8010062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.141+0000 7f802b0d2700 1 --2- 172.21.15.153:0/3673897919 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8010060890 0x7f8010062d40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8014004fd0 tx=0x7f8014007eb0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.141+0000 7f802b0d2700 1 -- 172.21.15.153:0/3673897919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8024154900 msgr2=0x7f8024063230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.141+0000 7f802b0d2700 1 --2- 172.21.15.153:0/3673897919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8024154900 0x7f8024063230 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f801c00ec80 tx=0x7f801c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.141+0000 7f802b0d2700 1 -- 172.21.15.153:0/3673897919 shutdown_connections 2024-08-17T02:26:57.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.141+0000 7f802b0d2700 1 --2- 172.21.15.153:0/3673897919 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8010060890 0x7f8010062d40 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.141+0000 7f802b0d2700 1 --2- 172.21.15.153:0/3673897919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8024154900 0x7f8024063230 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.141+0000 7f802b0d2700 1 --2- 172.21.15.153:0/3673897919 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80240cb390 0x7f80240aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.141+0000 7f802b0d2700 1 --2- 172.21.15.153:0/3673897919 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80240b14a0 0x7f80241501f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.141+0000 7f802b0d2700 1 -- 172.21.15.153:0/3673897919 >> 172.21.15.153:0/3673897919 conn(0x7f80240678d0 msgr2=0x7f802406d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:57.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.141+0000 7f802b0d2700 1 -- 172.21.15.153:0/3673897919 shutdown_connections 2024-08-17T02:26:57.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.141+0000 7f802b0d2700 1 -- 172.21.15.153:0/3673897919 wait complete. 2024-08-17T02:26:57.156 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:26:57.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.265+0000 7fa147fff700 1 Processor -- start 2024-08-17T02:26:57.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.265+0000 7fa147fff700 1 -- start start 2024-08-17T02:26:57.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa147fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa14806ee10 0x7fa1480ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa147fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa1480aebe0 0x7fa1480b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa147fff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1480ad090 con 0x7fa148142940 2024-08-17T02:26:57.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa147fff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1480ad330 con 0x7fa1480aebe0 2024-08-17T02:26:57.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa147fff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1480ad610 con 0x7fa14806ee10 2024-08-17T02:26:57.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa146ffd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fa148142940 0x7fa14806e700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50868/0 (socket says 172.21.15.153:50868) 2024-08-17T02:26:57.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa146ffd700 1 -- 172.21.15.153:0/1288543589 learned_addr learned my addr 172.21.15.153:0/1288543589 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:57.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa1477fe700 1 --2- 172.21.15.153:0/1288543589 >> v2:172.21.15.174:3300/0 conn(0x7fa1480aebe0 0x7fa1480b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa1467fc700 1 --2- 172.21.15.153:0/1288543589 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa14806ee10 0x7fa1480ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa145ffb700 1 -- 172.21.15.153:0/1288543589 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4166805656 0 0) 0x7fa1480ad090 con 0x7fa148142940 2024-08-17T02:26:57.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa145ffb700 1 -- 172.21.15.153:0/1288543589 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa134003570 con 0x7fa148142940 2024-08-17T02:26:57.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa145ffb700 1 -- 172.21.15.153:0/1288543589 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2230002475 0 0) 0x7fa134003570 con 0x7fa148142940 2024-08-17T02:26:57.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa145ffb700 1 -- 172.21.15.153:0/1288543589 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa14806ee10 msgr2=0x7fa1480ae6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:57.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa145ffb700 1 --2- 172.21.15.153:0/1288543589 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa14806ee10 0x7fa1480ae6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa145ffb700 1 -- 172.21.15.153:0/1288543589 >> v2:172.21.15.174:3300/0 conn(0x7fa1480aebe0 msgr2=0x7fa1480b0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:57.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa145ffb700 1 --2- 172.21.15.153:0/1288543589 >> v2:172.21.15.174:3300/0 conn(0x7fa1480aebe0 0x7fa1480b0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa145ffb700 1 -- 172.21.15.153:0/1288543589 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1480ad8f0 con 0x7fa148142940 2024-08-17T02:26:57.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa145ffb700 1 -- 172.21.15.153:0/1288543589 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3701463666 0 0) 0x7fa130001470 con 0x7fa148142940 2024-08-17T02:26:57.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa145ffb700 1 -- 172.21.15.153:0/1288543589 >> v1:172.21.15.153:6789/0 conn(0x7fa148142940 legacy=0x7fa14806e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa145ffb700 1 --2- 172.21.15.153:0/1288543589 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa14806ee10 0x7fa134003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa145ffb700 1 --2- 172.21.15.153:0/1288543589 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa134003fe0 0x7fa134004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa145ffb700 1 --2- 172.21.15.153:0/1288543589 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa134004d50 0x7fa1340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa145ffb700 1 -- 172.21.15.153:0/1288543589 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1480ad330 con 0x7fa134004d50 2024-08-17T02:26:57.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa145ffb700 1 -- 172.21.15.153:0/1288543589 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1480ad610 con 0x7fa134003fe0 2024-08-17T02:26:57.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa145ffb700 1 -- 172.21.15.153:0/1288543589 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa13400ba90 con 0x7fa14806ee10 2024-08-17T02:26:57.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa1477fe700 1 --2- 172.21.15.153:0/1288543589 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa134004d50 0x7fa1340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa146ffd700 1 --2- 172.21.15.153:0/1288543589 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa14806ee10 0x7fa134003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa1467fc700 1 --2- 172.21.15.153:0/1288543589 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa134003fe0 0x7fa134004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa1477fe700 1 -- 172.21.15.153:0/1288543589 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa14806ee10 msgr2=0x7fa134003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:57.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa1477fe700 1 --2- 172.21.15.153:0/1288543589 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa14806ee10 0x7fa134003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa1477fe700 1 -- 172.21.15.153:0/1288543589 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa134003fe0 msgr2=0x7fa134004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:57.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa1477fe700 1 --2- 172.21.15.153:0/1288543589 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa134003fe0 0x7fa134004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa1477fe700 1 -- 172.21.15.153:0/1288543589 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa134003570 con 0x7fa134004d50 2024-08-17T02:26:57.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa1477fe700 1 --2- 172.21.15.153:0/1288543589 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa134004d50 0x7fa1340051c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa14000e210 tx=0x7fa14000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c452e4512ad4f3e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa145ffb700 1 -- 172.21.15.153:0/1288543589 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14000ea60 con 0x7fa134004d50 2024-08-17T02:26:57.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa145ffb700 1 -- 172.21.15.153:0/1288543589 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14000f040 con 0x7fa134004d50 2024-08-17T02:26:57.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa145ffb700 1 -- 172.21.15.153:0/1288543589 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14000ee10 con 0x7fa134004d50 2024-08-17T02:26:57.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa147fff700 1 -- 172.21.15.153:0/1288543589 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa134004d50 msgr2=0x7fa1340051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa147fff700 1 --2- 172.21.15.153:0/1288543589 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa134004d50 0x7fa1340051c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa14000e210 tx=0x7fa14000b040 comp rx=0 tx=0).stop 2024-08-17T02:26:57.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa1477fe700 1 -- 172.21.15.153:0/1288543589 reap_dead start 2024-08-17T02:26:57.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa147fff700 1 -- 172.21.15.153:0/1288543589 shutdown_connections 2024-08-17T02:26:57.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.269+0000 7fa147fff700 1 -- 172.21.15.153:0/1288543589 >> 172.21.15.153:0/1288543589 conn(0x7fa1480ca2c0 msgr2=0x7fa14806dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:57.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.273+0000 7fa147fff700 1 -- 172.21.15.153:0/1288543589 shutdown_connections 2024-08-17T02:26:57.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.273+0000 7fa147fff700 1 -- 172.21.15.153:0/1288543589 wait complete. 2024-08-17T02:26:57.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.273+0000 7fa147fff700 1 Processor -- start 2024-08-17T02:26:57.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.273+0000 7fa147fff700 1 -- start start 2024-08-17T02:26:57.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.273+0000 7fa147fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1481415a0 0x7fa148141970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.273+0000 7fa147fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa14816d410 0x7fa1480ab9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.273+0000 7fa147fff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa1480abee0 0x7fa1481691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.273+0000 7fa147fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1480c6f90 con 0x7fa1481415a0 2024-08-17T02:26:57.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.273+0000 7fa147fff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa14816a110 con 0x7fa1480abee0 2024-08-17T02:26:57.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.273+0000 7fa147fff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa14816cf80 con 0x7fa14816d410 2024-08-17T02:26:57.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.277+0000 7fa146ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1481415a0 0x7fa148141970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.277+0000 7fa146ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1481415a0 0x7fa148141970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59682/0 (socket says 172.21.15.153:59682) 2024-08-17T02:26:57.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.277+0000 7fa146ffd700 1 -- 172.21.15.153:0/2728845090 learned_addr learned my addr 172.21.15.153:0/2728845090 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:57.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.277+0000 7fa1477fe700 1 --2- 172.21.15.153:0/2728845090 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa1480abee0 0x7fa1481691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.277+0000 7fa1467fc700 1 --2- 172.21.15.153:0/2728845090 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa14816d410 0x7fa1480ab9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.277+0000 7fa146ffd700 1 -- 172.21.15.153:0/2728845090 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa14816d410 msgr2=0x7fa1480ab9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.277+0000 7fa146ffd700 1 --2- 172.21.15.153:0/2728845090 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa14816d410 0x7fa1480ab9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.277+0000 7fa146ffd700 1 -- 172.21.15.153:0/2728845090 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa1480abee0 msgr2=0x7fa1481691a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.277+0000 7fa146ffd700 1 --2- 172.21.15.153:0/2728845090 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa1480abee0 0x7fa1481691a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.277+0000 7fa146ffd700 1 -- 172.21.15.153:0/2728845090 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1480ac330 con 0x7fa1481415a0 2024-08-17T02:26:57.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.277+0000 7fa146ffd700 1 --2- 172.21.15.153:0/2728845090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1481415a0 0x7fa148141970 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa130004890 tx=0x7fa130001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.277+0000 7fa13effd700 1 -- 172.21.15.153:0/2728845090 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa130018030 con 0x7fa1481415a0 2024-08-17T02:26:57.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.277+0000 7fa13effd700 1 -- 172.21.15.153:0/2728845090 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa13000f6c0 con 0x7fa1481415a0 2024-08-17T02:26:57.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.277+0000 7fa147fff700 1 -- 172.21.15.153:0/2728845090 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa148169e30 con 0x7fa1481415a0 2024-08-17T02:26:57.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.277+0000 7fa13effd700 1 -- 172.21.15.153:0/2728845090 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13000fa80 con 0x7fa1481415a0 2024-08-17T02:26:57.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.277+0000 7fa147fff700 1 -- 172.21.15.153:0/2728845090 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa14816cc10 con 0x7fa1481415a0 2024-08-17T02:26:57.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.277+0000 7fa147fff700 1 -- 172.21.15.153:0/2728845090 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa14816c790 con 0x7fa1481415a0 2024-08-17T02:26:57.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.277+0000 7fa13effd700 1 -- 172.21.15.153:0/2728845090 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa13001b070 con 0x7fa1481415a0 2024-08-17T02:26:57.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.281+0000 7fa13effd700 1 --2- 172.21.15.153:0/2728845090 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fa128060860 0x7fa128062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.281+0000 7fa13effd700 1 -- 172.21.15.153:0/2728845090 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa130019070 con 0x7fa1481415a0 2024-08-17T02:26:57.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.281+0000 7fa1467fc700 1 --2- 172.21.15.153:0/2728845090 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fa128060860 0x7fa128062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.281+0000 7fa1467fc700 1 --2- 172.21.15.153:0/2728845090 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fa128060860 0x7fa128062d10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa1480c8dd0 tx=0x7fa1380091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.285+0000 7fa13effd700 1 -- 172.21.15.153:0/2728845090 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa14816c790 con 0x7fa1481415a0 2024-08-17T02:26:57.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:57.489+0000 7fa147fff700 1 -- 172.21.15.153:0/2728845090 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa14816c790 con 0x7fa1481415a0 2024-08-17T02:26:58.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.489+0000 7fa13effd700 1 -- 172.21.15.153:0/2728845090 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa14816c790 con 0x7fa1481415a0 2024-08-17T02:26:58.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.497+0000 7fa147fff700 1 -- 172.21.15.153:0/2728845090 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fa128060860 msgr2=0x7fa128062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.497+0000 7fa147fff700 1 --2- 172.21.15.153:0/2728845090 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fa128060860 0x7fa128062d10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa1480c8dd0 tx=0x7fa1380091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.497+0000 7fa147fff700 1 -- 172.21.15.153:0/2728845090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1481415a0 msgr2=0x7fa148141970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.497+0000 7fa147fff700 1 --2- 172.21.15.153:0/2728845090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1481415a0 0x7fa148141970 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa130004890 tx=0x7fa130001e90 comp rx=0 tx=0).stop 2024-08-17T02:26:58.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.497+0000 7fa147fff700 1 -- 172.21.15.153:0/2728845090 shutdown_connections 2024-08-17T02:26:58.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.497+0000 7fa147fff700 1 --2- 172.21.15.153:0/2728845090 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fa128060860 0x7fa128062d10 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.497+0000 7fa147fff700 1 --2- 172.21.15.153:0/2728845090 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa1480abee0 0x7fa1481691a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.497+0000 7fa147fff700 1 --2- 172.21.15.153:0/2728845090 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa14816d410 0x7fa1480ab9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.497+0000 7fa147fff700 1 --2- 172.21.15.153:0/2728845090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1481415a0 0x7fa148141970 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.497+0000 7fa147fff700 1 -- 172.21.15.153:0/2728845090 >> 172.21.15.153:0/2728845090 conn(0x7fa1480ca2c0 msgr2=0x7fa1480cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:58.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.497+0000 7fa147fff700 1 -- 172.21.15.153:0/2728845090 shutdown_connections 2024-08-17T02:26:58.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.497+0000 7fa147fff700 1 -- 172.21.15.153:0/2728845090 wait complete. 2024-08-17T02:26:58.516 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:26:58.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.629+0000 7f226f083700 1 Processor -- start 2024-08-17T02:26:58.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.629+0000 7f226f083700 1 -- start start 2024-08-17T02:26:58.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.629+0000 7f226f083700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f22681501e0 0x7f22680ab7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.629+0000 7f226f083700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22680abd30 0x7f22680686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.629+0000 7f226f083700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2268157160 con 0x7f22681505b0 2024-08-17T02:26:58.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.629+0000 7f226f083700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2268156550 con 0x7f22681501e0 2024-08-17T02:26:58.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.629+0000 7f226f083700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2268156830 con 0x7f22680abd30 2024-08-17T02:26:58.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.629+0000 7f226e882700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f22681505b0 0x7f22680ad2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50876/0 (socket says 172.21.15.153:50876) 2024-08-17T02:26:58.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.629+0000 7f226e882700 1 -- 172.21.15.153:0/3415785023 learned_addr learned my addr 172.21.15.153:0/3415785023 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:58.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.633+0000 7f226e081700 1 --2- 172.21.15.153:0/3415785023 >> v2:172.21.15.174:3300/0 conn(0x7f22681501e0 0x7f22680ab7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.633+0000 7f226d880700 1 --2- 172.21.15.153:0/3415785023 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22680abd30 0x7f22680686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.633+0000 7f226d07f700 1 -- 172.21.15.153:0/3415785023 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1389625447 0 0) 0x7f2268157160 con 0x7f22681505b0 2024-08-17T02:26:58.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.633+0000 7f226d07f700 1 -- 172.21.15.153:0/3415785023 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2254003570 con 0x7f22681505b0 2024-08-17T02:26:58.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.633+0000 7f226d07f700 1 -- 172.21.15.153:0/3415785023 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1287508027 0 0) 0x7f2254003570 con 0x7f22681505b0 2024-08-17T02:26:58.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.633+0000 7f226d07f700 1 -- 172.21.15.153:0/3415785023 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22680abd30 msgr2=0x7f22680686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:58.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.633+0000 7f226d07f700 1 --2- 172.21.15.153:0/3415785023 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22680abd30 0x7f22680686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.633+0000 7f226d07f700 1 -- 172.21.15.153:0/3415785023 >> v2:172.21.15.174:3300/0 conn(0x7f22681501e0 msgr2=0x7f22680ab7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:58.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.633+0000 7f226d07f700 1 --2- 172.21.15.153:0/3415785023 >> v2:172.21.15.174:3300/0 conn(0x7f22681501e0 0x7f22680ab7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.633+0000 7f226d07f700 1 -- 172.21.15.153:0/3415785023 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2268156b10 con 0x7f22681505b0 2024-08-17T02:26:58.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.633+0000 7f226d07f700 1 -- 172.21.15.153:0/3415785023 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3701463666 0 0) 0x7f22600017f0 con 0x7f22681505b0 2024-08-17T02:26:58.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.633+0000 7f226e081700 1 --2- 172.21.15.153:0/3415785023 >> v2:172.21.15.174:3300/0 conn(0x7f22681501e0 0x7f22680ab7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:58.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.633+0000 7f226d07f700 1 -- 172.21.15.153:0/3415785023 >> v1:172.21.15.153:6789/0 conn(0x7f22681505b0 legacy=0x7f22680ad2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.633+0000 7f226d07f700 1 --2- 172.21.15.153:0/3415785023 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22680abd30 0x7f2254003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.633+0000 7f226d07f700 1 --2- 172.21.15.153:0/3415785023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2254003fe0 0x7f2254004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.633+0000 7f226d07f700 1 --2- 172.21.15.153:0/3415785023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2254004d50 0x7f22540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.633+0000 7f226d07f700 1 -- 172.21.15.153:0/3415785023 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2268156550 con 0x7f2254004d50 2024-08-17T02:26:58.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.633+0000 7f226d07f700 1 -- 172.21.15.153:0/3415785023 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2268156830 con 0x7f2254003fe0 2024-08-17T02:26:58.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.633+0000 7f226d07f700 1 -- 172.21.15.153:0/3415785023 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225400ba90 con 0x7f22680abd30 2024-08-17T02:26:58.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.633+0000 7f226e882700 1 --2- 172.21.15.153:0/3415785023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2254004d50 0x7f22540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.633+0000 7f226d880700 1 --2- 172.21.15.153:0/3415785023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2254003fe0 0x7f2254004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.633+0000 7f226e081700 1 --2- 172.21.15.153:0/3415785023 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22680abd30 0x7f2254003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.633+0000 7f226e882700 1 -- 172.21.15.153:0/3415785023 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22680abd30 msgr2=0x7f2254003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:58.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.633+0000 7f226e882700 1 --2- 172.21.15.153:0/3415785023 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22680abd30 0x7f2254003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.633+0000 7f226e882700 1 -- 172.21.15.153:0/3415785023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2254003fe0 msgr2=0x7f2254004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:58.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.633+0000 7f226e882700 1 --2- 172.21.15.153:0/3415785023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2254003fe0 0x7f2254004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.633+0000 7f226e882700 1 -- 172.21.15.153:0/3415785023 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2254003570 con 0x7f2254004d50 2024-08-17T02:26:58.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.633+0000 7f226e882700 1 --2- 172.21.15.153:0/3415785023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2254004d50 0x7f22540051c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f226000cc10 tx=0x7f2260002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91c633c20fc99d26 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:58.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.633+0000 7f226d07f700 1 -- 172.21.15.153:0/3415785023 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226000e850 con 0x7f2254004d50 2024-08-17T02:26:58.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.633+0000 7f226d07f700 1 -- 172.21.15.153:0/3415785023 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f226000e9b0 con 0x7f2254004d50 2024-08-17T02:26:58.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.633+0000 7f226d07f700 1 -- 172.21.15.153:0/3415785023 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226000ed70 con 0x7f2254004d50 2024-08-17T02:26:58.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.633+0000 7f226f083700 1 -- 172.21.15.153:0/3415785023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2254004d50 msgr2=0x7f22540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.633+0000 7f226f083700 1 --2- 172.21.15.153:0/3415785023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2254004d50 0x7f22540051c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f226000cc10 tx=0x7f2260002210 comp rx=0 tx=0).stop 2024-08-17T02:26:58.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.633+0000 7f226e882700 1 -- 172.21.15.153:0/3415785023 reap_dead start 2024-08-17T02:26:58.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.633+0000 7f226f083700 1 -- 172.21.15.153:0/3415785023 shutdown_connections 2024-08-17T02:26:58.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.633+0000 7f226f083700 1 -- 172.21.15.153:0/3415785023 >> 172.21.15.153:0/3415785023 conn(0x7f226806e310 msgr2=0x7f226806b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:58.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.633+0000 7f226f083700 1 -- 172.21.15.153:0/3415785023 shutdown_connections 2024-08-17T02:26:58.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.633+0000 7f226f083700 1 -- 172.21.15.153:0/3415785023 wait complete. 2024-08-17T02:26:58.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.637+0000 7f226f083700 1 Processor -- start 2024-08-17T02:26:58.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.637+0000 7f226f083700 1 -- start start 2024-08-17T02:26:58.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.637+0000 7f226f083700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2254004d50 0x7f226815af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.637+0000 7f226f083700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22681529d0 0x7f226813ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.637+0000 7f226f083700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2268164ae0 0x7f2268068530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.637+0000 7f226f083700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2268157570 con 0x7f22681529d0 2024-08-17T02:26:58.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.637+0000 7f226f083700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2268152f90 con 0x7f2254004d50 2024-08-17T02:26:58.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.637+0000 7f226f083700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2268153270 con 0x7f2268164ae0 2024-08-17T02:26:58.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.637+0000 7f226d880700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22681529d0 0x7f226813ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.637+0000 7f226d880700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22681529d0 0x7f226813ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59708/0 (socket says 172.21.15.153:59708) 2024-08-17T02:26:58.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.637+0000 7f226d880700 1 -- 172.21.15.153:0/1687106367 learned_addr learned my addr 172.21.15.153:0/1687106367 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:58.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.637+0000 7f226e081700 1 --2- 172.21.15.153:0/1687106367 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2254004d50 0x7f226815af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.637+0000 7f226e882700 1 --2- 172.21.15.153:0/1687106367 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2268164ae0 0x7f2268068530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.637+0000 7f226d880700 1 -- 172.21.15.153:0/1687106367 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2268164ae0 msgr2=0x7f2268068530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.637+0000 7f226d880700 1 --2- 172.21.15.153:0/1687106367 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2268164ae0 0x7f2268068530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.637+0000 7f226d880700 1 -- 172.21.15.153:0/1687106367 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2254004d50 msgr2=0x7f226815af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.637+0000 7f226d880700 1 --2- 172.21.15.153:0/1687106367 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2254004d50 0x7f226815af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.637+0000 7f226d880700 1 -- 172.21.15.153:0/1687106367 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2268153550 con 0x7f22681529d0 2024-08-17T02:26:58.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.637+0000 7f226d880700 1 --2- 172.21.15.153:0/1687106367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22681529d0 0x7f226813ef30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2258011b40 tx=0x7f22580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:58.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.637+0000 7f225e7fc700 1 -- 172.21.15.153:0/1687106367 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225800f940 con 0x7f22681529d0 2024-08-17T02:26:58.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.641+0000 7f225e7fc700 1 -- 172.21.15.153:0/1687106367 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225800faa0 con 0x7f22681529d0 2024-08-17T02:26:58.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.641+0000 7f226f083700 1 -- 172.21.15.153:0/1687106367 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f226815b470 con 0x7f22681529d0 2024-08-17T02:26:58.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.641+0000 7f225e7fc700 1 -- 172.21.15.153:0/1687106367 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225800fe60 con 0x7f22681529d0 2024-08-17T02:26:58.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.641+0000 7f226f083700 1 -- 172.21.15.153:0/1687106367 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f226813f470 con 0x7f22681529d0 2024-08-17T02:26:58.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.641+0000 7f226f083700 1 -- 172.21.15.153:0/1687106367 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22680638f0 con 0x7f22681529d0 2024-08-17T02:26:58.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.641+0000 7f225e7fc700 1 -- 172.21.15.153:0/1687106367 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2258014650 con 0x7f22681529d0 2024-08-17T02:26:58.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.641+0000 7f225e7fc700 1 --2- 172.21.15.153:0/1687106367 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f224c060860 0x7f224c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.641+0000 7f225e7fc700 1 -- 172.21.15.153:0/1687106367 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2258018030 con 0x7f22681529d0 2024-08-17T02:26:58.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.641+0000 7f226e081700 1 --2- 172.21.15.153:0/1687106367 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f224c060860 0x7f224c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.645+0000 7f226e081700 1 --2- 172.21.15.153:0/1687106367 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f224c060860 0x7f224c062d10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2268167ff0 tx=0x7f22640091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:58.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.649+0000 7f225e7fc700 1 -- 172.21.15.153:0/1687106367 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f225804d9b0 con 0x7f22681529d0 2024-08-17T02:26:58.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:58.849+0000 7f226f083700 1 -- 172.21.15.153:0/1687106367 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f22680ae7b0 con 0x7f22681529d0 2024-08-17T02:26:59.329 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:59.331 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:59.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.513+0000 7f225e7fc700 1 -- 172.21.15.153:0/1687106367 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2258050fd0 con 0x7f22681529d0 2024-08-17T02:26:59.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.517+0000 7f226f083700 1 -- 172.21.15.153:0/1687106367 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f224c060860 msgr2=0x7f224c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.517+0000 7f226f083700 1 --2- 172.21.15.153:0/1687106367 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f224c060860 0x7f224c062d10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2268167ff0 tx=0x7f22640091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.517+0000 7f226f083700 1 -- 172.21.15.153:0/1687106367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22681529d0 msgr2=0x7f226813ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.517+0000 7f226f083700 1 --2- 172.21.15.153:0/1687106367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22681529d0 0x7f226813ef30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2258011b40 tx=0x7f22580091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.517+0000 7f226f083700 1 -- 172.21.15.153:0/1687106367 shutdown_connections 2024-08-17T02:26:59.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.517+0000 7f226f083700 1 --2- 172.21.15.153:0/1687106367 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f224c060860 0x7f224c062d10 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.517+0000 7f226f083700 1 --2- 172.21.15.153:0/1687106367 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2268164ae0 0x7f2268068530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.517+0000 7f226f083700 1 --2- 172.21.15.153:0/1687106367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22681529d0 0x7f226813ef30 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.517+0000 7f226f083700 1 --2- 172.21.15.153:0/1687106367 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2254004d50 0x7f226815af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.517+0000 7f226f083700 1 -- 172.21.15.153:0/1687106367 >> 172.21.15.153:0/1687106367 conn(0x7f226806e310 msgr2=0x7f2268153ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:59.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.517+0000 7f226f083700 1 -- 172.21.15.153:0/1687106367 shutdown_connections 2024-08-17T02:26:59.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.517+0000 7f226f083700 1 -- 172.21.15.153:0/1687106367 wait complete. 2024-08-17T02:26:59.541 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:59.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.653+0000 7fdc12cbe700 1 Processor -- start 2024-08-17T02:26:59.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.653+0000 7fdc12cbe700 1 -- start start 2024-08-17T02:26:59.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.653+0000 7fdc12cbe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdc0c068ca0 0x7fdc0c0cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.653+0000 7fdc12cbe700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc0c0c7750 con 0x7fdc0c06a470 2024-08-17T02:26:59.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.653+0000 7fdc12cbe700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc0c0c6e20 con 0x7fdc0c0688d0 2024-08-17T02:26:59.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.653+0000 7fdc12cbe700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc0c0cb220 con 0x7fdc0c068ca0 2024-08-17T02:26:59.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.653+0000 7fdc10a5a700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fdc0c0688d0 0x7fdc0c0caa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.153:39408/0 (socket says 172.21.15.153:39408) 2024-08-17T02:26:59.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.653+0000 7fdc1125b700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fdc0c06a470 0x7fdc0c0c7be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50886/0 (socket says 172.21.15.153:50886) 2024-08-17T02:26:59.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.653+0000 7fdc0bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdc0c068ca0 0x7fdc0c0cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.653+0000 7fdc10a5a700 1 -- 172.21.15.153:0/1364611878 learned_addr learned my addr 172.21.15.153:0/1364611878 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:26:59.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.657+0000 7fdc0b7fe700 1 -- 172.21.15.153:0/1364611878 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2486595021 0 0) 0x7fdc0c0c7750 con 0x7fdc0c06a470 2024-08-17T02:26:59.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.657+0000 7fdc0b7fe700 1 -- 172.21.15.153:0/1364611878 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbfc003570 con 0x7fdc0c06a470 2024-08-17T02:26:59.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.657+0000 7fdc0b7fe700 1 -- 172.21.15.153:0/1364611878 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1730011811 0 0) 0x7fdc0c0c6e20 con 0x7fdc0c0688d0 2024-08-17T02:26:59.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.657+0000 7fdc0b7fe700 1 -- 172.21.15.153:0/1364611878 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc0c0c7750 con 0x7fdc0c0688d0 2024-08-17T02:26:59.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.657+0000 7fdc0bfff700 1 -- 172.21.15.153:0/1364611878 >> v1:172.21.15.174:6789/0 conn(0x7fdc0c0688d0 legacy=0x7fdc0c0caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.657+0000 7fdc0bfff700 1 -- 172.21.15.153:0/1364611878 >> v1:172.21.15.153:6789/0 conn(0x7fdc0c06a470 legacy=0x7fdc0c0c7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.657+0000 7fdc0bfff700 1 -- 172.21.15.153:0/1364611878 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc0c0c7100 con 0x7fdc0c068ca0 2024-08-17T02:26:59.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.657+0000 7fdc0bfff700 1 --2- 172.21.15.153:0/1364611878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc0c068ca0 0x7fdc0c0cc160 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fdbf800a9f0 tx=0x7fdbf800a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a069fc549ac4dfa9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.657+0000 7fdc0b7fe700 1 -- 172.21.15.153:0/1364611878 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf800c6b0 con 0x7fdc0c068ca0 2024-08-17T02:26:59.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.657+0000 7fdc0b7fe700 1 -- 172.21.15.153:0/1364611878 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf800c810 con 0x7fdc0c068ca0 2024-08-17T02:26:59.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.657+0000 7fdc0b7fe700 1 -- 172.21.15.153:0/1364611878 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf800cbd0 con 0x7fdc0c068ca0 2024-08-17T02:26:59.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.657+0000 7fdc12cbe700 1 -- 172.21.15.153:0/1364611878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc0c068ca0 msgr2=0x7fdc0c0cc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.657+0000 7fdc12cbe700 1 --2- 172.21.15.153:0/1364611878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc0c068ca0 0x7fdc0c0cc160 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fdbf800a9f0 tx=0x7fdbf800a290 comp rx=0 tx=0).stop 2024-08-17T02:26:59.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.657+0000 7fdc12cbe700 1 -- 172.21.15.153:0/1364611878 shutdown_connections 2024-08-17T02:26:59.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.657+0000 7fdc12cbe700 1 --2- 172.21.15.153:0/1364611878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc0c068ca0 0x7fdc0c0cc160 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.657+0000 7fdc12cbe700 1 -- 172.21.15.153:0/1364611878 >> 172.21.15.153:0/1364611878 conn(0x7fdc0c0c9c20 msgr2=0x7fdc0c06d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:59.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.657+0000 7fdc12cbe700 1 -- 172.21.15.153:0/1364611878 shutdown_connections 2024-08-17T02:26:59.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.657+0000 7fdc12cbe700 1 -- 172.21.15.153:0/1364611878 wait complete. 2024-08-17T02:26:59.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.661+0000 7fdc12cbe700 1 Processor -- start 2024-08-17T02:26:59.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.661+0000 7fdc12cbe700 1 -- start start 2024-08-17T02:26:59.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.661+0000 7fdc12cbe700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc0c0688d0 0x7fdc0c142bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.661+0000 7fdc12cbe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc0c068ca0 0x7fdc0c15d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.661+0000 7fdc12cbe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc0c06a470 0x7fdc0c1576b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.661+0000 7fdc12cbe700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c0acb30 con 0x7fdc0c06a470 2024-08-17T02:26:59.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.661+0000 7fdc12cbe700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c0abf20 con 0x7fdc0c0688d0 2024-08-17T02:26:59.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.661+0000 7fdc12cbe700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c0ac200 con 0x7fdc0c068ca0 2024-08-17T02:26:59.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.661+0000 7fdc1125b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc0c06a470 0x7fdc0c1576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.661+0000 7fdc10a5a700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc0c0688d0 0x7fdc0c142bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.661+0000 7fdc10a5a700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc0c0688d0 0x7fdc0c142bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.153:55320/0 (socket says 172.21.15.153:55320) 2024-08-17T02:26:59.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.661+0000 7fdc10a5a700 1 -- 172.21.15.153:0/935660411 learned_addr learned my addr 172.21.15.153:0/935660411 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:26:59.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.661+0000 7fdc1125b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc0c06a470 0x7fdc0c1576b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59728/0 (socket says 172.21.15.153:59728) 2024-08-17T02:26:59.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.661+0000 7fdc0bfff700 1 --2- 172.21.15.153:0/935660411 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc0c068ca0 0x7fdc0c15d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.661+0000 7fdc1125b700 1 -- 172.21.15.153:0/935660411 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc0c068ca0 msgr2=0x7fdc0c15d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.661+0000 7fdc1125b700 1 --2- 172.21.15.153:0/935660411 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc0c068ca0 0x7fdc0c15d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.661+0000 7fdc1125b700 1 -- 172.21.15.153:0/935660411 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc0c0688d0 msgr2=0x7fdc0c142bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.661+0000 7fdc1125b700 1 --2- 172.21.15.153:0/935660411 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc0c0688d0 0x7fdc0c142bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.661+0000 7fdc1125b700 1 -- 172.21.15.153:0/935660411 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf800a530 con 0x7fdc0c06a470 2024-08-17T02:26:59.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.661+0000 7fdc1125b700 1 --2- 172.21.15.153:0/935660411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc0c06a470 0x7fdc0c1576b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdc0400cbc0 tx=0x7fdc040019a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.661+0000 7fdc08ff9700 1 -- 172.21.15.153:0/935660411 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc04005df0 con 0x7fdc0c06a470 2024-08-17T02:26:59.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.661+0000 7fdc08ff9700 1 -- 172.21.15.153:0/935660411 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0400a5d0 con 0x7fdc0c06a470 2024-08-17T02:26:59.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.661+0000 7fdc12cbe700 1 -- 172.21.15.153:0/935660411 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc0c0ac4e0 con 0x7fdc0c06a470 2024-08-17T02:26:59.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.661+0000 7fdc08ff9700 1 -- 172.21.15.153:0/935660411 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0400a950 con 0x7fdc0c06a470 2024-08-17T02:26:59.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.661+0000 7fdc12cbe700 1 -- 172.21.15.153:0/935660411 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc0c143100 con 0x7fdc0c06a470 2024-08-17T02:26:59.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.665+0000 7fdc12cbe700 1 -- 172.21.15.153:0/935660411 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc0c0acca0 con 0x7fdc0c06a470 2024-08-17T02:26:59.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.665+0000 7fdc08ff9700 1 -- 172.21.15.153:0/935660411 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fdc040070f0 con 0x7fdc0c06a470 2024-08-17T02:26:59.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.665+0000 7fdc08ff9700 1 --2- 172.21.15.153:0/935660411 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fdbf0060860 0x7fdbf0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.665+0000 7fdc08ff9700 1 -- 172.21.15.153:0/935660411 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdc0407cae0 con 0x7fdc0c06a470 2024-08-17T02:26:59.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.665+0000 7fdc10a5a700 1 --2- 172.21.15.153:0/935660411 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fdbf0060860 0x7fdbf0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.665+0000 7fdc10a5a700 1 --2- 172.21.15.153:0/935660411 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fdbf0060860 0x7fdbf0062d10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c0af280 tx=0x7fdc00009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.673+0000 7fdc08ff9700 1 -- 172.21.15.153:0/935660411 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fdc0404cfb0 con 0x7fdc0c06a470 2024-08-17T02:26:59.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.881+0000 7fdc12cbe700 1 -- 172.21.15.153:0/935660411 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc0c0645c0 con 0x7fdc0c06a470 2024-08-17T02:26:59.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.881+0000 7fdc08ff9700 1 -- 172.21.15.153:0/935660411 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4605 (secure 0 0 0) 0x7fdc040505d0 con 0x7fdc0c06a470 2024-08-17T02:26:59.885 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:26:59.885 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4885,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/747297575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":747297575},{"type":"v1","addr":"172.21.15.174:6833","nonce":747297575}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4891,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1080524090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1080524090},{"type":"v1","addr":"172.21.15.174:6835","nonce":1080524090}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5013,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2569513399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2569513399},{"type":"v1","addr":"172.21.15.153:6835","nonce":2569513399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:55.849257+0000","modified":"2024-08-17T02:26:59.510699+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5031},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5031":{"gid":5031,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6837/2567193475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":2567193475},{"type":"v1","addr":"172.21.15.153:6837","nonce":2567193475}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:26:59.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.885+0000 7fdc12cbe700 1 -- 172.21.15.153:0/935660411 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fdbf0060860 msgr2=0x7fdbf0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.885+0000 7fdc12cbe700 1 --2- 172.21.15.153:0/935660411 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fdbf0060860 0x7fdbf0062d10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c0af280 tx=0x7fdc00009040 comp rx=0 tx=0).stop 2024-08-17T02:26:59.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.885+0000 7fdc12cbe700 1 -- 172.21.15.153:0/935660411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc0c06a470 msgr2=0x7fdc0c1576b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.885+0000 7fdc12cbe700 1 --2- 172.21.15.153:0/935660411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc0c06a470 0x7fdc0c1576b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdc0400cbc0 tx=0x7fdc040019a0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.885+0000 7fdc12cbe700 1 -- 172.21.15.153:0/935660411 shutdown_connections 2024-08-17T02:26:59.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.885+0000 7fdc12cbe700 1 --2- 172.21.15.153:0/935660411 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fdbf0060860 0x7fdbf0062d10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.885+0000 7fdc12cbe700 1 --2- 172.21.15.153:0/935660411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc0c06a470 0x7fdc0c1576b0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.885+0000 7fdc12cbe700 1 --2- 172.21.15.153:0/935660411 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc0c068ca0 0x7fdc0c15d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.885+0000 7fdc12cbe700 1 --2- 172.21.15.153:0/935660411 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc0c0688d0 0x7fdc0c142bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.885+0000 7fdc12cbe700 1 -- 172.21.15.153:0/935660411 >> 172.21.15.153:0/935660411 conn(0x7fdc0c0c9c20 msgr2=0x7fdc0c06a870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:59.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.885+0000 7fdc12cbe700 1 -- 172.21.15.153:0/935660411 shutdown_connections 2024-08-17T02:26:59.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:26:59.885+0000 7fdc12cbe700 1 -- 172.21.15.153:0/935660411 wait complete. 2024-08-17T02:26:59.889 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 14 2024-08-17T02:26:59.899 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:00.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.001+0000 7f7024fba700 1 Processor -- start 2024-08-17T02:27:00.006 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.001+0000 7f7024fba700 1 -- start start 2024-08-17T02:27:00.006 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.005+0000 7f7024fba700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7020154900 0x7f70200b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.005+0000 7f7024fba700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f70200cb560 0x7f7020160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.005+0000 7f7024fba700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70200b1730 con 0x7f70200b12d0 2024-08-17T02:27:00.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.005+0000 7f7024fba700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7020068790 con 0x7f7020154900 2024-08-17T02:27:00.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.005+0000 7f7024fba700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70201583f0 con 0x7f70200cb560 2024-08-17T02:27:00.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.005+0000 7f701f7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7020154900 0x7f70200b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.005+0000 7f701f7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7020154900 0x7f70200b0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59732/0 (socket says 172.21.15.153:59732) 2024-08-17T02:27:00.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.005+0000 7f701f7fe700 1 -- 172.21.15.153:0/1507690026 learned_addr learned my addr 172.21.15.153:0/1507690026 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:27:00.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.005+0000 7f701ffff700 1 --2- 172.21.15.153:0/1507690026 >> v2:172.21.15.174:3300/0 conn(0x7f70200cb560 0x7f7020160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.005+0000 7f701f7fe700 1 -- 172.21.15.153:0/1507690026 >> v2:172.21.15.174:3300/0 conn(0x7f70200cb560 msgr2=0x7f7020160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:00.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.005+0000 7f701f7fe700 1 --2- 172.21.15.153:0/1507690026 >> v2:172.21.15.174:3300/0 conn(0x7f70200cb560 0x7f7020160ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.005+0000 7f701f7fe700 1 -- 172.21.15.153:0/1507690026 >> v1:172.21.15.174:6789/0 conn(0x7f70200b12d0 legacy=0x7f70200cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.005+0000 7f701f7fe700 1 -- 172.21.15.153:0/1507690026 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70200cbaa0 con 0x7f7020154900 2024-08-17T02:27:00.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.005+0000 7f701f7fe700 1 --2- 172.21.15.153:0/1507690026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7020154900 0x7f70200b0d90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f702006c980 tx=0x7f7010009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48b12db82d9db059 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.005+0000 7f701e7fc700 1 -- 172.21.15.153:0/1507690026 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7010009e70 con 0x7f7020154900 2024-08-17T02:27:00.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.005+0000 7f701e7fc700 1 -- 172.21.15.153:0/1507690026 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f701000b860 con 0x7f7020154900 2024-08-17T02:27:00.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.005+0000 7f701e7fc700 1 -- 172.21.15.153:0/1507690026 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701000bc00 con 0x7f7020154900 2024-08-17T02:27:00.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.005+0000 7f7024fba700 1 -- 172.21.15.153:0/1507690026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7020154900 msgr2=0x7f70200b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.005+0000 7f7024fba700 1 --2- 172.21.15.153:0/1507690026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7020154900 0x7f70200b0d90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f702006c980 tx=0x7f7010009250 comp rx=0 tx=0).stop 2024-08-17T02:27:00.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.005+0000 7f7024fba700 1 -- 172.21.15.153:0/1507690026 shutdown_connections 2024-08-17T02:27:00.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.005+0000 7f7024fba700 1 --2- 172.21.15.153:0/1507690026 >> v2:172.21.15.174:3300/0 conn(0x7f70200cb560 0x7f7020160ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.005+0000 7f7024fba700 1 --2- 172.21.15.153:0/1507690026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7020154900 0x7f70200b0d90 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.005+0000 7f7024fba700 1 -- 172.21.15.153:0/1507690026 >> 172.21.15.153:0/1507690026 conn(0x7f70200678d0 msgr2=0x7f7020067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:00.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.005+0000 7f7024fba700 1 -- 172.21.15.153:0/1507690026 shutdown_connections 2024-08-17T02:27:00.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.005+0000 7f7024fba700 1 -- 172.21.15.153:0/1507690026 wait complete. 2024-08-17T02:27:00.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.009+0000 7f7024fba700 1 Processor -- start 2024-08-17T02:27:00.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.009+0000 7f7024fba700 1 -- start start 2024-08-17T02:27:00.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.009+0000 7f7024fba700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70200b12d0 0x7f7020141c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.009+0000 7f7024fba700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70200cb560 0x7f7020069f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.009+0000 7f7024fba700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7020154900 0x7f702006a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.009+0000 7f7024fba700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7020169060 con 0x7f70200cb560 2024-08-17T02:27:00.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.009+0000 7f7024fba700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7020168770 con 0x7f7020154900 2024-08-17T02:27:00.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.009+0000 7f7024fba700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7020168a10 con 0x7f70200b12d0 2024-08-17T02:27:00.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.009+0000 7f701effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70200cb560 0x7f7020069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.009+0000 7f701effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70200cb560 0x7f7020069f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59736/0 (socket says 172.21.15.153:59736) 2024-08-17T02:27:00.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.009+0000 7f701effd700 1 -- 172.21.15.153:0/188852758 learned_addr learned my addr 172.21.15.153:0/188852758 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:27:00.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.009+0000 7f701ffff700 1 --2- 172.21.15.153:0/188852758 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7020154900 0x7f702006a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.009+0000 7f701f7fe700 1 --2- 172.21.15.153:0/188852758 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70200b12d0 0x7f7020141c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.009+0000 7f701effd700 1 -- 172.21.15.153:0/188852758 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70200b12d0 msgr2=0x7f7020141c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.009+0000 7f701effd700 1 --2- 172.21.15.153:0/188852758 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70200b12d0 0x7f7020141c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.009+0000 7f701effd700 1 -- 172.21.15.153:0/188852758 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7020154900 msgr2=0x7f702006a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.009+0000 7f701effd700 1 --2- 172.21.15.153:0/188852758 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7020154900 0x7f702006a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.009+0000 7f701effd700 1 -- 172.21.15.153:0/188852758 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70100094f0 con 0x7f70200cb560 2024-08-17T02:27:00.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.009+0000 7f701effd700 1 --2- 172.21.15.153:0/188852758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70200cb560 0x7f7020069f10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f701400c590 tx=0x7f701400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.009+0000 7f70077fe700 1 -- 172.21.15.153:0/188852758 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7014011590 con 0x7f70200cb560 2024-08-17T02:27:00.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.009+0000 7f70077fe700 1 -- 172.21.15.153:0/188852758 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7014011710 con 0x7f70200cb560 2024-08-17T02:27:00.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.013+0000 7f7024fba700 1 -- 172.21.15.153:0/188852758 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7020168cf0 con 0x7f70200cb560 2024-08-17T02:27:00.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.013+0000 7f70077fe700 1 -- 172.21.15.153:0/188852758 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7014011ad0 con 0x7f70200cb560 2024-08-17T02:27:00.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.013+0000 7f7024fba700 1 -- 172.21.15.153:0/188852758 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7020142180 con 0x7f70200cb560 2024-08-17T02:27:00.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.013+0000 7f7024fba700 1 -- 172.21.15.153:0/188852758 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70200643a0 con 0x7f70200cb560 2024-08-17T02:27:00.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.013+0000 7f70077fe700 1 -- 172.21.15.153:0/188852758 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f701401b3b0 con 0x7f70200cb560 2024-08-17T02:27:00.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.013+0000 7f70077fe700 1 --2- 172.21.15.153:0/188852758 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f700c060860 0x7f700c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.013+0000 7f701f7fe700 1 --2- 172.21.15.153:0/188852758 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f700c060860 0x7f700c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.013+0000 7f70077fe700 1 -- 172.21.15.153:0/188852758 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f701407be70 con 0x7f70200cb560 2024-08-17T02:27:00.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.013+0000 7f701f7fe700 1 --2- 172.21.15.153:0/188852758 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f700c060860 0x7f700c062d10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f702006c980 tx=0x7f7010017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.017+0000 7f70077fe700 1 -- 172.21.15.153:0/188852758 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f701404c2c0 con 0x7f70200cb560 2024-08-17T02:27:00.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.185+0000 7f7024fba700 1 -- 172.21.15.153:0/188852758 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70200b1730 con 0x7f70200cb560 2024-08-17T02:27:00.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.189+0000 7f70077fe700 1 -- 172.21.15.153:0/188852758 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f70200b1730 con 0x7f70200cb560 2024-08-17T02:27:00.191 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:27:00.191 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":32,"fsid":"56d41c33-b929-456d-96be-2aac4ecd299d","created":"2024-08-17T02:25:47.756085+0000","modified":"2024-08-17T02:26:57.484203+0000","last_up_change":"2024-08-17T02:25:58.643690+0000","last_in_change":"2024-08-17T02:25:49.809186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:58.093273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:54.363196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:54.837150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0736f8e6-818e-42e6-a0dc-8aaf813315d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":24234},{"type":"v1","addr":"172.21.15.153:6817","nonce":24234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":24234},{"type":"v1","addr":"172.21.15.153:6819","nonce":24234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":24234},{"type":"v1","addr":"172.21.15.153:6823","nonce":24234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":24234},{"type":"v1","addr":"172.21.15.153:6821","nonce":24234}]},"public_addr":"172.21.15.153:6817/24234","cluster_addr":"172.21.15.153:6819/24234","heartbeat_back_addr":"172.21.15.153:6823/24234","heartbeat_front_addr":"172.21.15.153:6821/24234","state":["exists","up"]},{"osd":1,"uuid":"011762e9-6c2d-441a-aa56-68474639d72f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":24232},{"type":"v1","addr":"172.21.15.153:6801","nonce":24232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":24232},{"type":"v1","addr":"172.21.15.153:6803","nonce":24232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":24232},{"type":"v1","addr":"172.21.15.153:6809","nonce":24232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":24232},{"type":"v1","addr":"172.21.15.153:6806","nonce":24232}]},"public_addr":"172.21.15.153:6801/24232","cluster_addr":"172.21.15.153:6803/24232","heartbeat_back_addr":"172.21.15.153:6809/24232","heartbeat_front_addr":"172.21.15.153:6806/24232","state":["exists","up"]},{"osd":2,"uuid":"b562cd97-aa12-455e-b46a-e720a2ec9d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":24235},{"type":"v1","addr":"172.21.15.153:6808","nonce":24235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":24235},{"type":"v1","addr":"172.21.15.153:6811","nonce":24235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":24235},{"type":"v1","addr":"172.21.15.153:6815","nonce":24235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":24235},{"type":"v1","addr":"172.21.15.153:6813","nonce":24235}]},"public_addr":"172.21.15.153:6808/24235","cluster_addr":"172.21.15.153:6811/24235","heartbeat_back_addr":"172.21.15.153:6815/24235","heartbeat_front_addr":"172.21.15.153:6813/24235","state":["exists","up"]},{"osd":3,"uuid":"222da52f-90c2-4132-a5d2-6f6cf83d4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":24236},{"type":"v1","addr":"172.21.15.153:6825","nonce":24236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":24236},{"type":"v1","addr":"172.21.15.153:6827","nonce":24236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":24236},{"type":"v1","addr":"172.21.15.153:6831","nonce":24236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":24236},{"type":"v1","addr":"172.21.15.153:6829","nonce":24236}]},"public_addr":"172.21.15.153:6825/24236","cluster_addr":"172.21.15.153:6827/24236","heartbeat_back_addr":"172.21.15.153:6831/24236","heartbeat_front_addr":"172.21.15.153:6829/24236","state":["exists","up"]},{"osd":4,"uuid":"a38a04cd-032b-4977-a260-1ef3567d0c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24456},{"type":"v1","addr":"172.21.15.174:6809","nonce":24456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24456},{"type":"v1","addr":"172.21.15.174:6811","nonce":24456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24456},{"type":"v1","addr":"172.21.15.174:6815","nonce":24456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24456},{"type":"v1","addr":"172.21.15.174:6813","nonce":24456}]},"public_addr":"172.21.15.174:6809/24456","cluster_addr":"172.21.15.174:6811/24456","heartbeat_back_addr":"172.21.15.174:6815/24456","heartbeat_front_addr":"172.21.15.174:6813/24456","state":["exists","up"]},{"osd":5,"uuid":"c7778084-e751-48da-87a1-ab8bbe85aa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24457},{"type":"v1","addr":"172.21.15.174:6825","nonce":24457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24457},{"type":"v1","addr":"172.21.15.174:6827","nonce":24457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24457},{"type":"v1","addr":"172.21.15.174:6831","nonce":24457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24457},{"type":"v1","addr":"172.21.15.174:6829","nonce":24457}]},"public_addr":"172.21.15.174:6825/24457","cluster_addr":"172.21.15.174:6827/24457","heartbeat_back_addr":"172.21.15.174:6831/24457","heartbeat_front_addr":"172.21.15.174:6829/24457","state":["exists","up"]},{"osd":6,"uuid":"2d8e0715-254f-442c-9625-50721d0bc858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24477},{"type":"v1","addr":"172.21.15.174:6801","nonce":24477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24477},{"type":"v1","addr":"172.21.15.174:6803","nonce":24477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24477},{"type":"v1","addr":"172.21.15.174:6807","nonce":24477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24477},{"type":"v1","addr":"172.21.15.174:6805","nonce":24477}]},"public_addr":"172.21.15.174:6801/24477","cluster_addr":"172.21.15.174:6803/24477","heartbeat_back_addr":"172.21.15.174:6807/24477","heartbeat_front_addr":"172.21.15.174:6805/24477","state":["exists","up"]},{"osd":7,"uuid":"dffda25a-4601-4ddb-9a27-b0be1cadde27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24455},{"type":"v1","addr":"172.21.15.174:6817","nonce":24455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24455},{"type":"v1","addr":"172.21.15.174:6819","nonce":24455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24455},{"type":"v1","addr":"172.21.15.174:6823","nonce":24455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24455},{"type":"v1","addr":"172.21.15.174:6821","nonce":24455}]},"public_addr":"172.21.15.174:6817/24455","cluster_addr":"172.21.15.174:6819/24455","heartbeat_back_addr":"172.21.15.174:6823/24455","heartbeat_front_addr":"172.21.15.174:6821/24455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.990117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.033862+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.748087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.112877+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.070448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.360961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.110940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.226377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:00.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.189+0000 7f7024fba700 1 -- 172.21.15.153:0/188852758 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f700c060860 msgr2=0x7f700c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.189+0000 7f7024fba700 1 --2- 172.21.15.153:0/188852758 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f700c060860 0x7f700c062d10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f702006c980 tx=0x7f7010017000 comp rx=0 tx=0).stop 2024-08-17T02:27:00.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.189+0000 7f7024fba700 1 -- 172.21.15.153:0/188852758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70200cb560 msgr2=0x7f7020069f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.189+0000 7f7024fba700 1 --2- 172.21.15.153:0/188852758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70200cb560 0x7f7020069f10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f701400c590 tx=0x7f701400c8a0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.189+0000 7f7024fba700 1 -- 172.21.15.153:0/188852758 shutdown_connections 2024-08-17T02:27:00.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.189+0000 7f7024fba700 1 --2- 172.21.15.153:0/188852758 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f700c060860 0x7f700c062d10 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.189+0000 7f7024fba700 1 --2- 172.21.15.153:0/188852758 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7020154900 0x7f702006a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.189+0000 7f7024fba700 1 --2- 172.21.15.153:0/188852758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70200cb560 0x7f7020069f10 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.189+0000 7f7024fba700 1 --2- 172.21.15.153:0/188852758 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70200b12d0 0x7f7020141c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.189+0000 7f7024fba700 1 -- 172.21.15.153:0/188852758 >> 172.21.15.153:0/188852758 conn(0x7f70200678d0 msgr2=0x7f70200ca4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:00.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.189+0000 7f7024fba700 1 -- 172.21.15.153:0/188852758 shutdown_connections 2024-08-17T02:27:00.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.189+0000 7f7024fba700 1 -- 172.21.15.153:0/188852758 wait complete. 2024-08-17T02:27:00.205 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:27:00.205 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:27:00.308 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.305+0000 7fc356097700 1 Processor -- start 2024-08-17T02:27:00.308 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.305+0000 7fc356097700 1 -- start start 2024-08-17T02:27:00.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.305+0000 7fc356097700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc350068ca0 0x7fc3500b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.305+0000 7fc356097700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc350155160 0x7fc3501555e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.305+0000 7fc356097700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc350159fb0 con 0x7fc3500688d0 2024-08-17T02:27:00.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.305+0000 7fc356097700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc350159410 con 0x7fc350155160 2024-08-17T02:27:00.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.305+0000 7fc356097700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc350156c30 con 0x7fc350068ca0 2024-08-17T02:27:00.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.305+0000 7fc34ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc350155160 0x7fc3501555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.305+0000 7fc34effd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc350068ca0 0x7fc3500b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.305+0000 7fc34effd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc350068ca0 0x7fc3500b1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.153:55344/0 (socket says 172.21.15.153:55344) 2024-08-17T02:27:00.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.305+0000 7fc34f7fe700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fc3500688d0 0x7fc3500af4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.153:39426/0 (socket says 172.21.15.153:39426) 2024-08-17T02:27:00.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.305+0000 7fc34effd700 1 -- 172.21.15.153:0/2611362107 learned_addr learned my addr 172.21.15.153:0/2611362107 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:27:00.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.305+0000 7fc34effd700 1 -- 172.21.15.153:0/2611362107 >> v2:172.21.15.153:3300/0 conn(0x7fc350155160 msgr2=0x7fc3501555e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:00.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.305+0000 7fc34effd700 1 --2- 172.21.15.153:0/2611362107 >> v2:172.21.15.153:3300/0 conn(0x7fc350155160 0x7fc3501555e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.305+0000 7fc34effd700 1 -- 172.21.15.153:0/2611362107 >> v1:172.21.15.174:6789/0 conn(0x7fc3500688d0 legacy=0x7fc3500af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.305+0000 7fc34effd700 1 -- 172.21.15.153:0/2611362107 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc350159680 con 0x7fc350068ca0 2024-08-17T02:27:00.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.305+0000 7fc34e7fc700 1 -- 172.21.15.153:0/2611362107 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2073237996 0 0) 0x7fc350159fb0 con 0x7fc3500688d0 2024-08-17T02:27:00.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.305+0000 7fc34ffff700 1 --2- 172.21.15.153:0/2611362107 >> v2:172.21.15.153:3300/0 conn(0x7fc350155160 0x7fc3501555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:00.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.305+0000 7fc34effd700 1 --2- 172.21.15.153:0/2611362107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc350068ca0 0x7fc3500b1f20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc34400bc50 tx=0x7fc34400b4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c6479c33f5aac33 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.305+0000 7fc34e7fc700 1 -- 172.21.15.153:0/2611362107 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34400dbb0 con 0x7fc350068ca0 2024-08-17T02:27:00.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.305+0000 7fc34e7fc700 1 -- 172.21.15.153:0/2611362107 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34400dd10 con 0x7fc350068ca0 2024-08-17T02:27:00.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.305+0000 7fc34e7fc700 1 -- 172.21.15.153:0/2611362107 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3440196b0 con 0x7fc350068ca0 2024-08-17T02:27:00.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.309+0000 7fc356097700 1 -- 172.21.15.153:0/2611362107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc350068ca0 msgr2=0x7fc3500b1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.309+0000 7fc356097700 1 --2- 172.21.15.153:0/2611362107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc350068ca0 0x7fc3500b1f20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc34400bc50 tx=0x7fc34400b4f0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.309+0000 7fc356097700 1 -- 172.21.15.153:0/2611362107 shutdown_connections 2024-08-17T02:27:00.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.309+0000 7fc356097700 1 --2- 172.21.15.153:0/2611362107 >> v2:172.21.15.153:3300/0 conn(0x7fc350155160 0x7fc3501555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.309+0000 7fc356097700 1 --2- 172.21.15.153:0/2611362107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc350068ca0 0x7fc3500b1f20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.309+0000 7fc356097700 1 -- 172.21.15.153:0/2611362107 >> 172.21.15.153:0/2611362107 conn(0x7fc35006e3d0 msgr2=0x7fc35006b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:00.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.309+0000 7fc356097700 1 -- 172.21.15.153:0/2611362107 shutdown_connections 2024-08-17T02:27:00.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.309+0000 7fc356097700 1 -- 172.21.15.153:0/2611362107 wait complete. 2024-08-17T02:27:00.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.309+0000 7fc356097700 1 Processor -- start 2024-08-17T02:27:00.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.309+0000 7fc356097700 1 -- start start 2024-08-17T02:27:00.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.309+0000 7fc356097700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3500688d0 0x7fc350169b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.309+0000 7fc356097700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc350068ca0 0x7fc35014c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.309+0000 7fc356097700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc350155160 0x7fc35014cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.309+0000 7fc356097700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3501696e0 con 0x7fc350068ca0 2024-08-17T02:27:00.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.309+0000 7fc356097700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35014d710 con 0x7fc350155160 2024-08-17T02:27:00.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.309+0000 7fc356097700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc35014d9f0 con 0x7fc3500688d0 2024-08-17T02:27:00.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.309+0000 7fc34effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc350068ca0 0x7fc35014c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.309+0000 7fc34effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc350068ca0 0x7fc35014c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59744/0 (socket says 172.21.15.153:59744) 2024-08-17T02:27:00.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.309+0000 7fc34effd700 1 -- 172.21.15.153:0/1967046264 learned_addr learned my addr 172.21.15.153:0/1967046264 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:27:00.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.309+0000 7fc34ffff700 1 --2- 172.21.15.153:0/1967046264 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc350155160 0x7fc35014cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.309+0000 7fc34f7fe700 1 --2- 172.21.15.153:0/1967046264 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3500688d0 0x7fc350169b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.313+0000 7fc34effd700 1 -- 172.21.15.153:0/1967046264 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3500688d0 msgr2=0x7fc350169b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.313+0000 7fc34effd700 1 --2- 172.21.15.153:0/1967046264 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3500688d0 0x7fc350169b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.313+0000 7fc34effd700 1 -- 172.21.15.153:0/1967046264 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc350155160 msgr2=0x7fc35014cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.313+0000 7fc34effd700 1 --2- 172.21.15.153:0/1967046264 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc350155160 0x7fc35014cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.313+0000 7fc34effd700 1 -- 172.21.15.153:0/1967046264 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc348009a20 con 0x7fc350068ca0 2024-08-17T02:27:00.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.313+0000 7fc34ffff700 1 --2- 172.21.15.153:0/1967046264 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc350155160 0x7fc35014cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:00.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.313+0000 7fc34effd700 1 --2- 172.21.15.153:0/1967046264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc350068ca0 0x7fc35014c600 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc344006fd0 tx=0x7fc34401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.313+0000 7fc3377fe700 1 -- 172.21.15.153:0/1967046264 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc344010680 con 0x7fc350068ca0 2024-08-17T02:27:00.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.313+0000 7fc3377fe700 1 -- 172.21.15.153:0/1967046264 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc344010800 con 0x7fc350068ca0 2024-08-17T02:27:00.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.313+0000 7fc356097700 1 -- 172.21.15.153:0/1967046264 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc34400b790 con 0x7fc350068ca0 2024-08-17T02:27:00.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.313+0000 7fc3377fe700 1 -- 172.21.15.153:0/1967046264 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc344010bc0 con 0x7fc350068ca0 2024-08-17T02:27:00.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.313+0000 7fc356097700 1 -- 172.21.15.153:0/1967046264 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc35014cb40 con 0x7fc350068ca0 2024-08-17T02:27:00.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.313+0000 7fc356097700 1 -- 172.21.15.153:0/1967046264 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc350169850 con 0x7fc350068ca0 2024-08-17T02:27:00.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.313+0000 7fc3377fe700 1 -- 172.21.15.153:0/1967046264 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc3440233f0 con 0x7fc350068ca0 2024-08-17T02:27:00.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.313+0000 7fc3377fe700 1 --2- 172.21.15.153:0/1967046264 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fc33c060860 0x7fc33c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.313+0000 7fc34f7fe700 1 --2- 172.21.15.153:0/1967046264 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fc33c060860 0x7fc33c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.313+0000 7fc3377fe700 1 -- 172.21.15.153:0/1967046264 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc344014070 con 0x7fc350068ca0 2024-08-17T02:27:00.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.317+0000 7fc34f7fe700 1 --2- 172.21.15.153:0/1967046264 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fc33c060860 0x7fc33c062d10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc340007180 tx=0x7fc340007ef0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.321+0000 7fc3377fe700 1 -- 172.21.15.153:0/1967046264 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc34404ee10 con 0x7fc350068ca0 2024-08-17T02:27:00.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.485+0000 7fc356097700 1 -- 172.21.15.153:0/1967046264 --> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc3500645c0 con 0x7fc33c060860 2024-08-17T02:27:00.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.501+0000 7fc3377fe700 1 -- 172.21.15.153:0/1967046264 <== mgr.4104 v2:172.21.15.153:6832/24147 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264533 (secure 0 0 0) 0x7fc3500645c0 con 0x7fc33c060860 2024-08-17T02:27:00.508 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:27:00.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.505+0000 7fc356097700 1 -- 172.21.15.153:0/1967046264 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fc33c060860 msgr2=0x7fc33c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.505+0000 7fc356097700 1 --2- 172.21.15.153:0/1967046264 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fc33c060860 0x7fc33c062d10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc340007180 tx=0x7fc340007ef0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.505+0000 7fc356097700 1 -- 172.21.15.153:0/1967046264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc350068ca0 msgr2=0x7fc35014c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.505+0000 7fc356097700 1 --2- 172.21.15.153:0/1967046264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc350068ca0 0x7fc35014c600 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc344006fd0 tx=0x7fc34401b000 comp rx=0 tx=0).stop 2024-08-17T02:27:00.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.505+0000 7fc356097700 1 -- 172.21.15.153:0/1967046264 shutdown_connections 2024-08-17T02:27:00.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.505+0000 7fc356097700 1 --2- 172.21.15.153:0/1967046264 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fc33c060860 0x7fc33c062d10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.505+0000 7fc356097700 1 --2- 172.21.15.153:0/1967046264 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc350155160 0x7fc35014cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.505+0000 7fc356097700 1 --2- 172.21.15.153:0/1967046264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc350068ca0 0x7fc35014c600 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.505+0000 7fc356097700 1 --2- 172.21.15.153:0/1967046264 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3500688d0 0x7fc350169b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.505+0000 7fc356097700 1 -- 172.21.15.153:0/1967046264 >> 172.21.15.153:0/1967046264 conn(0x7fc35006e3d0 msgr2=0x7fc350156f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:00.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.505+0000 7fc356097700 1 -- 172.21.15.153:0/1967046264 shutdown_connections 2024-08-17T02:27:00.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.505+0000 7fc356097700 1 -- 172.21.15.153:0/1967046264 wait complete. 2024-08-17T02:27:00.511 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-08-17T02:27:00.521 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-08-17T02:27:00.052255+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":63,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382816,"kb_used_data":3952,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752591904,"statfs":{"total":773094113280,"available":770654109696,"internally_reserved":0,"allocated":4046848,"data_stored":2250652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.578948"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.503403+0000","last_change":"2024-08-17T02:26:56.500846+0000","last_active":"2024-08-17T02:26:56.503403+0000","last_peered":"2024-08-17T02:26:56.503403+0000","last_clean":"2024-08-17T02:26:56.503403+0000","last_became_active":"2024-08-17T02:26:56.500513+0000","last_became_peered":"2024-08-17T02:26:56.500513+0000","last_unstale":"2024-08-17T02:26:56.503403+0000","last_undegraded":"2024-08-17T02:26:56.503403+0000","last_fullsized":"2024-08-17T02:26:56.503403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:30.373768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.509984+0000","last_change":"2024-08-17T02:26:56.505967+0000","last_active":"2024-08-17T02:26:56.509984+0000","last_peered":"2024-08-17T02:26:56.509984+0000","last_clean":"2024-08-17T02:26:56.509984+0000","last_became_active":"2024-08-17T02:26:56.505669+0000","last_became_peered":"2024-08-17T02:26:56.505669+0000","last_unstale":"2024-08-17T02:26:56.509984+0000","last_undegraded":"2024-08-17T02:26:56.509984+0000","last_fullsized":"2024-08-17T02:26:56.509984+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:49:55.402389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.512979+0000","last_change":"2024-08-17T02:26:56.508128+0000","last_active":"2024-08-17T02:26:56.512979+0000","last_peered":"2024-08-17T02:26:56.512979+0000","last_clean":"2024-08-17T02:26:56.512979+0000","last_became_active":"2024-08-17T02:26:56.507740+0000","last_became_peered":"2024-08-17T02:26:56.507740+0000","last_unstale":"2024-08-17T02:26:56.512979+0000","last_undegraded":"2024-08-17T02:26:56.512979+0000","last_fullsized":"2024-08-17T02:26:56.512979+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:10:07.456075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.512847+0000","last_change":"2024-08-17T02:26:56.504331+0000","last_active":"2024-08-17T02:26:56.512847+0000","last_peered":"2024-08-17T02:26:56.512847+0000","last_clean":"2024-08-17T02:26:56.512847+0000","last_became_active":"2024-08-17T02:26:56.504018+0000","last_became_peered":"2024-08-17T02:26:56.504018+0000","last_unstale":"2024-08-17T02:26:56.512847+0000","last_undegraded":"2024-08-17T02:26:56.512847+0000","last_fullsized":"2024-08-17T02:26:56.512847+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:31:39.039987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.505790+0000","last_change":"2024-08-17T02:26:56.505790+0000","last_active":"2024-08-17T02:26:56.505790+0000","last_peered":"2024-08-17T02:26:56.505790+0000","last_clean":"2024-08-17T02:26:56.505790+0000","last_became_active":"2024-08-17T02:26:56.505479+0000","last_became_peered":"2024-08-17T02:26:56.505479+0000","last_unstale":"2024-08-17T02:26:56.505790+0000","last_undegraded":"2024-08-17T02:26:56.505790+0000","last_fullsized":"2024-08-17T02:26:56.505790+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:09:20.380163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.509831+0000","last_change":"2024-08-17T02:26:56.506074+0000","last_active":"2024-08-17T02:26:56.509831+0000","last_peered":"2024-08-17T02:26:56.509831+0000","last_clean":"2024-08-17T02:26:56.509831+0000","last_became_active":"2024-08-17T02:26:56.505836+0000","last_became_peered":"2024-08-17T02:26:56.505836+0000","last_unstale":"2024-08-17T02:26:56.509831+0000","last_undegraded":"2024-08-17T02:26:56.509831+0000","last_fullsized":"2024-08-17T02:26:56.509831+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:24.373874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.513885+0000","last_change":"2024-08-17T02:26:56.512163+0000","last_active":"2024-08-17T02:26:56.513885+0000","last_peered":"2024-08-17T02:26:56.513885+0000","last_clean":"2024-08-17T02:26:56.513885+0000","last_became_active":"2024-08-17T02:26:56.511568+0000","last_became_peered":"2024-08-17T02:26:56.511568+0000","last_unstale":"2024-08-17T02:26:56.513885+0000","last_undegraded":"2024-08-17T02:26:56.513885+0000","last_fullsized":"2024-08-17T02:26:56.513885+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:10:07.456075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.514136+0000","last_change":"2024-08-17T02:26:56.512820+0000","last_active":"2024-08-17T02:26:56.514136+0000","last_peered":"2024-08-17T02:26:56.514136+0000","last_clean":"2024-08-17T02:26:56.514136+0000","last_became_active":"2024-08-17T02:26:56.512181+0000","last_became_peered":"2024-08-17T02:26:56.512181+0000","last_unstale":"2024-08-17T02:26:56.514136+0000","last_undegraded":"2024-08-17T02:26:56.514136+0000","last_fullsized":"2024-08-17T02:26:56.514136+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:09:25.912935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.514583+0000","last_change":"2024-08-17T02:26:56.508601+0000","last_active":"2024-08-17T02:26:56.514583+0000","last_peered":"2024-08-17T02:26:56.514583+0000","last_clean":"2024-08-17T02:26:56.514583+0000","last_became_active":"2024-08-17T02:26:56.508060+0000","last_became_peered":"2024-08-17T02:26:56.508060+0000","last_unstale":"2024-08-17T02:26:56.514583+0000","last_undegraded":"2024-08-17T02:26:56.514583+0000","last_fullsized":"2024-08-17T02:26:56.514583+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:35:58.942197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.516013+0000","last_change":"2024-08-17T02:26:56.509852+0000","last_active":"2024-08-17T02:26:56.516013+0000","last_peered":"2024-08-17T02:26:56.516013+0000","last_clean":"2024-08-17T02:26:56.516013+0000","last_became_active":"2024-08-17T02:26:56.508084+0000","last_became_peered":"2024-08-17T02:26:56.508084+0000","last_unstale":"2024-08-17T02:26:56.516013+0000","last_undegraded":"2024-08-17T02:26:56.516013+0000","last_fullsized":"2024-08-17T02:26:56.516013+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:19.840030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.518338+0000","last_change":"2024-08-17T02:26:56.516813+0000","last_active":"2024-08-17T02:26:56.518338+0000","last_peered":"2024-08-17T02:26:56.518338+0000","last_clean":"2024-08-17T02:26:56.518338+0000","last_became_active":"2024-08-17T02:26:56.516476+0000","last_became_peered":"2024-08-17T02:26:56.516476+0000","last_unstale":"2024-08-17T02:26:56.518338+0000","last_undegraded":"2024-08-17T02:26:56.518338+0000","last_fullsized":"2024-08-17T02:26:56.518338+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:36:24.386265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.513018+0000","last_change":"2024-08-17T02:26:56.509142+0000","last_active":"2024-08-17T02:26:56.513018+0000","last_peered":"2024-08-17T02:26:56.513018+0000","last_clean":"2024-08-17T02:26:56.513018+0000","last_became_active":"2024-08-17T02:26:56.508882+0000","last_became_peered":"2024-08-17T02:26:56.508882+0000","last_unstale":"2024-08-17T02:26:56.513018+0000","last_undegraded":"2024-08-17T02:26:56.513018+0000","last_fullsized":"2024-08-17T02:26:56.513018+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:24.429926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.513857+0000","last_change":"2024-08-17T02:26:56.513857+0000","last_active":"2024-08-17T02:26:56.513857+0000","last_peered":"2024-08-17T02:26:56.513857+0000","last_clean":"2024-08-17T02:26:56.513857+0000","last_became_active":"2024-08-17T02:26:56.513606+0000","last_became_peered":"2024-08-17T02:26:56.513606+0000","last_unstale":"2024-08-17T02:26:56.513857+0000","last_undegraded":"2024-08-17T02:26:56.513857+0000","last_fullsized":"2024-08-17T02:26:56.513857+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:53.080739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.509853+0000","last_change":"2024-08-17T02:26:56.506491+0000","last_active":"2024-08-17T02:26:56.509853+0000","last_peered":"2024-08-17T02:26:56.509853+0000","last_clean":"2024-08-17T02:26:56.509853+0000","last_became_active":"2024-08-17T02:26:56.506176+0000","last_became_peered":"2024-08-17T02:26:56.506176+0000","last_unstale":"2024-08-17T02:26:56.509853+0000","last_undegraded":"2024-08-17T02:26:56.509853+0000","last_fullsized":"2024-08-17T02:26:56.509853+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:22:39.138649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.501204+0000","last_change":"2024-08-17T02:26:56.499445+0000","last_active":"2024-08-17T02:26:56.501204+0000","last_peered":"2024-08-17T02:26:56.501204+0000","last_clean":"2024-08-17T02:26:56.501204+0000","last_became_active":"2024-08-17T02:26:56.498916+0000","last_became_peered":"2024-08-17T02:26:56.498916+0000","last_unstale":"2024-08-17T02:26:56.501204+0000","last_undegraded":"2024-08-17T02:26:56.501204+0000","last_fullsized":"2024-08-17T02:26:56.501204+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:30:12.034768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.514153+0000","last_change":"2024-08-17T02:26:56.512997+0000","last_active":"2024-08-17T02:26:56.514153+0000","last_peered":"2024-08-17T02:26:56.514153+0000","last_clean":"2024-08-17T02:26:56.514153+0000","last_became_active":"2024-08-17T02:26:56.512539+0000","last_became_peered":"2024-08-17T02:26:56.512539+0000","last_unstale":"2024-08-17T02:26:56.514153+0000","last_undegraded":"2024-08-17T02:26:56.514153+0000","last_fullsized":"2024-08-17T02:26:56.514153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:36.857632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.514101+0000","last_change":"2024-08-17T02:26:56.512779+0000","last_active":"2024-08-17T02:26:56.514101+0000","last_peered":"2024-08-17T02:26:56.514101+0000","last_clean":"2024-08-17T02:26:56.514101+0000","last_became_active":"2024-08-17T02:26:56.512448+0000","last_became_peered":"2024-08-17T02:26:56.512448+0000","last_unstale":"2024-08-17T02:26:56.514101+0000","last_undegraded":"2024-08-17T02:26:56.514101+0000","last_fullsized":"2024-08-17T02:26:56.514101+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:19.840030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.519410+0000","last_change":"2024-08-17T02:26:56.514034+0000","last_active":"2024-08-17T02:26:56.519410+0000","last_peered":"2024-08-17T02:26:56.519410+0000","last_clean":"2024-08-17T02:26:56.519410+0000","last_became_active":"2024-08-17T02:26:56.513763+0000","last_became_peered":"2024-08-17T02:26:56.513763+0000","last_unstale":"2024-08-17T02:26:56.519410+0000","last_undegraded":"2024-08-17T02:26:56.519410+0000","last_fullsized":"2024-08-17T02:26:56.519410+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:24:44.395718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.523511+0000","last_change":"2024-08-17T02:26:56.516691+0000","last_active":"2024-08-17T02:26:56.523511+0000","last_peered":"2024-08-17T02:26:56.523511+0000","last_clean":"2024-08-17T02:26:56.523511+0000","last_became_active":"2024-08-17T02:26:56.516329+0000","last_became_peered":"2024-08-17T02:26:56.516329+0000","last_unstale":"2024-08-17T02:26:56.523511+0000","last_undegraded":"2024-08-17T02:26:56.523511+0000","last_fullsized":"2024-08-17T02:26:56.523511+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:54:21.155990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.506413+0000","last_change":"2024-08-17T02:26:56.506413+0000","last_active":"2024-08-17T02:26:56.506413+0000","last_peered":"2024-08-17T02:26:56.506413+0000","last_clean":"2024-08-17T02:26:56.506413+0000","last_became_active":"2024-08-17T02:26:56.506105+0000","last_became_peered":"2024-08-17T02:26:56.506105+0000","last_unstale":"2024-08-17T02:26:56.506413+0000","last_undegraded":"2024-08-17T02:26:56.506413+0000","last_fullsized":"2024-08-17T02:26:56.506413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:44:13.752344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.514300+0000","last_change":"2024-08-17T02:26:56.506245+0000","last_active":"2024-08-17T02:26:56.514300+0000","last_peered":"2024-08-17T02:26:56.514300+0000","last_clean":"2024-08-17T02:26:56.514300+0000","last_became_active":"2024-08-17T02:26:56.505891+0000","last_became_peered":"2024-08-17T02:26:56.505891+0000","last_unstale":"2024-08-17T02:26:56.514300+0000","last_undegraded":"2024-08-17T02:26:56.514300+0000","last_fullsized":"2024-08-17T02:26:56.514300+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:27:22.505326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.511078+0000","last_change":"2024-08-17T02:26:56.504215+0000","last_active":"2024-08-17T02:26:56.511078+0000","last_peered":"2024-08-17T02:26:56.511078+0000","last_clean":"2024-08-17T02:26:56.511078+0000","last_became_active":"2024-08-17T02:26:56.503700+0000","last_became_peered":"2024-08-17T02:26:56.503700+0000","last_unstale":"2024-08-17T02:26:56.511078+0000","last_undegraded":"2024-08-17T02:26:56.511078+0000","last_fullsized":"2024-08-17T02:26:56.511078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:30.373768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.513119+0000","last_change":"2024-08-17T02:26:56.507598+0000","last_active":"2024-08-17T02:26:56.513119+0000","last_peered":"2024-08-17T02:26:56.513119+0000","last_clean":"2024-08-17T02:26:56.513119+0000","last_became_active":"2024-08-17T02:26:56.507328+0000","last_became_peered":"2024-08-17T02:26:56.507328+0000","last_unstale":"2024-08-17T02:26:56.513119+0000","last_undegraded":"2024-08-17T02:26:56.513119+0000","last_fullsized":"2024-08-17T02:26:56.513119+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:54:31.590117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.512069+0000","last_change":"2024-08-17T02:26:56.506886+0000","last_active":"2024-08-17T02:26:56.512069+0000","last_peered":"2024-08-17T02:26:56.512069+0000","last_clean":"2024-08-17T02:26:56.512069+0000","last_became_active":"2024-08-17T02:26:56.506626+0000","last_became_peered":"2024-08-17T02:26:56.506626+0000","last_unstale":"2024-08-17T02:26:56.512069+0000","last_undegraded":"2024-08-17T02:26:56.512069+0000","last_fullsized":"2024-08-17T02:26:56.512069+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:28.514977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.521633+0000","last_change":"2024-08-17T02:26:56.513188+0000","last_active":"2024-08-17T02:26:56.521633+0000","last_peered":"2024-08-17T02:26:56.521633+0000","last_clean":"2024-08-17T02:26:56.521633+0000","last_became_active":"2024-08-17T02:26:56.512889+0000","last_became_peered":"2024-08-17T02:26:56.512889+0000","last_unstale":"2024-08-17T02:26:56.521633+0000","last_undegraded":"2024-08-17T02:26:56.521633+0000","last_fullsized":"2024-08-17T02:26:56.521633+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:16:16.561417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.519389+0000","last_change":"2024-08-17T02:26:56.513205+0000","last_active":"2024-08-17T02:26:56.519389+0000","last_peered":"2024-08-17T02:26:56.519389+0000","last_clean":"2024-08-17T02:26:56.519389+0000","last_became_active":"2024-08-17T02:26:56.512948+0000","last_became_peered":"2024-08-17T02:26:56.512948+0000","last_unstale":"2024-08-17T02:26:56.519389+0000","last_undegraded":"2024-08-17T02:26:56.519389+0000","last_fullsized":"2024-08-17T02:26:56.519389+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:48:30.881665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.516152+0000","last_change":"2024-08-17T02:26:56.510617+0000","last_active":"2024-08-17T02:26:56.516152+0000","last_peered":"2024-08-17T02:26:56.516152+0000","last_clean":"2024-08-17T02:26:56.516152+0000","last_became_active":"2024-08-17T02:26:56.507923+0000","last_became_peered":"2024-08-17T02:26:56.507923+0000","last_unstale":"2024-08-17T02:26:56.516152+0000","last_undegraded":"2024-08-17T02:26:56.516152+0000","last_fullsized":"2024-08-17T02:26:56.516152+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:44:16.911038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.501704+0000","last_change":"2024-08-17T02:26:56.499934+0000","last_active":"2024-08-17T02:26:56.501704+0000","last_peered":"2024-08-17T02:26:56.501704+0000","last_clean":"2024-08-17T02:26:56.501704+0000","last_became_active":"2024-08-17T02:26:56.499675+0000","last_became_peered":"2024-08-17T02:26:56.499675+0000","last_unstale":"2024-08-17T02:26:56.501704+0000","last_undegraded":"2024-08-17T02:26:56.501704+0000","last_fullsized":"2024-08-17T02:26:56.501704+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:30:02.596332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.514921+0000","last_change":"2024-08-17T02:26:56.510268+0000","last_active":"2024-08-17T02:26:56.514921+0000","last_peered":"2024-08-17T02:26:56.514921+0000","last_clean":"2024-08-17T02:26:56.514921+0000","last_became_active":"2024-08-17T02:26:56.509893+0000","last_became_peered":"2024-08-17T02:26:56.509893+0000","last_unstale":"2024-08-17T02:26:56.514921+0000","last_undegraded":"2024-08-17T02:26:56.514921+0000","last_fullsized":"2024-08-17T02:26:56.514921+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:44:16.911038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.511482+0000","last_change":"2024-08-17T02:26:56.506965+0000","last_active":"2024-08-17T02:26:56.511482+0000","last_peered":"2024-08-17T02:26:56.511482+0000","last_clean":"2024-08-17T02:26:56.511482+0000","last_became_active":"2024-08-17T02:26:56.506691+0000","last_became_peered":"2024-08-17T02:26:56.506691+0000","last_unstale":"2024-08-17T02:26:56.511482+0000","last_undegraded":"2024-08-17T02:26:56.511482+0000","last_fullsized":"2024-08-17T02:26:56.511482+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:31:39.039987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.511730+0000","last_change":"2024-08-17T02:26:56.506847+0000","last_active":"2024-08-17T02:26:56.511730+0000","last_peered":"2024-08-17T02:26:56.511730+0000","last_clean":"2024-08-17T02:26:56.511730+0000","last_became_active":"2024-08-17T02:26:56.506490+0000","last_became_peered":"2024-08-17T02:26:56.506490+0000","last_unstale":"2024-08-17T02:26:56.511730+0000","last_undegraded":"2024-08-17T02:26:56.511730+0000","last_fullsized":"2024-08-17T02:26:56.511730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:35:58.942197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.518216+0000","last_change":"2024-08-17T02:26:56.515531+0000","last_active":"2024-08-17T02:26:56.518216+0000","last_peered":"2024-08-17T02:26:56.518216+0000","last_clean":"2024-08-17T02:26:56.518216+0000","last_became_active":"2024-08-17T02:26:56.515210+0000","last_became_peered":"2024-08-17T02:26:56.515210+0000","last_unstale":"2024-08-17T02:26:56.518216+0000","last_undegraded":"2024-08-17T02:26:56.518216+0000","last_fullsized":"2024-08-17T02:26:56.518216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:48:30.881665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.518579+0000","last_change":"2024-08-17T02:26:56.512698+0000","last_active":"2024-08-17T02:26:56.518579+0000","last_peered":"2024-08-17T02:26:56.518579+0000","last_clean":"2024-08-17T02:26:56.518579+0000","last_became_active":"2024-08-17T02:26:56.512374+0000","last_became_peered":"2024-08-17T02:26:56.512374+0000","last_unstale":"2024-08-17T02:26:56.518579+0000","last_undegraded":"2024-08-17T02:26:56.518579+0000","last_fullsized":"2024-08-17T02:26:56.518579+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:45.237497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.521278+0000","last_change":"2024-08-17T02:26:55.504333+0000","last_active":"2024-08-17T02:26:56.521278+0000","last_peered":"2024-08-17T02:26:56.521278+0000","last_clean":"2024-08-17T02:26:56.521278+0000","last_became_active":"2024-08-17T02:26:55.503255+0000","last_became_peered":"2024-08-17T02:26:55.503255+0000","last_unstale":"2024-08-17T02:26:56.521278+0000","last_undegraded":"2024-08-17T02:26:56.521278+0000","last_fullsized":"2024-08-17T02:26:56.521278+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:06:33.618043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.511895+0000","last_change":"2024-08-17T02:26:56.509366+0000","last_active":"2024-08-17T02:26:56.511895+0000","last_peered":"2024-08-17T02:26:56.511895+0000","last_clean":"2024-08-17T02:26:56.511895+0000","last_became_active":"2024-08-17T02:26:56.509039+0000","last_became_peered":"2024-08-17T02:26:56.509039+0000","last_unstale":"2024-08-17T02:26:56.511895+0000","last_undegraded":"2024-08-17T02:26:56.511895+0000","last_fullsized":"2024-08-17T02:26:56.511895+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:48:01.572551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.521840+0000","last_change":"2024-08-17T02:26:55.507032+0000","last_active":"2024-08-17T02:26:56.521840+0000","last_peered":"2024-08-17T02:26:56.521840+0000","last_clean":"2024-08-17T02:26:56.521840+0000","last_became_active":"2024-08-17T02:26:55.506699+0000","last_became_peered":"2024-08-17T02:26:55.506699+0000","last_unstale":"2024-08-17T02:26:56.521840+0000","last_undegraded":"2024-08-17T02:26:56.521840+0000","last_fullsized":"2024-08-17T02:26:56.521840+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:22:22.628820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.514935+0000","last_change":"2024-08-17T02:26:56.510063+0000","last_active":"2024-08-17T02:26:56.514935+0000","last_peered":"2024-08-17T02:26:56.514935+0000","last_clean":"2024-08-17T02:26:56.514935+0000","last_became_active":"2024-08-17T02:26:56.509782+0000","last_became_peered":"2024-08-17T02:26:56.509782+0000","last_unstale":"2024-08-17T02:26:56.514935+0000","last_undegraded":"2024-08-17T02:26:56.514935+0000","last_fullsized":"2024-08-17T02:26:56.514935+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:28:26.831159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.523680+0000","last_change":"2024-08-17T02:26:55.509895+0000","last_active":"2024-08-17T02:26:56.523680+0000","last_peered":"2024-08-17T02:26:56.523680+0000","last_clean":"2024-08-17T02:26:56.523680+0000","last_became_active":"2024-08-17T02:26:55.509392+0000","last_became_peered":"2024-08-17T02:26:55.509392+0000","last_unstale":"2024-08-17T02:26:56.523680+0000","last_undegraded":"2024-08-17T02:26:56.523680+0000","last_fullsized":"2024-08-17T02:26:56.523680+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:16:15.552494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.516120+0000","last_change":"2024-08-17T02:26:56.508192+0000","last_active":"2024-08-17T02:26:56.516120+0000","last_peered":"2024-08-17T02:26:56.516120+0000","last_clean":"2024-08-17T02:26:56.516120+0000","last_became_active":"2024-08-17T02:26:56.507557+0000","last_became_peered":"2024-08-17T02:26:56.507557+0000","last_unstale":"2024-08-17T02:26:56.516120+0000","last_undegraded":"2024-08-17T02:26:56.516120+0000","last_fullsized":"2024-08-17T02:26:56.516120+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:30.373768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.522540+0000","last_change":"2024-08-17T02:26:55.507945+0000","last_active":"2024-08-17T02:26:56.522540+0000","last_peered":"2024-08-17T02:26:56.522540+0000","last_clean":"2024-08-17T02:26:56.522540+0000","last_became_active":"2024-08-17T02:26:55.507602+0000","last_became_peered":"2024-08-17T02:26:55.507602+0000","last_unstale":"2024-08-17T02:26:56.522540+0000","last_undegraded":"2024-08-17T02:26:56.522540+0000","last_fullsized":"2024-08-17T02:26:56.522540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:01:27.787063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.517050+0000","last_change":"2024-08-17T02:26:56.515501+0000","last_active":"2024-08-17T02:26:56.517050+0000","last_peered":"2024-08-17T02:26:56.517050+0000","last_clean":"2024-08-17T02:26:56.517050+0000","last_became_active":"2024-08-17T02:26:56.515264+0000","last_became_peered":"2024-08-17T02:26:56.515264+0000","last_unstale":"2024-08-17T02:26:56.517050+0000","last_undegraded":"2024-08-17T02:26:56.517050+0000","last_fullsized":"2024-08-17T02:26:56.517050+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:44:19.651824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.523464+0000","last_change":"2024-08-17T02:26:55.503376+0000","last_active":"2024-08-17T02:26:56.523464+0000","last_peered":"2024-08-17T02:26:56.523464+0000","last_clean":"2024-08-17T02:26:56.523464+0000","last_became_active":"2024-08-17T02:26:55.503091+0000","last_became_peered":"2024-08-17T02:26:55.503091+0000","last_unstale":"2024-08-17T02:26:56.523464+0000","last_undegraded":"2024-08-17T02:26:56.523464+0000","last_fullsized":"2024-08-17T02:26:56.523464+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:13:55.945519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.501235+0000","last_change":"2024-08-17T02:26:56.498261+0000","last_active":"2024-08-17T02:26:56.501235+0000","last_peered":"2024-08-17T02:26:56.501235+0000","last_clean":"2024-08-17T02:26:56.501235+0000","last_became_active":"2024-08-17T02:26:56.497742+0000","last_became_peered":"2024-08-17T02:26:56.497742+0000","last_unstale":"2024-08-17T02:26:56.501235+0000","last_undegraded":"2024-08-17T02:26:56.501235+0000","last_fullsized":"2024-08-17T02:26:56.501235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:19.840030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.523461+0000","last_change":"2024-08-17T02:26:55.503241+0000","last_active":"2024-08-17T02:26:56.523461+0000","last_peered":"2024-08-17T02:26:56.523461+0000","last_clean":"2024-08-17T02:26:56.523461+0000","last_became_active":"2024-08-17T02:26:55.502412+0000","last_became_peered":"2024-08-17T02:26:55.502412+0000","last_unstale":"2024-08-17T02:26:56.523461+0000","last_undegraded":"2024-08-17T02:26:56.523461+0000","last_fullsized":"2024-08-17T02:26:56.523461+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:01:06.658260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.506204+0000","last_change":"2024-08-17T02:26:56.501044+0000","last_active":"2024-08-17T02:26:56.506204+0000","last_peered":"2024-08-17T02:26:56.506204+0000","last_clean":"2024-08-17T02:26:56.506204+0000","last_became_active":"2024-08-17T02:26:56.500741+0000","last_became_peered":"2024-08-17T02:26:56.500741+0000","last_unstale":"2024-08-17T02:26:56.506204+0000","last_undegraded":"2024-08-17T02:26:56.506204+0000","last_fullsized":"2024-08-17T02:26:56.506204+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:48:01.572551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.503314+0000","last_change":"2024-08-17T02:26:55.504586+0000","last_active":"2024-08-17T02:26:56.503314+0000","last_peered":"2024-08-17T02:26:56.503314+0000","last_clean":"2024-08-17T02:26:56.503314+0000","last_became_active":"2024-08-17T02:26:55.504304+0000","last_became_peered":"2024-08-17T02:26:55.504304+0000","last_unstale":"2024-08-17T02:26:56.503314+0000","last_undegraded":"2024-08-17T02:26:56.503314+0000","last_fullsized":"2024-08-17T02:26:56.503314+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:35:57.933273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.515959+0000","last_change":"2024-08-17T02:26:56.507641+0000","last_active":"2024-08-17T02:26:56.515959+0000","last_peered":"2024-08-17T02:26:56.515959+0000","last_clean":"2024-08-17T02:26:56.515959+0000","last_became_active":"2024-08-17T02:26:56.507305+0000","last_became_peered":"2024-08-17T02:26:56.507305+0000","last_unstale":"2024-08-17T02:26:56.515959+0000","last_undegraded":"2024-08-17T02:26:56.515959+0000","last_fullsized":"2024-08-17T02:26:56.515959+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:27:22.505326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.494536+0000","last_change":"2024-08-17T02:26:55.502499+0000","last_active":"2024-08-17T02:26:56.494536+0000","last_peered":"2024-08-17T02:26:56.494536+0000","last_clean":"2024-08-17T02:26:56.494536+0000","last_became_active":"2024-08-17T02:26:55.502231+0000","last_became_peered":"2024-08-17T02:26:55.502231+0000","last_unstale":"2024-08-17T02:26:56.494536+0000","last_undegraded":"2024-08-17T02:26:56.494536+0000","last_fullsized":"2024-08-17T02:26:56.494536+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:40:32.839187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.511829+0000","last_change":"2024-08-17T02:26:56.505430+0000","last_active":"2024-08-17T02:26:56.511829+0000","last_peered":"2024-08-17T02:26:56.511829+0000","last_clean":"2024-08-17T02:26:56.511829+0000","last_became_active":"2024-08-17T02:26:56.505152+0000","last_became_peered":"2024-08-17T02:26:56.505152+0000","last_unstale":"2024-08-17T02:26:56.511829+0000","last_undegraded":"2024-08-17T02:26:56.511829+0000","last_fullsized":"2024-08-17T02:26:56.511829+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:36:24.386265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.503546+0000","last_change":"2024-08-17T02:26:55.507581+0000","last_active":"2024-08-17T02:26:56.503546+0000","last_peered":"2024-08-17T02:26:56.503546+0000","last_clean":"2024-08-17T02:26:56.503546+0000","last_became_active":"2024-08-17T02:26:55.507308+0000","last_became_peered":"2024-08-17T02:26:55.507308+0000","last_unstale":"2024-08-17T02:26:56.503546+0000","last_undegraded":"2024-08-17T02:26:56.503546+0000","last_fullsized":"2024-08-17T02:26:56.503546+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:48:00.563628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.519450+0000","last_change":"2024-08-17T02:26:56.514111+0000","last_active":"2024-08-17T02:26:56.519450+0000","last_peered":"2024-08-17T02:26:56.519450+0000","last_clean":"2024-08-17T02:26:56.519450+0000","last_became_active":"2024-08-17T02:26:56.513745+0000","last_became_peered":"2024-08-17T02:26:56.513745+0000","last_unstale":"2024-08-17T02:26:56.519450+0000","last_undegraded":"2024-08-17T02:26:56.519450+0000","last_fullsized":"2024-08-17T02:26:56.519450+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:02:33.781784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.490201+0000","last_change":"2024-08-17T02:26:55.510779+0000","last_active":"2024-08-17T02:26:56.490201+0000","last_peered":"2024-08-17T02:26:56.490201+0000","last_clean":"2024-08-17T02:26:56.490201+0000","last_became_active":"2024-08-17T02:26:55.510468+0000","last_became_peered":"2024-08-17T02:26:55.510468+0000","last_unstale":"2024-08-17T02:26:56.490201+0000","last_undegraded":"2024-08-17T02:26:56.490201+0000","last_fullsized":"2024-08-17T02:26:56.490201+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:52.071816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.521038+0000","last_change":"2024-08-17T02:26:56.513222+0000","last_active":"2024-08-17T02:26:56.521038+0000","last_peered":"2024-08-17T02:26:56.521038+0000","last_clean":"2024-08-17T02:26:56.521038+0000","last_became_active":"2024-08-17T02:26:56.512920+0000","last_became_peered":"2024-08-17T02:26:56.512920+0000","last_unstale":"2024-08-17T02:26:56.521038+0000","last_undegraded":"2024-08-17T02:26:56.521038+0000","last_fullsized":"2024-08-17T02:26:56.521038+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:09:25.912935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.520589+0000","last_change":"2024-08-17T02:26:55.503127+0000","last_active":"2024-08-17T02:26:56.520589+0000","last_peered":"2024-08-17T02:26:56.520589+0000","last_clean":"2024-08-17T02:26:56.520589+0000","last_became_active":"2024-08-17T02:26:55.502612+0000","last_became_peered":"2024-08-17T02:26:55.502612+0000","last_unstale":"2024-08-17T02:26:56.520589+0000","last_undegraded":"2024-08-17T02:26:56.520589+0000","last_fullsized":"2024-08-17T02:26:56.520589+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:02.030073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.513049+0000","last_change":"2024-08-17T02:26:56.508668+0000","last_active":"2024-08-17T02:26:56.513049+0000","last_peered":"2024-08-17T02:26:56.513049+0000","last_clean":"2024-08-17T02:26:56.513049+0000","last_became_active":"2024-08-17T02:26:56.508398+0000","last_became_peered":"2024-08-17T02:26:56.508398+0000","last_unstale":"2024-08-17T02:26:56.513049+0000","last_undegraded":"2024-08-17T02:26:56.513049+0000","last_fullsized":"2024-08-17T02:26:56.513049+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:57:09.592985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.526763+0000","last_change":"2024-08-17T02:26:55.509756+0000","last_active":"2024-08-17T02:26:56.526763+0000","last_peered":"2024-08-17T02:26:56.526763+0000","last_clean":"2024-08-17T02:26:56.526763+0000","last_became_active":"2024-08-17T02:26:55.509332+0000","last_became_peered":"2024-08-17T02:26:55.509332+0000","last_unstale":"2024-08-17T02:26:56.526763+0000","last_undegraded":"2024-08-17T02:26:56.526763+0000","last_fullsized":"2024-08-17T02:26:56.526763+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:44:15.902114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.512784+0000","last_change":"2024-08-17T02:26:56.504124+0000","last_active":"2024-08-17T02:26:56.512784+0000","last_peered":"2024-08-17T02:26:56.512784+0000","last_clean":"2024-08-17T02:26:56.512784+0000","last_became_active":"2024-08-17T02:26:56.503769+0000","last_became_peered":"2024-08-17T02:26:56.503769+0000","last_unstale":"2024-08-17T02:26:56.512784+0000","last_undegraded":"2024-08-17T02:26:56.512784+0000","last_fullsized":"2024-08-17T02:26:56.512784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:28:26.831159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.522020+0000","last_change":"2024-08-17T02:26:55.501614+0000","last_active":"2024-08-17T02:26:56.522020+0000","last_peered":"2024-08-17T02:26:56.522020+0000","last_clean":"2024-08-17T02:26:56.522020+0000","last_became_active":"2024-08-17T02:26:55.501293+0000","last_became_peered":"2024-08-17T02:26:55.501293+0000","last_unstale":"2024-08-17T02:26:56.522020+0000","last_undegraded":"2024-08-17T02:26:56.522020+0000","last_fullsized":"2024-08-17T02:26:56.522020+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:00:37.532319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.505245+0000","last_change":"2024-08-17T02:26:56.501262+0000","last_active":"2024-08-17T02:26:56.505245+0000","last_peered":"2024-08-17T02:26:56.505245+0000","last_clean":"2024-08-17T02:26:56.505245+0000","last_became_active":"2024-08-17T02:26:56.500188+0000","last_became_peered":"2024-08-17T02:26:56.500188+0000","last_unstale":"2024-08-17T02:26:56.505245+0000","last_undegraded":"2024-08-17T02:26:56.505245+0000","last_fullsized":"2024-08-17T02:26:56.505245+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:58:16.013165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.496856+0000","last_change":"2024-08-17T02:26:55.505842+0000","last_active":"2024-08-17T02:26:56.496856+0000","last_peered":"2024-08-17T02:26:56.496856+0000","last_clean":"2024-08-17T02:26:56.496856+0000","last_became_active":"2024-08-17T02:26:55.505423+0000","last_became_peered":"2024-08-17T02:26:55.505423+0000","last_unstale":"2024-08-17T02:26:56.496856+0000","last_undegraded":"2024-08-17T02:26:56.496856+0000","last_fullsized":"2024-08-17T02:26:56.496856+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:13:55.945519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.518235+0000","last_change":"2024-08-17T02:26:56.516821+0000","last_active":"2024-08-17T02:26:56.518235+0000","last_peered":"2024-08-17T02:26:56.518235+0000","last_clean":"2024-08-17T02:26:56.518235+0000","last_became_active":"2024-08-17T02:26:56.516534+0000","last_became_peered":"2024-08-17T02:26:56.516534+0000","last_unstale":"2024-08-17T02:26:56.518235+0000","last_undegraded":"2024-08-17T02:26:56.518235+0000","last_fullsized":"2024-08-17T02:26:56.518235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:54:21.155990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.503011+0000","last_change":"2024-08-17T02:26:55.506968+0000","last_active":"2024-08-17T02:26:56.503011+0000","last_peered":"2024-08-17T02:26:56.503011+0000","last_clean":"2024-08-17T02:26:56.503011+0000","last_became_active":"2024-08-17T02:26:55.506538+0000","last_became_peered":"2024-08-17T02:26:55.506538+0000","last_unstale":"2024-08-17T02:26:56.503011+0000","last_undegraded":"2024-08-17T02:26:56.503011+0000","last_fullsized":"2024-08-17T02:26:56.503011+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:28:25.822235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.510981+0000","last_change":"2024-08-17T02:26:56.504146+0000","last_active":"2024-08-17T02:26:56.510981+0000","last_peered":"2024-08-17T02:26:56.510981+0000","last_clean":"2024-08-17T02:26:56.510981+0000","last_became_active":"2024-08-17T02:26:56.502418+0000","last_became_peered":"2024-08-17T02:26:56.502418+0000","last_unstale":"2024-08-17T02:26:56.510981+0000","last_undegraded":"2024-08-17T02:26:56.510981+0000","last_fullsized":"2024-08-17T02:26:56.510981+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:28:26.831159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.525189+0000","last_change":"2024-08-17T02:26:55.512067+0000","last_active":"2024-08-17T02:26:56.525189+0000","last_peered":"2024-08-17T02:26:56.525189+0000","last_clean":"2024-08-17T02:26:56.525189+0000","last_became_active":"2024-08-17T02:26:55.511805+0000","last_became_peered":"2024-08-17T02:26:55.511805+0000","last_unstale":"2024-08-17T02:26:56.525189+0000","last_undegraded":"2024-08-17T02:26:56.525189+0000","last_fullsized":"2024-08-17T02:26:56.525189+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:29.364844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.506368+0000","last_change":"2024-08-17T02:26:56.501193+0000","last_active":"2024-08-17T02:26:56.506368+0000","last_peered":"2024-08-17T02:26:56.506368+0000","last_clean":"2024-08-17T02:26:56.506368+0000","last_became_active":"2024-08-17T02:26:56.500886+0000","last_became_peered":"2024-08-17T02:26:56.500886+0000","last_unstale":"2024-08-17T02:26:56.506368+0000","last_undegraded":"2024-08-17T02:26:56.506368+0000","last_fullsized":"2024-08-17T02:26:56.506368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:16:16.561417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.524682+0000","last_change":"2024-08-17T02:26:55.511100+0000","last_active":"2024-08-17T02:26:56.524682+0000","last_peered":"2024-08-17T02:26:56.524682+0000","last_clean":"2024-08-17T02:26:56.524682+0000","last_became_active":"2024-08-17T02:26:55.510807+0000","last_became_peered":"2024-08-17T02:26:55.510807+0000","last_unstale":"2024-08-17T02:26:56.524682+0000","last_undegraded":"2024-08-17T02:26:56.524682+0000","last_fullsized":"2024-08-17T02:26:56.524682+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:06:33.618043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.511071+0000","last_change":"2024-08-17T02:26:56.501953+0000","last_active":"2024-08-17T02:26:56.511071+0000","last_peered":"2024-08-17T02:26:56.511071+0000","last_clean":"2024-08-17T02:26:56.511071+0000","last_became_active":"2024-08-17T02:26:56.501693+0000","last_became_peered":"2024-08-17T02:26:56.501693+0000","last_unstale":"2024-08-17T02:26:56.511071+0000","last_undegraded":"2024-08-17T02:26:56.511071+0000","last_fullsized":"2024-08-17T02:26:56.511071+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:08:46.053249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.521623+0000","last_change":"2024-08-17T02:26:55.501905+0000","last_active":"2024-08-17T02:26:56.521623+0000","last_peered":"2024-08-17T02:26:56.521623+0000","last_clean":"2024-08-17T02:26:56.521623+0000","last_became_active":"2024-08-17T02:26:55.501640+0000","last_became_peered":"2024-08-17T02:26:55.501640+0000","last_unstale":"2024-08-17T02:26:56.521623+0000","last_undegraded":"2024-08-17T02:26:56.521623+0000","last_fullsized":"2024-08-17T02:26:56.521623+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:59:56.904293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.516289+0000","last_change":"2024-08-17T02:26:56.507948+0000","last_active":"2024-08-17T02:26:56.516289+0000","last_peered":"2024-08-17T02:26:56.516289+0000","last_clean":"2024-08-17T02:26:56.516289+0000","last_became_active":"2024-08-17T02:26:56.507616+0000","last_became_peered":"2024-08-17T02:26:56.507616+0000","last_unstale":"2024-08-17T02:26:56.516289+0000","last_undegraded":"2024-08-17T02:26:56.516289+0000","last_fullsized":"2024-08-17T02:26:56.516289+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:28.514977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.521659+0000","last_change":"2024-08-17T02:26:55.500328+0000","last_active":"2024-08-17T02:26:56.521659+0000","last_peered":"2024-08-17T02:26:56.521659+0000","last_clean":"2024-08-17T02:26:56.521659+0000","last_became_active":"2024-08-17T02:26:55.499943+0000","last_became_peered":"2024-08-17T02:26:55.499943+0000","last_unstale":"2024-08-17T02:26:56.521659+0000","last_undegraded":"2024-08-17T02:26:56.521659+0000","last_fullsized":"2024-08-17T02:26:56.521659+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:15:19.285394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.512383+0000","last_change":"2024-08-17T02:26:56.512383+0000","last_active":"2024-08-17T02:26:56.512383+0000","last_peered":"2024-08-17T02:26:56.512383+0000","last_clean":"2024-08-17T02:26:56.512383+0000","last_became_active":"2024-08-17T02:26:56.512065+0000","last_became_peered":"2024-08-17T02:26:56.512065+0000","last_unstale":"2024-08-17T02:26:56.512383+0000","last_undegraded":"2024-08-17T02:26:56.512383+0000","last_fullsized":"2024-08-17T02:26:56.512383+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:22:23.637744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.490422+0000","last_change":"2024-08-17T02:26:55.502619+0000","last_active":"2024-08-17T02:26:56.490422+0000","last_peered":"2024-08-17T02:26:56.490422+0000","last_clean":"2024-08-17T02:26:56.490422+0000","last_became_active":"2024-08-17T02:26:55.502330+0000","last_became_peered":"2024-08-17T02:26:55.502330+0000","last_unstale":"2024-08-17T02:26:56.490422+0000","last_undegraded":"2024-08-17T02:26:56.490422+0000","last_fullsized":"2024-08-17T02:26:56.490422+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:36:55.966696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.507536+0000","last_change":"2024-08-17T02:26:56.507536+0000","last_active":"2024-08-17T02:26:56.507536+0000","last_peered":"2024-08-17T02:26:56.507536+0000","last_clean":"2024-08-17T02:26:56.507536+0000","last_became_active":"2024-08-17T02:26:56.507281+0000","last_became_peered":"2024-08-17T02:26:56.507281+0000","last_unstale":"2024-08-17T02:26:56.507536+0000","last_undegraded":"2024-08-17T02:26:56.507536+0000","last_fullsized":"2024-08-17T02:26:56.507536+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:32:28.900466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.522429+0000","last_change":"2024-08-17T02:26:55.507958+0000","last_active":"2024-08-17T02:26:56.522429+0000","last_peered":"2024-08-17T02:26:56.522429+0000","last_clean":"2024-08-17T02:26:56.522429+0000","last_became_active":"2024-08-17T02:26:55.507685+0000","last_became_peered":"2024-08-17T02:26:55.507685+0000","last_unstale":"2024-08-17T02:26:56.522429+0000","last_undegraded":"2024-08-17T02:26:56.522429+0000","last_fullsized":"2024-08-17T02:26:56.522429+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:09:19.371240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.502800+0000","last_change":"2024-08-17T02:26:56.502800+0000","last_active":"2024-08-17T02:26:56.502800+0000","last_peered":"2024-08-17T02:26:56.502800+0000","last_clean":"2024-08-17T02:26:56.502800+0000","last_became_active":"2024-08-17T02:26:56.502483+0000","last_became_peered":"2024-08-17T02:26:56.502483+0000","last_unstale":"2024-08-17T02:26:56.502800+0000","last_undegraded":"2024-08-17T02:26:56.502800+0000","last_fullsized":"2024-08-17T02:26:56.502800+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:10.190201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.495989+0000","last_change":"2024-08-17T02:26:55.509045+0000","last_active":"2024-08-17T02:26:56.495989+0000","last_peered":"2024-08-17T02:26:56.495989+0000","last_clean":"2024-08-17T02:26:56.495989+0000","last_became_active":"2024-08-17T02:26:55.508832+0000","last_became_peered":"2024-08-17T02:26:55.508832+0000","last_unstale":"2024-08-17T02:26:56.495989+0000","last_undegraded":"2024-08-17T02:26:56.495989+0000","last_fullsized":"2024-08-17T02:26:56.495989+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:40:57.362649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.505739+0000","last_change":"2024-08-17T02:26:56.505739+0000","last_active":"2024-08-17T02:26:56.505739+0000","last_peered":"2024-08-17T02:26:56.505739+0000","last_clean":"2024-08-17T02:26:56.505739+0000","last_became_active":"2024-08-17T02:26:56.504767+0000","last_became_peered":"2024-08-17T02:26:56.504767+0000","last_unstale":"2024-08-17T02:26:56.505739+0000","last_undegraded":"2024-08-17T02:26:56.505739+0000","last_fullsized":"2024-08-17T02:26:56.505739+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:08:21.329290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.490594+0000","last_change":"2024-08-17T02:26:55.507441+0000","last_active":"2024-08-17T02:26:56.490594+0000","last_peered":"2024-08-17T02:26:56.490594+0000","last_clean":"2024-08-17T02:26:56.490594+0000","last_became_active":"2024-08-17T02:26:55.507190+0000","last_became_peered":"2024-08-17T02:26:55.507190+0000","last_unstale":"2024-08-17T02:26:56.490594+0000","last_undegraded":"2024-08-17T02:26:56.490594+0000","last_fullsized":"2024-08-17T02:26:56.490594+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:05:59.431259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.512237+0000","last_change":"2024-08-17T02:26:56.507880+0000","last_active":"2024-08-17T02:26:56.512237+0000","last_peered":"2024-08-17T02:26:56.512237+0000","last_clean":"2024-08-17T02:26:56.512237+0000","last_became_active":"2024-08-17T02:26:56.507607+0000","last_became_peered":"2024-08-17T02:26:56.507607+0000","last_unstale":"2024-08-17T02:26:56.512237+0000","last_undegraded":"2024-08-17T02:26:56.512237+0000","last_fullsized":"2024-08-17T02:26:56.512237+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:24.429926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.493428+0000","last_change":"2024-08-17T02:26:55.506450+0000","last_active":"2024-08-17T02:26:56.493428+0000","last_peered":"2024-08-17T02:26:56.493428+0000","last_clean":"2024-08-17T02:26:56.493428+0000","last_became_active":"2024-08-17T02:26:55.506180+0000","last_became_peered":"2024-08-17T02:26:55.506180+0000","last_unstale":"2024-08-17T02:26:56.493428+0000","last_undegraded":"2024-08-17T02:26:56.493428+0000","last_fullsized":"2024-08-17T02:26:56.493428+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:46:59.819375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.502457+0000","last_change":"2024-08-17T02:26:56.502457+0000","last_active":"2024-08-17T02:26:56.502457+0000","last_peered":"2024-08-17T02:26:56.502457+0000","last_clean":"2024-08-17T02:26:56.502457+0000","last_became_active":"2024-08-17T02:26:56.502186+0000","last_became_peered":"2024-08-17T02:26:56.502186+0000","last_unstale":"2024-08-17T02:26:56.502457+0000","last_undegraded":"2024-08-17T02:26:56.502457+0000","last_fullsized":"2024-08-17T02:26:56.502457+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:51:27.506000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.522021+0000","last_change":"2024-08-17T02:26:55.505720+0000","last_active":"2024-08-17T02:26:56.522021+0000","last_peered":"2024-08-17T02:26:56.522021+0000","last_clean":"2024-08-17T02:26:56.522021+0000","last_became_active":"2024-08-17T02:26:55.505391+0000","last_became_peered":"2024-08-17T02:26:55.505391+0000","last_unstale":"2024-08-17T02:26:56.522021+0000","last_undegraded":"2024-08-17T02:26:56.522021+0000","last_fullsized":"2024-08-17T02:26:56.522021+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:36:55.966696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.512942+0000","last_change":"2024-08-17T02:26:56.508150+0000","last_active":"2024-08-17T02:26:56.512942+0000","last_peered":"2024-08-17T02:26:56.512942+0000","last_clean":"2024-08-17T02:26:56.512942+0000","last_became_active":"2024-08-17T02:26:56.507862+0000","last_became_peered":"2024-08-17T02:26:56.507862+0000","last_unstale":"2024-08-17T02:26:56.512942+0000","last_undegraded":"2024-08-17T02:26:56.512942+0000","last_fullsized":"2024-08-17T02:26:56.512942+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:44:19.651824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.490193+0000","last_change":"2024-08-17T02:26:55.508312+0000","last_active":"2024-08-17T02:26:56.490193+0000","last_peered":"2024-08-17T02:26:56.490193+0000","last_clean":"2024-08-17T02:26:56.490193+0000","last_became_active":"2024-08-17T02:26:55.507656+0000","last_became_peered":"2024-08-17T02:26:55.507656+0000","last_unstale":"2024-08-17T02:26:56.490193+0000","last_undegraded":"2024-08-17T02:26:56.490193+0000","last_fullsized":"2024-08-17T02:26:56.490193+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:44:12.743421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.513385+0000","last_change":"2024-08-17T02:26:56.508533+0000","last_active":"2024-08-17T02:26:56.513385+0000","last_peered":"2024-08-17T02:26:56.513385+0000","last_clean":"2024-08-17T02:26:56.513385+0000","last_became_active":"2024-08-17T02:26:56.508204+0000","last_became_peered":"2024-08-17T02:26:56.508204+0000","last_unstale":"2024-08-17T02:26:56.513385+0000","last_undegraded":"2024-08-17T02:26:56.513385+0000","last_fullsized":"2024-08-17T02:26:56.513385+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:36:13.643339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.497627+0000","last_change":"2024-08-17T02:26:55.506867+0000","last_active":"2024-08-17T02:26:56.497627+0000","last_peered":"2024-08-17T02:26:56.497627+0000","last_clean":"2024-08-17T02:26:56.497627+0000","last_became_active":"2024-08-17T02:26:55.506609+0000","last_became_peered":"2024-08-17T02:26:55.506609+0000","last_unstale":"2024-08-17T02:26:56.497627+0000","last_undegraded":"2024-08-17T02:26:56.497627+0000","last_fullsized":"2024-08-17T02:26:56.497627+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:15:19.285394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.511764+0000","last_change":"2024-08-17T02:26:56.507224+0000","last_active":"2024-08-17T02:26:56.511764+0000","last_peered":"2024-08-17T02:26:56.511764+0000","last_clean":"2024-08-17T02:26:56.511764+0000","last_became_active":"2024-08-17T02:26:56.506935+0000","last_became_peered":"2024-08-17T02:26:56.506935+0000","last_unstale":"2024-08-17T02:26:56.511764+0000","last_undegraded":"2024-08-17T02:26:56.511764+0000","last_fullsized":"2024-08-17T02:26:56.511764+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:27:22.505326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.489052+0000","last_change":"2024-08-17T02:26:55.507386+0000","last_active":"2024-08-17T02:26:56.489052+0000","last_peered":"2024-08-17T02:26:56.489052+0000","last_clean":"2024-08-17T02:26:56.489052+0000","last_became_active":"2024-08-17T02:26:55.506685+0000","last_became_peered":"2024-08-17T02:26:55.506685+0000","last_unstale":"2024-08-17T02:26:56.489052+0000","last_undegraded":"2024-08-17T02:26:56.489052+0000","last_fullsized":"2024-08-17T02:26:56.489052+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:09.181278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.505198+0000","last_change":"2024-08-17T02:26:56.501044+0000","last_active":"2024-08-17T02:26:56.505198+0000","last_peered":"2024-08-17T02:26:56.505198+0000","last_clean":"2024-08-17T02:26:56.505198+0000","last_became_active":"2024-08-17T02:26:56.500870+0000","last_became_peered":"2024-08-17T02:26:56.500870+0000","last_unstale":"2024-08-17T02:26:56.505198+0000","last_undegraded":"2024-08-17T02:26:56.505198+0000","last_fullsized":"2024-08-17T02:26:56.505198+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:00:55.548498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.497038+0000","last_change":"2024-08-17T02:26:55.506109+0000","last_active":"2024-08-17T02:26:56.497038+0000","last_peered":"2024-08-17T02:26:56.497038+0000","last_clean":"2024-08-17T02:26:56.497038+0000","last_became_active":"2024-08-17T02:26:55.505082+0000","last_became_peered":"2024-08-17T02:26:55.505082+0000","last_unstale":"2024-08-17T02:26:56.497038+0000","last_undegraded":"2024-08-17T02:26:56.497038+0000","last_fullsized":"2024-08-17T02:26:56.497038+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:05:59.431259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.510758+0000","last_change":"2024-08-17T02:26:56.509408+0000","last_active":"2024-08-17T02:26:56.510758+0000","last_peered":"2024-08-17T02:26:56.510758+0000","last_clean":"2024-08-17T02:26:56.510758+0000","last_became_active":"2024-08-17T02:26:56.509019+0000","last_became_peered":"2024-08-17T02:26:56.509019+0000","last_unstale":"2024-08-17T02:26:56.510758+0000","last_undegraded":"2024-08-17T02:26:56.510758+0000","last_fullsized":"2024-08-17T02:26:56.510758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:33:02.969932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.490836+0000","last_change":"2024-08-17T02:26:55.504495+0000","last_active":"2024-08-17T02:26:56.490836+0000","last_peered":"2024-08-17T02:26:56.490836+0000","last_clean":"2024-08-17T02:26:56.490836+0000","last_became_active":"2024-08-17T02:26:55.504220+0000","last_became_peered":"2024-08-17T02:26:55.504220+0000","last_unstale":"2024-08-17T02:26:56.490836+0000","last_undegraded":"2024-08-17T02:26:56.490836+0000","last_fullsized":"2024-08-17T02:26:56.490836+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:54:01.459162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.511022+0000","last_change":"2024-08-17T02:26:56.503333+0000","last_active":"2024-08-17T02:26:56.511022+0000","last_peered":"2024-08-17T02:26:56.511022+0000","last_clean":"2024-08-17T02:26:56.511022+0000","last_became_active":"2024-08-17T02:26:56.502968+0000","last_became_peered":"2024-08-17T02:26:56.502968+0000","last_unstale":"2024-08-17T02:26:56.511022+0000","last_undegraded":"2024-08-17T02:26:56.511022+0000","last_fullsized":"2024-08-17T02:26:56.511022+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:28.514977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.503207+0000","last_change":"2024-08-17T02:26:55.510057+0000","last_active":"2024-08-17T02:26:56.503207+0000","last_peered":"2024-08-17T02:26:56.503207+0000","last_clean":"2024-08-17T02:26:56.503207+0000","last_became_active":"2024-08-17T02:26:55.509765+0000","last_became_peered":"2024-08-17T02:26:55.509765+0000","last_unstale":"2024-08-17T02:26:56.503207+0000","last_undegraded":"2024-08-17T02:26:56.503207+0000","last_fullsized":"2024-08-17T02:26:56.503207+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:27:21.496402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.513838+0000","last_change":"2024-08-17T02:26:56.512025+0000","last_active":"2024-08-17T02:26:56.513838+0000","last_peered":"2024-08-17T02:26:56.513838+0000","last_clean":"2024-08-17T02:26:56.513838+0000","last_became_active":"2024-08-17T02:26:56.511691+0000","last_became_peered":"2024-08-17T02:26:56.511691+0000","last_unstale":"2024-08-17T02:26:56.513838+0000","last_undegraded":"2024-08-17T02:26:56.513838+0000","last_fullsized":"2024-08-17T02:26:56.513838+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:28.514977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.494885+0000","last_change":"2024-08-17T02:26:55.505418+0000","last_active":"2024-08-17T02:26:56.494885+0000","last_peered":"2024-08-17T02:26:56.494885+0000","last_clean":"2024-08-17T02:26:56.494885+0000","last_became_active":"2024-08-17T02:26:55.505074+0000","last_became_peered":"2024-08-17T02:26:55.505074+0000","last_unstale":"2024-08-17T02:26:56.494885+0000","last_undegraded":"2024-08-17T02:26:56.494885+0000","last_fullsized":"2024-08-17T02:26:56.494885+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:22:28.708889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":172,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.505603+0000","last_change":"2024-08-17T02:26:00.033569+0000","last_active":"2024-08-17T02:26:56.505603+0000","last_peered":"2024-08-17T02:26:56.505603+0000","last_clean":"2024-08-17T02:26:56.505603+0000","last_became_active":"2024-08-17T02:26:00.031512+0000","last_became_peered":"2024-08-17T02:26:00.031512+0000","last_unstale":"2024-08-17T02:26:56.505603+0000","last_undegraded":"2024-08-17T02:26:56.505603+0000","last_fullsized":"2024-08-17T02:26:56.505603+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:58.643690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:58.643690+0000","last_clean_scrub_stamp":"2024-08-17T02:25:58.643690+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:47:24.121981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509456,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298288,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073552,"statfs":{"total":96636764160,"available":96331317248,"internally_reserved":0,"allocated":950272,"data_stored":725185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3380000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]}]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297708,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074132,"statfs":{"total":96636764160,"available":96331911168,"internally_reserved":0,"allocated":360448,"data_stored":135331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2509999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509455,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297708,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074132,"statfs":{"total":96636764160,"available":96331911168,"internally_reserved":0,"allocated":360448,"data_stored":135387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2689999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]}]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297708,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074132,"statfs":{"total":96636764160,"available":96331911168,"internally_reserved":0,"allocated":360448,"data_stored":134831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]}]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297712,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074128,"statfs":{"total":96636764160,"available":96331907072,"internally_reserved":0,"allocated":356352,"data_stored":130013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5760000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.798}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.0899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5029999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.831}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]}]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":368640,"data_stored":136301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542160,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297692,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074148,"statfs":{"total":96636764160,"available":96331927552,"internally_reserved":0,"allocated":344064,"data_stored":128509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542160,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298284,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073556,"statfs":{"total":96636764160,"available":96331321344,"internally_reserved":0,"allocated":946176,"data_stored":725095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:27:00.526 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:27:00.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.625+0000 7f7c70dba700 1 Processor -- start 2024-08-17T02:27:00.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.625+0000 7f7c70dba700 1 -- start start 2024-08-17T02:27:00.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.625+0000 7f7c70dba700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7c6c142890 0x7f7c6c0cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.625+0000 7f7c70dba700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c6c0cc800 con 0x7f7c6c142c60 2024-08-17T02:27:00.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.625+0000 7f7c70dba700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c6c0cbbf0 con 0x7f7c6c15d5b0 2024-08-17T02:27:00.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.625+0000 7f7c70dba700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c6c0cbed0 con 0x7f7c6c142890 2024-08-17T02:27:00.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.625+0000 7f7c6a59c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7c6c142890 0x7f7c6c0cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.625+0000 7f7c69d9b700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f7c6c142c60 0x7f7c6c15cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50894/0 (socket says 172.21.15.153:50894) 2024-08-17T02:27:00.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.625+0000 7f7c69d9b700 1 -- 172.21.15.153:0/3758473659 learned_addr learned my addr 172.21.15.153:0/3758473659 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:27:00.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.629+0000 7f7c6959a700 1 -- 172.21.15.153:0/3758473659 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1781550379 0 0) 0x7f7c6c0cbbf0 con 0x7f7c6c15d5b0 2024-08-17T02:27:00.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.629+0000 7f7c6959a700 1 -- 172.21.15.153:0/3758473659 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c54003570 con 0x7f7c6c15d5b0 2024-08-17T02:27:00.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.629+0000 7f7c6a59c700 1 -- 172.21.15.153:0/3758473659 >> v1:172.21.15.174:6789/0 conn(0x7f7c6c15d5b0 legacy=0x7f7c6c0b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.629+0000 7f7c6a59c700 1 -- 172.21.15.153:0/3758473659 >> v1:172.21.15.153:6789/0 conn(0x7f7c6c142c60 legacy=0x7f7c6c15cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.629+0000 7f7c6959a700 1 -- 172.21.15.153:0/3758473659 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 528226757 0 0) 0x7f7c6c0cc800 con 0x7f7c6c142c60 2024-08-17T02:27:00.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.629+0000 7f7c6a59c700 1 -- 172.21.15.153:0/3758473659 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6c0cc1b0 con 0x7f7c6c142890 2024-08-17T02:27:00.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.629+0000 7f7c6a59c700 1 --2- 172.21.15.153:0/3758473659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c6c142890 0x7f7c6c0cb0a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c009910 tx=0x7f7c5c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c36f98da197d15f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.629+0000 7f7c6959a700 1 -- 172.21.15.153:0/3758473659 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c00b640 con 0x7f7c6c142890 2024-08-17T02:27:00.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.629+0000 7f7c6959a700 1 -- 172.21.15.153:0/3758473659 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5c00b7a0 con 0x7f7c6c142890 2024-08-17T02:27:00.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.629+0000 7f7c6959a700 1 -- 172.21.15.153:0/3758473659 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c00bb20 con 0x7f7c6c142890 2024-08-17T02:27:00.633 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.629+0000 7f7c70dba700 1 -- 172.21.15.153:0/3758473659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c6c142890 msgr2=0x7f7c6c0cb0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.633 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.629+0000 7f7c70dba700 1 --2- 172.21.15.153:0/3758473659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c6c142890 0x7f7c6c0cb0a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c009910 tx=0x7f7c5c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.633 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.629+0000 7f7c70dba700 1 -- 172.21.15.153:0/3758473659 shutdown_connections 2024-08-17T02:27:00.633 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.629+0000 7f7c70dba700 1 --2- 172.21.15.153:0/3758473659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c6c142890 0x7f7c6c0cb0a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.629+0000 7f7c70dba700 1 -- 172.21.15.153:0/3758473659 >> 172.21.15.153:0/3758473659 conn(0x7f7c6c0a9db0 msgr2=0x7f7c6c0ac1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:00.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.629+0000 7f7c70dba700 1 -- 172.21.15.153:0/3758473659 shutdown_connections 2024-08-17T02:27:00.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.629+0000 7f7c70dba700 1 -- 172.21.15.153:0/3758473659 wait complete. 2024-08-17T02:27:00.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.633+0000 7f7c70dba700 1 Processor -- start 2024-08-17T02:27:00.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.633+0000 7f7c70dba700 1 -- start start 2024-08-17T02:27:00.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.633+0000 7f7c70dba700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c6c142890 0x7f7c6c169ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.633+0000 7f7c70dba700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c6c142c60 0x7f7c6c0acc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.633+0000 7f7c70dba700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c6c15d5b0 0x7f7c6c16c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.633+0000 7f7c70dba700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c169a60 con 0x7f7c6c15d5b0 2024-08-17T02:27:00.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.633+0000 7f7c70dba700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c13f040 con 0x7f7c6c142890 2024-08-17T02:27:00.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.633+0000 7f7c70dba700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c16d4a0 con 0x7f7c6c142c60 2024-08-17T02:27:00.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.633+0000 7f7c6ad9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c6c15d5b0 0x7f7c6c16c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.633+0000 7f7c6ad9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c6c15d5b0 0x7f7c6c16c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59760/0 (socket says 172.21.15.153:59760) 2024-08-17T02:27:00.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.633+0000 7f7c6ad9d700 1 -- 172.21.15.153:0/102690865 learned_addr learned my addr 172.21.15.153:0/102690865 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:27:00.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.633+0000 7f7c6a59c700 1 --2- 172.21.15.153:0/102690865 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c6c142890 0x7f7c6c169ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.633+0000 7f7c69d9b700 1 --2- 172.21.15.153:0/102690865 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c6c142c60 0x7f7c6c0acc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.633+0000 7f7c6ad9d700 1 -- 172.21.15.153:0/102690865 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c6c142c60 msgr2=0x7f7c6c0acc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.633+0000 7f7c6ad9d700 1 --2- 172.21.15.153:0/102690865 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c6c142c60 0x7f7c6c0acc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.633+0000 7f7c6ad9d700 1 -- 172.21.15.153:0/102690865 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c6c142890 msgr2=0x7f7c6c169ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.633+0000 7f7c6ad9d700 1 --2- 172.21.15.153:0/102690865 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c6c142890 0x7f7c6c169ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.633+0000 7f7c6ad9d700 1 -- 172.21.15.153:0/102690865 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5c009420 con 0x7f7c6c15d5b0 2024-08-17T02:27:00.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.633+0000 7f7c6ad9d700 1 --2- 172.21.15.153:0/102690865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c6c15d5b0 0x7f7c6c16c900 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7c6400c910 tx=0x7f7c640027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.633+0000 7f7c5a7fc700 1 -- 172.21.15.153:0/102690865 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c64012630 con 0x7f7c6c15d5b0 2024-08-17T02:27:00.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.633+0000 7f7c5a7fc700 1 -- 172.21.15.153:0/102690865 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c640127b0 con 0x7f7c6c15d5b0 2024-08-17T02:27:00.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.633+0000 7f7c70dba700 1 -- 172.21.15.153:0/102690865 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c6c16d780 con 0x7f7c6c15d5b0 2024-08-17T02:27:00.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.633+0000 7f7c5a7fc700 1 -- 172.21.15.153:0/102690865 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c64012b70 con 0x7f7c6c15d5b0 2024-08-17T02:27:00.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.633+0000 7f7c70dba700 1 -- 172.21.15.153:0/102690865 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c6c1696f0 con 0x7f7c6c15d5b0 2024-08-17T02:27:00.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.637+0000 7f7c70dba700 1 -- 172.21.15.153:0/102690865 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c6c169c10 con 0x7f7c6c15d5b0 2024-08-17T02:27:00.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.637+0000 7f7c5a7fc700 1 -- 172.21.15.153:0/102690865 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7c6401b400 con 0x7f7c6c15d5b0 2024-08-17T02:27:00.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.637+0000 7f7c5a7fc700 1 --2- 172.21.15.153:0/102690865 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7c4c060890 0x7f7c4c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.637+0000 7f7c5a7fc700 1 -- 172.21.15.153:0/102690865 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7c6407ced0 con 0x7f7c6c15d5b0 2024-08-17T02:27:00.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.637+0000 7f7c6a59c700 1 --2- 172.21.15.153:0/102690865 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7c4c060890 0x7f7c4c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.637+0000 7f7c6a59c700 1 --2- 172.21.15.153:0/102690865 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7c4c060890 0x7f7c4c062d40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c0091e0 tx=0x7f7c5c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.641+0000 7f7c5a7fc700 1 -- 172.21.15.153:0/102690865 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f7c6c169c10 con 0x7f7c6c15d5b0 2024-08-17T02:27:00.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.801+0000 7f7c70dba700 1 -- 172.21.15.153:0/102690865 --> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7c6c169c10 con 0x7f7c4c060890 2024-08-17T02:27:00.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.817+0000 7f7c5a7fc700 1 -- 172.21.15.153:0/102690865 <== mgr.4104 v2:172.21.15.153:6832/24147 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264533 (secure 0 0 0) 0x7f7c6c169c10 con 0x7f7c4c060890 2024-08-17T02:27:00.823 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:27:00.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.821+0000 7f7c70dba700 1 -- 172.21.15.153:0/102690865 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7c4c060890 msgr2=0x7f7c4c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.821+0000 7f7c70dba700 1 --2- 172.21.15.153:0/102690865 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7c4c060890 0x7f7c4c062d40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c0091e0 tx=0x7f7c5c017000 comp rx=0 tx=0).stop 2024-08-17T02:27:00.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.821+0000 7f7c70dba700 1 -- 172.21.15.153:0/102690865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c6c15d5b0 msgr2=0x7f7c6c16c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.821+0000 7f7c70dba700 1 --2- 172.21.15.153:0/102690865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c6c15d5b0 0x7f7c6c16c900 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7c6400c910 tx=0x7f7c640027a0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.821+0000 7f7c70dba700 1 -- 172.21.15.153:0/102690865 shutdown_connections 2024-08-17T02:27:00.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.821+0000 7f7c70dba700 1 --2- 172.21.15.153:0/102690865 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7c4c060890 0x7f7c4c062d40 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.821+0000 7f7c70dba700 1 --2- 172.21.15.153:0/102690865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c6c15d5b0 0x7f7c6c16c900 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.821+0000 7f7c70dba700 1 --2- 172.21.15.153:0/102690865 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c6c142c60 0x7f7c6c0acc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.821+0000 7f7c70dba700 1 --2- 172.21.15.153:0/102690865 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c6c142890 0x7f7c6c169ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.821+0000 7f7c70dba700 1 -- 172.21.15.153:0/102690865 >> 172.21.15.153:0/102690865 conn(0x7f7c6c0a9db0 msgr2=0x7f7c6c13fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:00.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.821+0000 7f7c70dba700 1 -- 172.21.15.153:0/102690865 shutdown_connections 2024-08-17T02:27:00.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.821+0000 7f7c70dba700 1 -- 172.21.15.153:0/102690865 wait complete. 2024-08-17T02:27:00.828 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-08-17T02:27:00.838 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-08-17T02:27:00.052255+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":63,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382816,"kb_used_data":3952,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752591904,"statfs":{"total":773094113280,"available":770654109696,"internally_reserved":0,"allocated":4046848,"data_stored":2250652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.578948"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.503403+0000","last_change":"2024-08-17T02:26:56.500846+0000","last_active":"2024-08-17T02:26:56.503403+0000","last_peered":"2024-08-17T02:26:56.503403+0000","last_clean":"2024-08-17T02:26:56.503403+0000","last_became_active":"2024-08-17T02:26:56.500513+0000","last_became_peered":"2024-08-17T02:26:56.500513+0000","last_unstale":"2024-08-17T02:26:56.503403+0000","last_undegraded":"2024-08-17T02:26:56.503403+0000","last_fullsized":"2024-08-17T02:26:56.503403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:30.373768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.509984+0000","last_change":"2024-08-17T02:26:56.505967+0000","last_active":"2024-08-17T02:26:56.509984+0000","last_peered":"2024-08-17T02:26:56.509984+0000","last_clean":"2024-08-17T02:26:56.509984+0000","last_became_active":"2024-08-17T02:26:56.505669+0000","last_became_peered":"2024-08-17T02:26:56.505669+0000","last_unstale":"2024-08-17T02:26:56.509984+0000","last_undegraded":"2024-08-17T02:26:56.509984+0000","last_fullsized":"2024-08-17T02:26:56.509984+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:49:55.402389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.512979+0000","last_change":"2024-08-17T02:26:56.508128+0000","last_active":"2024-08-17T02:26:56.512979+0000","last_peered":"2024-08-17T02:26:56.512979+0000","last_clean":"2024-08-17T02:26:56.512979+0000","last_became_active":"2024-08-17T02:26:56.507740+0000","last_became_peered":"2024-08-17T02:26:56.507740+0000","last_unstale":"2024-08-17T02:26:56.512979+0000","last_undegraded":"2024-08-17T02:26:56.512979+0000","last_fullsized":"2024-08-17T02:26:56.512979+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:10:07.456075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.512847+0000","last_change":"2024-08-17T02:26:56.504331+0000","last_active":"2024-08-17T02:26:56.512847+0000","last_peered":"2024-08-17T02:26:56.512847+0000","last_clean":"2024-08-17T02:26:56.512847+0000","last_became_active":"2024-08-17T02:26:56.504018+0000","last_became_peered":"2024-08-17T02:26:56.504018+0000","last_unstale":"2024-08-17T02:26:56.512847+0000","last_undegraded":"2024-08-17T02:26:56.512847+0000","last_fullsized":"2024-08-17T02:26:56.512847+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:31:39.039987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.505790+0000","last_change":"2024-08-17T02:26:56.505790+0000","last_active":"2024-08-17T02:26:56.505790+0000","last_peered":"2024-08-17T02:26:56.505790+0000","last_clean":"2024-08-17T02:26:56.505790+0000","last_became_active":"2024-08-17T02:26:56.505479+0000","last_became_peered":"2024-08-17T02:26:56.505479+0000","last_unstale":"2024-08-17T02:26:56.505790+0000","last_undegraded":"2024-08-17T02:26:56.505790+0000","last_fullsized":"2024-08-17T02:26:56.505790+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:09:20.380163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.509831+0000","last_change":"2024-08-17T02:26:56.506074+0000","last_active":"2024-08-17T02:26:56.509831+0000","last_peered":"2024-08-17T02:26:56.509831+0000","last_clean":"2024-08-17T02:26:56.509831+0000","last_became_active":"2024-08-17T02:26:56.505836+0000","last_became_peered":"2024-08-17T02:26:56.505836+0000","last_unstale":"2024-08-17T02:26:56.509831+0000","last_undegraded":"2024-08-17T02:26:56.509831+0000","last_fullsized":"2024-08-17T02:26:56.509831+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:24.373874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.513885+0000","last_change":"2024-08-17T02:26:56.512163+0000","last_active":"2024-08-17T02:26:56.513885+0000","last_peered":"2024-08-17T02:26:56.513885+0000","last_clean":"2024-08-17T02:26:56.513885+0000","last_became_active":"2024-08-17T02:26:56.511568+0000","last_became_peered":"2024-08-17T02:26:56.511568+0000","last_unstale":"2024-08-17T02:26:56.513885+0000","last_undegraded":"2024-08-17T02:26:56.513885+0000","last_fullsized":"2024-08-17T02:26:56.513885+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:10:07.456075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.514136+0000","last_change":"2024-08-17T02:26:56.512820+0000","last_active":"2024-08-17T02:26:56.514136+0000","last_peered":"2024-08-17T02:26:56.514136+0000","last_clean":"2024-08-17T02:26:56.514136+0000","last_became_active":"2024-08-17T02:26:56.512181+0000","last_became_peered":"2024-08-17T02:26:56.512181+0000","last_unstale":"2024-08-17T02:26:56.514136+0000","last_undegraded":"2024-08-17T02:26:56.514136+0000","last_fullsized":"2024-08-17T02:26:56.514136+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:09:25.912935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.514583+0000","last_change":"2024-08-17T02:26:56.508601+0000","last_active":"2024-08-17T02:26:56.514583+0000","last_peered":"2024-08-17T02:26:56.514583+0000","last_clean":"2024-08-17T02:26:56.514583+0000","last_became_active":"2024-08-17T02:26:56.508060+0000","last_became_peered":"2024-08-17T02:26:56.508060+0000","last_unstale":"2024-08-17T02:26:56.514583+0000","last_undegraded":"2024-08-17T02:26:56.514583+0000","last_fullsized":"2024-08-17T02:26:56.514583+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:35:58.942197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.516013+0000","last_change":"2024-08-17T02:26:56.509852+0000","last_active":"2024-08-17T02:26:56.516013+0000","last_peered":"2024-08-17T02:26:56.516013+0000","last_clean":"2024-08-17T02:26:56.516013+0000","last_became_active":"2024-08-17T02:26:56.508084+0000","last_became_peered":"2024-08-17T02:26:56.508084+0000","last_unstale":"2024-08-17T02:26:56.516013+0000","last_undegraded":"2024-08-17T02:26:56.516013+0000","last_fullsized":"2024-08-17T02:26:56.516013+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:19.840030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.518338+0000","last_change":"2024-08-17T02:26:56.516813+0000","last_active":"2024-08-17T02:26:56.518338+0000","last_peered":"2024-08-17T02:26:56.518338+0000","last_clean":"2024-08-17T02:26:56.518338+0000","last_became_active":"2024-08-17T02:26:56.516476+0000","last_became_peered":"2024-08-17T02:26:56.516476+0000","last_unstale":"2024-08-17T02:26:56.518338+0000","last_undegraded":"2024-08-17T02:26:56.518338+0000","last_fullsized":"2024-08-17T02:26:56.518338+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:36:24.386265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.513018+0000","last_change":"2024-08-17T02:26:56.509142+0000","last_active":"2024-08-17T02:26:56.513018+0000","last_peered":"2024-08-17T02:26:56.513018+0000","last_clean":"2024-08-17T02:26:56.513018+0000","last_became_active":"2024-08-17T02:26:56.508882+0000","last_became_peered":"2024-08-17T02:26:56.508882+0000","last_unstale":"2024-08-17T02:26:56.513018+0000","last_undegraded":"2024-08-17T02:26:56.513018+0000","last_fullsized":"2024-08-17T02:26:56.513018+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:24.429926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.513857+0000","last_change":"2024-08-17T02:26:56.513857+0000","last_active":"2024-08-17T02:26:56.513857+0000","last_peered":"2024-08-17T02:26:56.513857+0000","last_clean":"2024-08-17T02:26:56.513857+0000","last_became_active":"2024-08-17T02:26:56.513606+0000","last_became_peered":"2024-08-17T02:26:56.513606+0000","last_unstale":"2024-08-17T02:26:56.513857+0000","last_undegraded":"2024-08-17T02:26:56.513857+0000","last_fullsized":"2024-08-17T02:26:56.513857+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:53.080739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.509853+0000","last_change":"2024-08-17T02:26:56.506491+0000","last_active":"2024-08-17T02:26:56.509853+0000","last_peered":"2024-08-17T02:26:56.509853+0000","last_clean":"2024-08-17T02:26:56.509853+0000","last_became_active":"2024-08-17T02:26:56.506176+0000","last_became_peered":"2024-08-17T02:26:56.506176+0000","last_unstale":"2024-08-17T02:26:56.509853+0000","last_undegraded":"2024-08-17T02:26:56.509853+0000","last_fullsized":"2024-08-17T02:26:56.509853+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:22:39.138649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.501204+0000","last_change":"2024-08-17T02:26:56.499445+0000","last_active":"2024-08-17T02:26:56.501204+0000","last_peered":"2024-08-17T02:26:56.501204+0000","last_clean":"2024-08-17T02:26:56.501204+0000","last_became_active":"2024-08-17T02:26:56.498916+0000","last_became_peered":"2024-08-17T02:26:56.498916+0000","last_unstale":"2024-08-17T02:26:56.501204+0000","last_undegraded":"2024-08-17T02:26:56.501204+0000","last_fullsized":"2024-08-17T02:26:56.501204+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:30:12.034768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.514153+0000","last_change":"2024-08-17T02:26:56.512997+0000","last_active":"2024-08-17T02:26:56.514153+0000","last_peered":"2024-08-17T02:26:56.514153+0000","last_clean":"2024-08-17T02:26:56.514153+0000","last_became_active":"2024-08-17T02:26:56.512539+0000","last_became_peered":"2024-08-17T02:26:56.512539+0000","last_unstale":"2024-08-17T02:26:56.514153+0000","last_undegraded":"2024-08-17T02:26:56.514153+0000","last_fullsized":"2024-08-17T02:26:56.514153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:36.857632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.514101+0000","last_change":"2024-08-17T02:26:56.512779+0000","last_active":"2024-08-17T02:26:56.514101+0000","last_peered":"2024-08-17T02:26:56.514101+0000","last_clean":"2024-08-17T02:26:56.514101+0000","last_became_active":"2024-08-17T02:26:56.512448+0000","last_became_peered":"2024-08-17T02:26:56.512448+0000","last_unstale":"2024-08-17T02:26:56.514101+0000","last_undegraded":"2024-08-17T02:26:56.514101+0000","last_fullsized":"2024-08-17T02:26:56.514101+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:19.840030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.519410+0000","last_change":"2024-08-17T02:26:56.514034+0000","last_active":"2024-08-17T02:26:56.519410+0000","last_peered":"2024-08-17T02:26:56.519410+0000","last_clean":"2024-08-17T02:26:56.519410+0000","last_became_active":"2024-08-17T02:26:56.513763+0000","last_became_peered":"2024-08-17T02:26:56.513763+0000","last_unstale":"2024-08-17T02:26:56.519410+0000","last_undegraded":"2024-08-17T02:26:56.519410+0000","last_fullsized":"2024-08-17T02:26:56.519410+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:24:44.395718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.523511+0000","last_change":"2024-08-17T02:26:56.516691+0000","last_active":"2024-08-17T02:26:56.523511+0000","last_peered":"2024-08-17T02:26:56.523511+0000","last_clean":"2024-08-17T02:26:56.523511+0000","last_became_active":"2024-08-17T02:26:56.516329+0000","last_became_peered":"2024-08-17T02:26:56.516329+0000","last_unstale":"2024-08-17T02:26:56.523511+0000","last_undegraded":"2024-08-17T02:26:56.523511+0000","last_fullsized":"2024-08-17T02:26:56.523511+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:54:21.155990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.506413+0000","last_change":"2024-08-17T02:26:56.506413+0000","last_active":"2024-08-17T02:26:56.506413+0000","last_peered":"2024-08-17T02:26:56.506413+0000","last_clean":"2024-08-17T02:26:56.506413+0000","last_became_active":"2024-08-17T02:26:56.506105+0000","last_became_peered":"2024-08-17T02:26:56.506105+0000","last_unstale":"2024-08-17T02:26:56.506413+0000","last_undegraded":"2024-08-17T02:26:56.506413+0000","last_fullsized":"2024-08-17T02:26:56.506413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:44:13.752344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.514300+0000","last_change":"2024-08-17T02:26:56.506245+0000","last_active":"2024-08-17T02:26:56.514300+0000","last_peered":"2024-08-17T02:26:56.514300+0000","last_clean":"2024-08-17T02:26:56.514300+0000","last_became_active":"2024-08-17T02:26:56.505891+0000","last_became_peered":"2024-08-17T02:26:56.505891+0000","last_unstale":"2024-08-17T02:26:56.514300+0000","last_undegraded":"2024-08-17T02:26:56.514300+0000","last_fullsized":"2024-08-17T02:26:56.514300+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:27:22.505326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.511078+0000","last_change":"2024-08-17T02:26:56.504215+0000","last_active":"2024-08-17T02:26:56.511078+0000","last_peered":"2024-08-17T02:26:56.511078+0000","last_clean":"2024-08-17T02:26:56.511078+0000","last_became_active":"2024-08-17T02:26:56.503700+0000","last_became_peered":"2024-08-17T02:26:56.503700+0000","last_unstale":"2024-08-17T02:26:56.511078+0000","last_undegraded":"2024-08-17T02:26:56.511078+0000","last_fullsized":"2024-08-17T02:26:56.511078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:30.373768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.513119+0000","last_change":"2024-08-17T02:26:56.507598+0000","last_active":"2024-08-17T02:26:56.513119+0000","last_peered":"2024-08-17T02:26:56.513119+0000","last_clean":"2024-08-17T02:26:56.513119+0000","last_became_active":"2024-08-17T02:26:56.507328+0000","last_became_peered":"2024-08-17T02:26:56.507328+0000","last_unstale":"2024-08-17T02:26:56.513119+0000","last_undegraded":"2024-08-17T02:26:56.513119+0000","last_fullsized":"2024-08-17T02:26:56.513119+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:54:31.590117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.512069+0000","last_change":"2024-08-17T02:26:56.506886+0000","last_active":"2024-08-17T02:26:56.512069+0000","last_peered":"2024-08-17T02:26:56.512069+0000","last_clean":"2024-08-17T02:26:56.512069+0000","last_became_active":"2024-08-17T02:26:56.506626+0000","last_became_peered":"2024-08-17T02:26:56.506626+0000","last_unstale":"2024-08-17T02:26:56.512069+0000","last_undegraded":"2024-08-17T02:26:56.512069+0000","last_fullsized":"2024-08-17T02:26:56.512069+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:28.514977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.521633+0000","last_change":"2024-08-17T02:26:56.513188+0000","last_active":"2024-08-17T02:26:56.521633+0000","last_peered":"2024-08-17T02:26:56.521633+0000","last_clean":"2024-08-17T02:26:56.521633+0000","last_became_active":"2024-08-17T02:26:56.512889+0000","last_became_peered":"2024-08-17T02:26:56.512889+0000","last_unstale":"2024-08-17T02:26:56.521633+0000","last_undegraded":"2024-08-17T02:26:56.521633+0000","last_fullsized":"2024-08-17T02:26:56.521633+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:16:16.561417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.519389+0000","last_change":"2024-08-17T02:26:56.513205+0000","last_active":"2024-08-17T02:26:56.519389+0000","last_peered":"2024-08-17T02:26:56.519389+0000","last_clean":"2024-08-17T02:26:56.519389+0000","last_became_active":"2024-08-17T02:26:56.512948+0000","last_became_peered":"2024-08-17T02:26:56.512948+0000","last_unstale":"2024-08-17T02:26:56.519389+0000","last_undegraded":"2024-08-17T02:26:56.519389+0000","last_fullsized":"2024-08-17T02:26:56.519389+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:48:30.881665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.516152+0000","last_change":"2024-08-17T02:26:56.510617+0000","last_active":"2024-08-17T02:26:56.516152+0000","last_peered":"2024-08-17T02:26:56.516152+0000","last_clean":"2024-08-17T02:26:56.516152+0000","last_became_active":"2024-08-17T02:26:56.507923+0000","last_became_peered":"2024-08-17T02:26:56.507923+0000","last_unstale":"2024-08-17T02:26:56.516152+0000","last_undegraded":"2024-08-17T02:26:56.516152+0000","last_fullsized":"2024-08-17T02:26:56.516152+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:44:16.911038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.501704+0000","last_change":"2024-08-17T02:26:56.499934+0000","last_active":"2024-08-17T02:26:56.501704+0000","last_peered":"2024-08-17T02:26:56.501704+0000","last_clean":"2024-08-17T02:26:56.501704+0000","last_became_active":"2024-08-17T02:26:56.499675+0000","last_became_peered":"2024-08-17T02:26:56.499675+0000","last_unstale":"2024-08-17T02:26:56.501704+0000","last_undegraded":"2024-08-17T02:26:56.501704+0000","last_fullsized":"2024-08-17T02:26:56.501704+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:30:02.596332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.514921+0000","last_change":"2024-08-17T02:26:56.510268+0000","last_active":"2024-08-17T02:26:56.514921+0000","last_peered":"2024-08-17T02:26:56.514921+0000","last_clean":"2024-08-17T02:26:56.514921+0000","last_became_active":"2024-08-17T02:26:56.509893+0000","last_became_peered":"2024-08-17T02:26:56.509893+0000","last_unstale":"2024-08-17T02:26:56.514921+0000","last_undegraded":"2024-08-17T02:26:56.514921+0000","last_fullsized":"2024-08-17T02:26:56.514921+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:44:16.911038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.511482+0000","last_change":"2024-08-17T02:26:56.506965+0000","last_active":"2024-08-17T02:26:56.511482+0000","last_peered":"2024-08-17T02:26:56.511482+0000","last_clean":"2024-08-17T02:26:56.511482+0000","last_became_active":"2024-08-17T02:26:56.506691+0000","last_became_peered":"2024-08-17T02:26:56.506691+0000","last_unstale":"2024-08-17T02:26:56.511482+0000","last_undegraded":"2024-08-17T02:26:56.511482+0000","last_fullsized":"2024-08-17T02:26:56.511482+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:31:39.039987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.511730+0000","last_change":"2024-08-17T02:26:56.506847+0000","last_active":"2024-08-17T02:26:56.511730+0000","last_peered":"2024-08-17T02:26:56.511730+0000","last_clean":"2024-08-17T02:26:56.511730+0000","last_became_active":"2024-08-17T02:26:56.506490+0000","last_became_peered":"2024-08-17T02:26:56.506490+0000","last_unstale":"2024-08-17T02:26:56.511730+0000","last_undegraded":"2024-08-17T02:26:56.511730+0000","last_fullsized":"2024-08-17T02:26:56.511730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:35:58.942197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.518216+0000","last_change":"2024-08-17T02:26:56.515531+0000","last_active":"2024-08-17T02:26:56.518216+0000","last_peered":"2024-08-17T02:26:56.518216+0000","last_clean":"2024-08-17T02:26:56.518216+0000","last_became_active":"2024-08-17T02:26:56.515210+0000","last_became_peered":"2024-08-17T02:26:56.515210+0000","last_unstale":"2024-08-17T02:26:56.518216+0000","last_undegraded":"2024-08-17T02:26:56.518216+0000","last_fullsized":"2024-08-17T02:26:56.518216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:48:30.881665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.518579+0000","last_change":"2024-08-17T02:26:56.512698+0000","last_active":"2024-08-17T02:26:56.518579+0000","last_peered":"2024-08-17T02:26:56.518579+0000","last_clean":"2024-08-17T02:26:56.518579+0000","last_became_active":"2024-08-17T02:26:56.512374+0000","last_became_peered":"2024-08-17T02:26:56.512374+0000","last_unstale":"2024-08-17T02:26:56.518579+0000","last_undegraded":"2024-08-17T02:26:56.518579+0000","last_fullsized":"2024-08-17T02:26:56.518579+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:45.237497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.521278+0000","last_change":"2024-08-17T02:26:55.504333+0000","last_active":"2024-08-17T02:26:56.521278+0000","last_peered":"2024-08-17T02:26:56.521278+0000","last_clean":"2024-08-17T02:26:56.521278+0000","last_became_active":"2024-08-17T02:26:55.503255+0000","last_became_peered":"2024-08-17T02:26:55.503255+0000","last_unstale":"2024-08-17T02:26:56.521278+0000","last_undegraded":"2024-08-17T02:26:56.521278+0000","last_fullsized":"2024-08-17T02:26:56.521278+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:06:33.618043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.511895+0000","last_change":"2024-08-17T02:26:56.509366+0000","last_active":"2024-08-17T02:26:56.511895+0000","last_peered":"2024-08-17T02:26:56.511895+0000","last_clean":"2024-08-17T02:26:56.511895+0000","last_became_active":"2024-08-17T02:26:56.509039+0000","last_became_peered":"2024-08-17T02:26:56.509039+0000","last_unstale":"2024-08-17T02:26:56.511895+0000","last_undegraded":"2024-08-17T02:26:56.511895+0000","last_fullsized":"2024-08-17T02:26:56.511895+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:48:01.572551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.521840+0000","last_change":"2024-08-17T02:26:55.507032+0000","last_active":"2024-08-17T02:26:56.521840+0000","last_peered":"2024-08-17T02:26:56.521840+0000","last_clean":"2024-08-17T02:26:56.521840+0000","last_became_active":"2024-08-17T02:26:55.506699+0000","last_became_peered":"2024-08-17T02:26:55.506699+0000","last_unstale":"2024-08-17T02:26:56.521840+0000","last_undegraded":"2024-08-17T02:26:56.521840+0000","last_fullsized":"2024-08-17T02:26:56.521840+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:22:22.628820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.514935+0000","last_change":"2024-08-17T02:26:56.510063+0000","last_active":"2024-08-17T02:26:56.514935+0000","last_peered":"2024-08-17T02:26:56.514935+0000","last_clean":"2024-08-17T02:26:56.514935+0000","last_became_active":"2024-08-17T02:26:56.509782+0000","last_became_peered":"2024-08-17T02:26:56.509782+0000","last_unstale":"2024-08-17T02:26:56.514935+0000","last_undegraded":"2024-08-17T02:26:56.514935+0000","last_fullsized":"2024-08-17T02:26:56.514935+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:28:26.831159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.523680+0000","last_change":"2024-08-17T02:26:55.509895+0000","last_active":"2024-08-17T02:26:56.523680+0000","last_peered":"2024-08-17T02:26:56.523680+0000","last_clean":"2024-08-17T02:26:56.523680+0000","last_became_active":"2024-08-17T02:26:55.509392+0000","last_became_peered":"2024-08-17T02:26:55.509392+0000","last_unstale":"2024-08-17T02:26:56.523680+0000","last_undegraded":"2024-08-17T02:26:56.523680+0000","last_fullsized":"2024-08-17T02:26:56.523680+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:16:15.552494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.516120+0000","last_change":"2024-08-17T02:26:56.508192+0000","last_active":"2024-08-17T02:26:56.516120+0000","last_peered":"2024-08-17T02:26:56.516120+0000","last_clean":"2024-08-17T02:26:56.516120+0000","last_became_active":"2024-08-17T02:26:56.507557+0000","last_became_peered":"2024-08-17T02:26:56.507557+0000","last_unstale":"2024-08-17T02:26:56.516120+0000","last_undegraded":"2024-08-17T02:26:56.516120+0000","last_fullsized":"2024-08-17T02:26:56.516120+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:30.373768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.522540+0000","last_change":"2024-08-17T02:26:55.507945+0000","last_active":"2024-08-17T02:26:56.522540+0000","last_peered":"2024-08-17T02:26:56.522540+0000","last_clean":"2024-08-17T02:26:56.522540+0000","last_became_active":"2024-08-17T02:26:55.507602+0000","last_became_peered":"2024-08-17T02:26:55.507602+0000","last_unstale":"2024-08-17T02:26:56.522540+0000","last_undegraded":"2024-08-17T02:26:56.522540+0000","last_fullsized":"2024-08-17T02:26:56.522540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:01:27.787063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.517050+0000","last_change":"2024-08-17T02:26:56.515501+0000","last_active":"2024-08-17T02:26:56.517050+0000","last_peered":"2024-08-17T02:26:56.517050+0000","last_clean":"2024-08-17T02:26:56.517050+0000","last_became_active":"2024-08-17T02:26:56.515264+0000","last_became_peered":"2024-08-17T02:26:56.515264+0000","last_unstale":"2024-08-17T02:26:56.517050+0000","last_undegraded":"2024-08-17T02:26:56.517050+0000","last_fullsized":"2024-08-17T02:26:56.517050+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:44:19.651824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.523464+0000","last_change":"2024-08-17T02:26:55.503376+0000","last_active":"2024-08-17T02:26:56.523464+0000","last_peered":"2024-08-17T02:26:56.523464+0000","last_clean":"2024-08-17T02:26:56.523464+0000","last_became_active":"2024-08-17T02:26:55.503091+0000","last_became_peered":"2024-08-17T02:26:55.503091+0000","last_unstale":"2024-08-17T02:26:56.523464+0000","last_undegraded":"2024-08-17T02:26:56.523464+0000","last_fullsized":"2024-08-17T02:26:56.523464+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:13:55.945519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.501235+0000","last_change":"2024-08-17T02:26:56.498261+0000","last_active":"2024-08-17T02:26:56.501235+0000","last_peered":"2024-08-17T02:26:56.501235+0000","last_clean":"2024-08-17T02:26:56.501235+0000","last_became_active":"2024-08-17T02:26:56.497742+0000","last_became_peered":"2024-08-17T02:26:56.497742+0000","last_unstale":"2024-08-17T02:26:56.501235+0000","last_undegraded":"2024-08-17T02:26:56.501235+0000","last_fullsized":"2024-08-17T02:26:56.501235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:19.840030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.523461+0000","last_change":"2024-08-17T02:26:55.503241+0000","last_active":"2024-08-17T02:26:56.523461+0000","last_peered":"2024-08-17T02:26:56.523461+0000","last_clean":"2024-08-17T02:26:56.523461+0000","last_became_active":"2024-08-17T02:26:55.502412+0000","last_became_peered":"2024-08-17T02:26:55.502412+0000","last_unstale":"2024-08-17T02:26:56.523461+0000","last_undegraded":"2024-08-17T02:26:56.523461+0000","last_fullsized":"2024-08-17T02:26:56.523461+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:01:06.658260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.506204+0000","last_change":"2024-08-17T02:26:56.501044+0000","last_active":"2024-08-17T02:26:56.506204+0000","last_peered":"2024-08-17T02:26:56.506204+0000","last_clean":"2024-08-17T02:26:56.506204+0000","last_became_active":"2024-08-17T02:26:56.500741+0000","last_became_peered":"2024-08-17T02:26:56.500741+0000","last_unstale":"2024-08-17T02:26:56.506204+0000","last_undegraded":"2024-08-17T02:26:56.506204+0000","last_fullsized":"2024-08-17T02:26:56.506204+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:48:01.572551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.503314+0000","last_change":"2024-08-17T02:26:55.504586+0000","last_active":"2024-08-17T02:26:56.503314+0000","last_peered":"2024-08-17T02:26:56.503314+0000","last_clean":"2024-08-17T02:26:56.503314+0000","last_became_active":"2024-08-17T02:26:55.504304+0000","last_became_peered":"2024-08-17T02:26:55.504304+0000","last_unstale":"2024-08-17T02:26:56.503314+0000","last_undegraded":"2024-08-17T02:26:56.503314+0000","last_fullsized":"2024-08-17T02:26:56.503314+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:35:57.933273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.515959+0000","last_change":"2024-08-17T02:26:56.507641+0000","last_active":"2024-08-17T02:26:56.515959+0000","last_peered":"2024-08-17T02:26:56.515959+0000","last_clean":"2024-08-17T02:26:56.515959+0000","last_became_active":"2024-08-17T02:26:56.507305+0000","last_became_peered":"2024-08-17T02:26:56.507305+0000","last_unstale":"2024-08-17T02:26:56.515959+0000","last_undegraded":"2024-08-17T02:26:56.515959+0000","last_fullsized":"2024-08-17T02:26:56.515959+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:27:22.505326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.494536+0000","last_change":"2024-08-17T02:26:55.502499+0000","last_active":"2024-08-17T02:26:56.494536+0000","last_peered":"2024-08-17T02:26:56.494536+0000","last_clean":"2024-08-17T02:26:56.494536+0000","last_became_active":"2024-08-17T02:26:55.502231+0000","last_became_peered":"2024-08-17T02:26:55.502231+0000","last_unstale":"2024-08-17T02:26:56.494536+0000","last_undegraded":"2024-08-17T02:26:56.494536+0000","last_fullsized":"2024-08-17T02:26:56.494536+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:40:32.839187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.511829+0000","last_change":"2024-08-17T02:26:56.505430+0000","last_active":"2024-08-17T02:26:56.511829+0000","last_peered":"2024-08-17T02:26:56.511829+0000","last_clean":"2024-08-17T02:26:56.511829+0000","last_became_active":"2024-08-17T02:26:56.505152+0000","last_became_peered":"2024-08-17T02:26:56.505152+0000","last_unstale":"2024-08-17T02:26:56.511829+0000","last_undegraded":"2024-08-17T02:26:56.511829+0000","last_fullsized":"2024-08-17T02:26:56.511829+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:36:24.386265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.503546+0000","last_change":"2024-08-17T02:26:55.507581+0000","last_active":"2024-08-17T02:26:56.503546+0000","last_peered":"2024-08-17T02:26:56.503546+0000","last_clean":"2024-08-17T02:26:56.503546+0000","last_became_active":"2024-08-17T02:26:55.507308+0000","last_became_peered":"2024-08-17T02:26:55.507308+0000","last_unstale":"2024-08-17T02:26:56.503546+0000","last_undegraded":"2024-08-17T02:26:56.503546+0000","last_fullsized":"2024-08-17T02:26:56.503546+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:48:00.563628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.519450+0000","last_change":"2024-08-17T02:26:56.514111+0000","last_active":"2024-08-17T02:26:56.519450+0000","last_peered":"2024-08-17T02:26:56.519450+0000","last_clean":"2024-08-17T02:26:56.519450+0000","last_became_active":"2024-08-17T02:26:56.513745+0000","last_became_peered":"2024-08-17T02:26:56.513745+0000","last_unstale":"2024-08-17T02:26:56.519450+0000","last_undegraded":"2024-08-17T02:26:56.519450+0000","last_fullsized":"2024-08-17T02:26:56.519450+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:02:33.781784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.490201+0000","last_change":"2024-08-17T02:26:55.510779+0000","last_active":"2024-08-17T02:26:56.490201+0000","last_peered":"2024-08-17T02:26:56.490201+0000","last_clean":"2024-08-17T02:26:56.490201+0000","last_became_active":"2024-08-17T02:26:55.510468+0000","last_became_peered":"2024-08-17T02:26:55.510468+0000","last_unstale":"2024-08-17T02:26:56.490201+0000","last_undegraded":"2024-08-17T02:26:56.490201+0000","last_fullsized":"2024-08-17T02:26:56.490201+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:52.071816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.521038+0000","last_change":"2024-08-17T02:26:56.513222+0000","last_active":"2024-08-17T02:26:56.521038+0000","last_peered":"2024-08-17T02:26:56.521038+0000","last_clean":"2024-08-17T02:26:56.521038+0000","last_became_active":"2024-08-17T02:26:56.512920+0000","last_became_peered":"2024-08-17T02:26:56.512920+0000","last_unstale":"2024-08-17T02:26:56.521038+0000","last_undegraded":"2024-08-17T02:26:56.521038+0000","last_fullsized":"2024-08-17T02:26:56.521038+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:09:25.912935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.520589+0000","last_change":"2024-08-17T02:26:55.503127+0000","last_active":"2024-08-17T02:26:56.520589+0000","last_peered":"2024-08-17T02:26:56.520589+0000","last_clean":"2024-08-17T02:26:56.520589+0000","last_became_active":"2024-08-17T02:26:55.502612+0000","last_became_peered":"2024-08-17T02:26:55.502612+0000","last_unstale":"2024-08-17T02:26:56.520589+0000","last_undegraded":"2024-08-17T02:26:56.520589+0000","last_fullsized":"2024-08-17T02:26:56.520589+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:02.030073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.513049+0000","last_change":"2024-08-17T02:26:56.508668+0000","last_active":"2024-08-17T02:26:56.513049+0000","last_peered":"2024-08-17T02:26:56.513049+0000","last_clean":"2024-08-17T02:26:56.513049+0000","last_became_active":"2024-08-17T02:26:56.508398+0000","last_became_peered":"2024-08-17T02:26:56.508398+0000","last_unstale":"2024-08-17T02:26:56.513049+0000","last_undegraded":"2024-08-17T02:26:56.513049+0000","last_fullsized":"2024-08-17T02:26:56.513049+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:57:09.592985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.526763+0000","last_change":"2024-08-17T02:26:55.509756+0000","last_active":"2024-08-17T02:26:56.526763+0000","last_peered":"2024-08-17T02:26:56.526763+0000","last_clean":"2024-08-17T02:26:56.526763+0000","last_became_active":"2024-08-17T02:26:55.509332+0000","last_became_peered":"2024-08-17T02:26:55.509332+0000","last_unstale":"2024-08-17T02:26:56.526763+0000","last_undegraded":"2024-08-17T02:26:56.526763+0000","last_fullsized":"2024-08-17T02:26:56.526763+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:44:15.902114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.512784+0000","last_change":"2024-08-17T02:26:56.504124+0000","last_active":"2024-08-17T02:26:56.512784+0000","last_peered":"2024-08-17T02:26:56.512784+0000","last_clean":"2024-08-17T02:26:56.512784+0000","last_became_active":"2024-08-17T02:26:56.503769+0000","last_became_peered":"2024-08-17T02:26:56.503769+0000","last_unstale":"2024-08-17T02:26:56.512784+0000","last_undegraded":"2024-08-17T02:26:56.512784+0000","last_fullsized":"2024-08-17T02:26:56.512784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:28:26.831159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.522020+0000","last_change":"2024-08-17T02:26:55.501614+0000","last_active":"2024-08-17T02:26:56.522020+0000","last_peered":"2024-08-17T02:26:56.522020+0000","last_clean":"2024-08-17T02:26:56.522020+0000","last_became_active":"2024-08-17T02:26:55.501293+0000","last_became_peered":"2024-08-17T02:26:55.501293+0000","last_unstale":"2024-08-17T02:26:56.522020+0000","last_undegraded":"2024-08-17T02:26:56.522020+0000","last_fullsized":"2024-08-17T02:26:56.522020+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:00:37.532319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.505245+0000","last_change":"2024-08-17T02:26:56.501262+0000","last_active":"2024-08-17T02:26:56.505245+0000","last_peered":"2024-08-17T02:26:56.505245+0000","last_clean":"2024-08-17T02:26:56.505245+0000","last_became_active":"2024-08-17T02:26:56.500188+0000","last_became_peered":"2024-08-17T02:26:56.500188+0000","last_unstale":"2024-08-17T02:26:56.505245+0000","last_undegraded":"2024-08-17T02:26:56.505245+0000","last_fullsized":"2024-08-17T02:26:56.505245+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:58:16.013165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.496856+0000","last_change":"2024-08-17T02:26:55.505842+0000","last_active":"2024-08-17T02:26:56.496856+0000","last_peered":"2024-08-17T02:26:56.496856+0000","last_clean":"2024-08-17T02:26:56.496856+0000","last_became_active":"2024-08-17T02:26:55.505423+0000","last_became_peered":"2024-08-17T02:26:55.505423+0000","last_unstale":"2024-08-17T02:26:56.496856+0000","last_undegraded":"2024-08-17T02:26:56.496856+0000","last_fullsized":"2024-08-17T02:26:56.496856+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:13:55.945519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.518235+0000","last_change":"2024-08-17T02:26:56.516821+0000","last_active":"2024-08-17T02:26:56.518235+0000","last_peered":"2024-08-17T02:26:56.518235+0000","last_clean":"2024-08-17T02:26:56.518235+0000","last_became_active":"2024-08-17T02:26:56.516534+0000","last_became_peered":"2024-08-17T02:26:56.516534+0000","last_unstale":"2024-08-17T02:26:56.518235+0000","last_undegraded":"2024-08-17T02:26:56.518235+0000","last_fullsized":"2024-08-17T02:26:56.518235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:54:21.155990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.503011+0000","last_change":"2024-08-17T02:26:55.506968+0000","last_active":"2024-08-17T02:26:56.503011+0000","last_peered":"2024-08-17T02:26:56.503011+0000","last_clean":"2024-08-17T02:26:56.503011+0000","last_became_active":"2024-08-17T02:26:55.506538+0000","last_became_peered":"2024-08-17T02:26:55.506538+0000","last_unstale":"2024-08-17T02:26:56.503011+0000","last_undegraded":"2024-08-17T02:26:56.503011+0000","last_fullsized":"2024-08-17T02:26:56.503011+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:28:25.822235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.510981+0000","last_change":"2024-08-17T02:26:56.504146+0000","last_active":"2024-08-17T02:26:56.510981+0000","last_peered":"2024-08-17T02:26:56.510981+0000","last_clean":"2024-08-17T02:26:56.510981+0000","last_became_active":"2024-08-17T02:26:56.502418+0000","last_became_peered":"2024-08-17T02:26:56.502418+0000","last_unstale":"2024-08-17T02:26:56.510981+0000","last_undegraded":"2024-08-17T02:26:56.510981+0000","last_fullsized":"2024-08-17T02:26:56.510981+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:28:26.831159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.525189+0000","last_change":"2024-08-17T02:26:55.512067+0000","last_active":"2024-08-17T02:26:56.525189+0000","last_peered":"2024-08-17T02:26:56.525189+0000","last_clean":"2024-08-17T02:26:56.525189+0000","last_became_active":"2024-08-17T02:26:55.511805+0000","last_became_peered":"2024-08-17T02:26:55.511805+0000","last_unstale":"2024-08-17T02:26:56.525189+0000","last_undegraded":"2024-08-17T02:26:56.525189+0000","last_fullsized":"2024-08-17T02:26:56.525189+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:29.364844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.506368+0000","last_change":"2024-08-17T02:26:56.501193+0000","last_active":"2024-08-17T02:26:56.506368+0000","last_peered":"2024-08-17T02:26:56.506368+0000","last_clean":"2024-08-17T02:26:56.506368+0000","last_became_active":"2024-08-17T02:26:56.500886+0000","last_became_peered":"2024-08-17T02:26:56.500886+0000","last_unstale":"2024-08-17T02:26:56.506368+0000","last_undegraded":"2024-08-17T02:26:56.506368+0000","last_fullsized":"2024-08-17T02:26:56.506368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:16:16.561417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.524682+0000","last_change":"2024-08-17T02:26:55.511100+0000","last_active":"2024-08-17T02:26:56.524682+0000","last_peered":"2024-08-17T02:26:56.524682+0000","last_clean":"2024-08-17T02:26:56.524682+0000","last_became_active":"2024-08-17T02:26:55.510807+0000","last_became_peered":"2024-08-17T02:26:55.510807+0000","last_unstale":"2024-08-17T02:26:56.524682+0000","last_undegraded":"2024-08-17T02:26:56.524682+0000","last_fullsized":"2024-08-17T02:26:56.524682+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:06:33.618043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.511071+0000","last_change":"2024-08-17T02:26:56.501953+0000","last_active":"2024-08-17T02:26:56.511071+0000","last_peered":"2024-08-17T02:26:56.511071+0000","last_clean":"2024-08-17T02:26:56.511071+0000","last_became_active":"2024-08-17T02:26:56.501693+0000","last_became_peered":"2024-08-17T02:26:56.501693+0000","last_unstale":"2024-08-17T02:26:56.511071+0000","last_undegraded":"2024-08-17T02:26:56.511071+0000","last_fullsized":"2024-08-17T02:26:56.511071+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:08:46.053249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.521623+0000","last_change":"2024-08-17T02:26:55.501905+0000","last_active":"2024-08-17T02:26:56.521623+0000","last_peered":"2024-08-17T02:26:56.521623+0000","last_clean":"2024-08-17T02:26:56.521623+0000","last_became_active":"2024-08-17T02:26:55.501640+0000","last_became_peered":"2024-08-17T02:26:55.501640+0000","last_unstale":"2024-08-17T02:26:56.521623+0000","last_undegraded":"2024-08-17T02:26:56.521623+0000","last_fullsized":"2024-08-17T02:26:56.521623+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:59:56.904293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.516289+0000","last_change":"2024-08-17T02:26:56.507948+0000","last_active":"2024-08-17T02:26:56.516289+0000","last_peered":"2024-08-17T02:26:56.516289+0000","last_clean":"2024-08-17T02:26:56.516289+0000","last_became_active":"2024-08-17T02:26:56.507616+0000","last_became_peered":"2024-08-17T02:26:56.507616+0000","last_unstale":"2024-08-17T02:26:56.516289+0000","last_undegraded":"2024-08-17T02:26:56.516289+0000","last_fullsized":"2024-08-17T02:26:56.516289+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:28.514977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.521659+0000","last_change":"2024-08-17T02:26:55.500328+0000","last_active":"2024-08-17T02:26:56.521659+0000","last_peered":"2024-08-17T02:26:56.521659+0000","last_clean":"2024-08-17T02:26:56.521659+0000","last_became_active":"2024-08-17T02:26:55.499943+0000","last_became_peered":"2024-08-17T02:26:55.499943+0000","last_unstale":"2024-08-17T02:26:56.521659+0000","last_undegraded":"2024-08-17T02:26:56.521659+0000","last_fullsized":"2024-08-17T02:26:56.521659+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:15:19.285394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.512383+0000","last_change":"2024-08-17T02:26:56.512383+0000","last_active":"2024-08-17T02:26:56.512383+0000","last_peered":"2024-08-17T02:26:56.512383+0000","last_clean":"2024-08-17T02:26:56.512383+0000","last_became_active":"2024-08-17T02:26:56.512065+0000","last_became_peered":"2024-08-17T02:26:56.512065+0000","last_unstale":"2024-08-17T02:26:56.512383+0000","last_undegraded":"2024-08-17T02:26:56.512383+0000","last_fullsized":"2024-08-17T02:26:56.512383+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:22:23.637744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.490422+0000","last_change":"2024-08-17T02:26:55.502619+0000","last_active":"2024-08-17T02:26:56.490422+0000","last_peered":"2024-08-17T02:26:56.490422+0000","last_clean":"2024-08-17T02:26:56.490422+0000","last_became_active":"2024-08-17T02:26:55.502330+0000","last_became_peered":"2024-08-17T02:26:55.502330+0000","last_unstale":"2024-08-17T02:26:56.490422+0000","last_undegraded":"2024-08-17T02:26:56.490422+0000","last_fullsized":"2024-08-17T02:26:56.490422+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:36:55.966696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.507536+0000","last_change":"2024-08-17T02:26:56.507536+0000","last_active":"2024-08-17T02:26:56.507536+0000","last_peered":"2024-08-17T02:26:56.507536+0000","last_clean":"2024-08-17T02:26:56.507536+0000","last_became_active":"2024-08-17T02:26:56.507281+0000","last_became_peered":"2024-08-17T02:26:56.507281+0000","last_unstale":"2024-08-17T02:26:56.507536+0000","last_undegraded":"2024-08-17T02:26:56.507536+0000","last_fullsized":"2024-08-17T02:26:56.507536+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:32:28.900466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.522429+0000","last_change":"2024-08-17T02:26:55.507958+0000","last_active":"2024-08-17T02:26:56.522429+0000","last_peered":"2024-08-17T02:26:56.522429+0000","last_clean":"2024-08-17T02:26:56.522429+0000","last_became_active":"2024-08-17T02:26:55.507685+0000","last_became_peered":"2024-08-17T02:26:55.507685+0000","last_unstale":"2024-08-17T02:26:56.522429+0000","last_undegraded":"2024-08-17T02:26:56.522429+0000","last_fullsized":"2024-08-17T02:26:56.522429+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:09:19.371240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.502800+0000","last_change":"2024-08-17T02:26:56.502800+0000","last_active":"2024-08-17T02:26:56.502800+0000","last_peered":"2024-08-17T02:26:56.502800+0000","last_clean":"2024-08-17T02:26:56.502800+0000","last_became_active":"2024-08-17T02:26:56.502483+0000","last_became_peered":"2024-08-17T02:26:56.502483+0000","last_unstale":"2024-08-17T02:26:56.502800+0000","last_undegraded":"2024-08-17T02:26:56.502800+0000","last_fullsized":"2024-08-17T02:26:56.502800+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:10.190201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.495989+0000","last_change":"2024-08-17T02:26:55.509045+0000","last_active":"2024-08-17T02:26:56.495989+0000","last_peered":"2024-08-17T02:26:56.495989+0000","last_clean":"2024-08-17T02:26:56.495989+0000","last_became_active":"2024-08-17T02:26:55.508832+0000","last_became_peered":"2024-08-17T02:26:55.508832+0000","last_unstale":"2024-08-17T02:26:56.495989+0000","last_undegraded":"2024-08-17T02:26:56.495989+0000","last_fullsized":"2024-08-17T02:26:56.495989+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:40:57.362649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.505739+0000","last_change":"2024-08-17T02:26:56.505739+0000","last_active":"2024-08-17T02:26:56.505739+0000","last_peered":"2024-08-17T02:26:56.505739+0000","last_clean":"2024-08-17T02:26:56.505739+0000","last_became_active":"2024-08-17T02:26:56.504767+0000","last_became_peered":"2024-08-17T02:26:56.504767+0000","last_unstale":"2024-08-17T02:26:56.505739+0000","last_undegraded":"2024-08-17T02:26:56.505739+0000","last_fullsized":"2024-08-17T02:26:56.505739+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:08:21.329290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.490594+0000","last_change":"2024-08-17T02:26:55.507441+0000","last_active":"2024-08-17T02:26:56.490594+0000","last_peered":"2024-08-17T02:26:56.490594+0000","last_clean":"2024-08-17T02:26:56.490594+0000","last_became_active":"2024-08-17T02:26:55.507190+0000","last_became_peered":"2024-08-17T02:26:55.507190+0000","last_unstale":"2024-08-17T02:26:56.490594+0000","last_undegraded":"2024-08-17T02:26:56.490594+0000","last_fullsized":"2024-08-17T02:26:56.490594+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:05:59.431259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.512237+0000","last_change":"2024-08-17T02:26:56.507880+0000","last_active":"2024-08-17T02:26:56.512237+0000","last_peered":"2024-08-17T02:26:56.512237+0000","last_clean":"2024-08-17T02:26:56.512237+0000","last_became_active":"2024-08-17T02:26:56.507607+0000","last_became_peered":"2024-08-17T02:26:56.507607+0000","last_unstale":"2024-08-17T02:26:56.512237+0000","last_undegraded":"2024-08-17T02:26:56.512237+0000","last_fullsized":"2024-08-17T02:26:56.512237+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:24.429926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.493428+0000","last_change":"2024-08-17T02:26:55.506450+0000","last_active":"2024-08-17T02:26:56.493428+0000","last_peered":"2024-08-17T02:26:56.493428+0000","last_clean":"2024-08-17T02:26:56.493428+0000","last_became_active":"2024-08-17T02:26:55.506180+0000","last_became_peered":"2024-08-17T02:26:55.506180+0000","last_unstale":"2024-08-17T02:26:56.493428+0000","last_undegraded":"2024-08-17T02:26:56.493428+0000","last_fullsized":"2024-08-17T02:26:56.493428+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:46:59.819375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.502457+0000","last_change":"2024-08-17T02:26:56.502457+0000","last_active":"2024-08-17T02:26:56.502457+0000","last_peered":"2024-08-17T02:26:56.502457+0000","last_clean":"2024-08-17T02:26:56.502457+0000","last_became_active":"2024-08-17T02:26:56.502186+0000","last_became_peered":"2024-08-17T02:26:56.502186+0000","last_unstale":"2024-08-17T02:26:56.502457+0000","last_undegraded":"2024-08-17T02:26:56.502457+0000","last_fullsized":"2024-08-17T02:26:56.502457+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:51:27.506000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.522021+0000","last_change":"2024-08-17T02:26:55.505720+0000","last_active":"2024-08-17T02:26:56.522021+0000","last_peered":"2024-08-17T02:26:56.522021+0000","last_clean":"2024-08-17T02:26:56.522021+0000","last_became_active":"2024-08-17T02:26:55.505391+0000","last_became_peered":"2024-08-17T02:26:55.505391+0000","last_unstale":"2024-08-17T02:26:56.522021+0000","last_undegraded":"2024-08-17T02:26:56.522021+0000","last_fullsized":"2024-08-17T02:26:56.522021+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:36:55.966696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.512942+0000","last_change":"2024-08-17T02:26:56.508150+0000","last_active":"2024-08-17T02:26:56.512942+0000","last_peered":"2024-08-17T02:26:56.512942+0000","last_clean":"2024-08-17T02:26:56.512942+0000","last_became_active":"2024-08-17T02:26:56.507862+0000","last_became_peered":"2024-08-17T02:26:56.507862+0000","last_unstale":"2024-08-17T02:26:56.512942+0000","last_undegraded":"2024-08-17T02:26:56.512942+0000","last_fullsized":"2024-08-17T02:26:56.512942+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:44:19.651824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.490193+0000","last_change":"2024-08-17T02:26:55.508312+0000","last_active":"2024-08-17T02:26:56.490193+0000","last_peered":"2024-08-17T02:26:56.490193+0000","last_clean":"2024-08-17T02:26:56.490193+0000","last_became_active":"2024-08-17T02:26:55.507656+0000","last_became_peered":"2024-08-17T02:26:55.507656+0000","last_unstale":"2024-08-17T02:26:56.490193+0000","last_undegraded":"2024-08-17T02:26:56.490193+0000","last_fullsized":"2024-08-17T02:26:56.490193+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:44:12.743421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.513385+0000","last_change":"2024-08-17T02:26:56.508533+0000","last_active":"2024-08-17T02:26:56.513385+0000","last_peered":"2024-08-17T02:26:56.513385+0000","last_clean":"2024-08-17T02:26:56.513385+0000","last_became_active":"2024-08-17T02:26:56.508204+0000","last_became_peered":"2024-08-17T02:26:56.508204+0000","last_unstale":"2024-08-17T02:26:56.513385+0000","last_undegraded":"2024-08-17T02:26:56.513385+0000","last_fullsized":"2024-08-17T02:26:56.513385+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:36:13.643339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.497627+0000","last_change":"2024-08-17T02:26:55.506867+0000","last_active":"2024-08-17T02:26:56.497627+0000","last_peered":"2024-08-17T02:26:56.497627+0000","last_clean":"2024-08-17T02:26:56.497627+0000","last_became_active":"2024-08-17T02:26:55.506609+0000","last_became_peered":"2024-08-17T02:26:55.506609+0000","last_unstale":"2024-08-17T02:26:56.497627+0000","last_undegraded":"2024-08-17T02:26:56.497627+0000","last_fullsized":"2024-08-17T02:26:56.497627+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:15:19.285394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.511764+0000","last_change":"2024-08-17T02:26:56.507224+0000","last_active":"2024-08-17T02:26:56.511764+0000","last_peered":"2024-08-17T02:26:56.511764+0000","last_clean":"2024-08-17T02:26:56.511764+0000","last_became_active":"2024-08-17T02:26:56.506935+0000","last_became_peered":"2024-08-17T02:26:56.506935+0000","last_unstale":"2024-08-17T02:26:56.511764+0000","last_undegraded":"2024-08-17T02:26:56.511764+0000","last_fullsized":"2024-08-17T02:26:56.511764+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:27:22.505326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.489052+0000","last_change":"2024-08-17T02:26:55.507386+0000","last_active":"2024-08-17T02:26:56.489052+0000","last_peered":"2024-08-17T02:26:56.489052+0000","last_clean":"2024-08-17T02:26:56.489052+0000","last_became_active":"2024-08-17T02:26:55.506685+0000","last_became_peered":"2024-08-17T02:26:55.506685+0000","last_unstale":"2024-08-17T02:26:56.489052+0000","last_undegraded":"2024-08-17T02:26:56.489052+0000","last_fullsized":"2024-08-17T02:26:56.489052+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:09.181278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.505198+0000","last_change":"2024-08-17T02:26:56.501044+0000","last_active":"2024-08-17T02:26:56.505198+0000","last_peered":"2024-08-17T02:26:56.505198+0000","last_clean":"2024-08-17T02:26:56.505198+0000","last_became_active":"2024-08-17T02:26:56.500870+0000","last_became_peered":"2024-08-17T02:26:56.500870+0000","last_unstale":"2024-08-17T02:26:56.505198+0000","last_undegraded":"2024-08-17T02:26:56.505198+0000","last_fullsized":"2024-08-17T02:26:56.505198+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:00:55.548498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.497038+0000","last_change":"2024-08-17T02:26:55.506109+0000","last_active":"2024-08-17T02:26:56.497038+0000","last_peered":"2024-08-17T02:26:56.497038+0000","last_clean":"2024-08-17T02:26:56.497038+0000","last_became_active":"2024-08-17T02:26:55.505082+0000","last_became_peered":"2024-08-17T02:26:55.505082+0000","last_unstale":"2024-08-17T02:26:56.497038+0000","last_undegraded":"2024-08-17T02:26:56.497038+0000","last_fullsized":"2024-08-17T02:26:56.497038+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:05:59.431259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.510758+0000","last_change":"2024-08-17T02:26:56.509408+0000","last_active":"2024-08-17T02:26:56.510758+0000","last_peered":"2024-08-17T02:26:56.510758+0000","last_clean":"2024-08-17T02:26:56.510758+0000","last_became_active":"2024-08-17T02:26:56.509019+0000","last_became_peered":"2024-08-17T02:26:56.509019+0000","last_unstale":"2024-08-17T02:26:56.510758+0000","last_undegraded":"2024-08-17T02:26:56.510758+0000","last_fullsized":"2024-08-17T02:26:56.510758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:33:02.969932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.490836+0000","last_change":"2024-08-17T02:26:55.504495+0000","last_active":"2024-08-17T02:26:56.490836+0000","last_peered":"2024-08-17T02:26:56.490836+0000","last_clean":"2024-08-17T02:26:56.490836+0000","last_became_active":"2024-08-17T02:26:55.504220+0000","last_became_peered":"2024-08-17T02:26:55.504220+0000","last_unstale":"2024-08-17T02:26:56.490836+0000","last_undegraded":"2024-08-17T02:26:56.490836+0000","last_fullsized":"2024-08-17T02:26:56.490836+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:54:01.459162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.511022+0000","last_change":"2024-08-17T02:26:56.503333+0000","last_active":"2024-08-17T02:26:56.511022+0000","last_peered":"2024-08-17T02:26:56.511022+0000","last_clean":"2024-08-17T02:26:56.511022+0000","last_became_active":"2024-08-17T02:26:56.502968+0000","last_became_peered":"2024-08-17T02:26:56.502968+0000","last_unstale":"2024-08-17T02:26:56.511022+0000","last_undegraded":"2024-08-17T02:26:56.511022+0000","last_fullsized":"2024-08-17T02:26:56.511022+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:28.514977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.503207+0000","last_change":"2024-08-17T02:26:55.510057+0000","last_active":"2024-08-17T02:26:56.503207+0000","last_peered":"2024-08-17T02:26:56.503207+0000","last_clean":"2024-08-17T02:26:56.503207+0000","last_became_active":"2024-08-17T02:26:55.509765+0000","last_became_peered":"2024-08-17T02:26:55.509765+0000","last_unstale":"2024-08-17T02:26:56.503207+0000","last_undegraded":"2024-08-17T02:26:56.503207+0000","last_fullsized":"2024-08-17T02:26:56.503207+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:27:21.496402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.513838+0000","last_change":"2024-08-17T02:26:56.512025+0000","last_active":"2024-08-17T02:26:56.513838+0000","last_peered":"2024-08-17T02:26:56.513838+0000","last_clean":"2024-08-17T02:26:56.513838+0000","last_became_active":"2024-08-17T02:26:56.511691+0000","last_became_peered":"2024-08-17T02:26:56.511691+0000","last_unstale":"2024-08-17T02:26:56.513838+0000","last_undegraded":"2024-08-17T02:26:56.513838+0000","last_fullsized":"2024-08-17T02:26:56.513838+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:55.471434+0000","last_clean_scrub_stamp":"2024-08-17T02:26:55.471434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:28.514977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.494885+0000","last_change":"2024-08-17T02:26:55.505418+0000","last_active":"2024-08-17T02:26:56.494885+0000","last_peered":"2024-08-17T02:26:56.494885+0000","last_clean":"2024-08-17T02:26:56.494885+0000","last_became_active":"2024-08-17T02:26:55.505074+0000","last_became_peered":"2024-08-17T02:26:55.505074+0000","last_unstale":"2024-08-17T02:26:56.494885+0000","last_undegraded":"2024-08-17T02:26:56.494885+0000","last_fullsized":"2024-08-17T02:26:56.494885+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:54.462510+0000","last_clean_scrub_stamp":"2024-08-17T02:26:54.462510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:22:28.708889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":172,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:56.505603+0000","last_change":"2024-08-17T02:26:00.033569+0000","last_active":"2024-08-17T02:26:56.505603+0000","last_peered":"2024-08-17T02:26:56.505603+0000","last_clean":"2024-08-17T02:26:56.505603+0000","last_became_active":"2024-08-17T02:26:00.031512+0000","last_became_peered":"2024-08-17T02:26:00.031512+0000","last_unstale":"2024-08-17T02:26:56.505603+0000","last_undegraded":"2024-08-17T02:26:56.505603+0000","last_fullsized":"2024-08-17T02:26:56.505603+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:58.643690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:58.643690+0000","last_clean_scrub_stamp":"2024-08-17T02:25:58.643690+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:47:24.121981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509456,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298288,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073552,"statfs":{"total":96636764160,"available":96331317248,"internally_reserved":0,"allocated":950272,"data_stored":725185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3380000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]}]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297708,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074132,"statfs":{"total":96636764160,"available":96331911168,"internally_reserved":0,"allocated":360448,"data_stored":135331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2509999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509455,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297708,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074132,"statfs":{"total":96636764160,"available":96331911168,"internally_reserved":0,"allocated":360448,"data_stored":135387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2689999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]}]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297708,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074132,"statfs":{"total":96636764160,"available":96331911168,"internally_reserved":0,"allocated":360448,"data_stored":134831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]}]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297712,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074128,"statfs":{"total":96636764160,"available":96331907072,"internally_reserved":0,"allocated":356352,"data_stored":130013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5760000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.798}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.0899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5029999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.831}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]}]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":368640,"data_stored":136301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542160,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297692,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074148,"statfs":{"total":96636764160,"available":96331927552,"internally_reserved":0,"allocated":344064,"data_stored":128509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542160,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298284,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073556,"statfs":{"total":96636764160,"available":96331321344,"internally_reserved":0,"allocated":946176,"data_stored":725095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:27:00.843 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:27:00.843 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-17T02:27:00.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.953+0000 7fd859150700 1 Processor -- start 2024-08-17T02:27:00.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.953+0000 7fd859150700 1 -- start start 2024-08-17T02:27:00.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.957+0000 7fd859150700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd8540688d0 0x7fd854068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.957+0000 7fd859150700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd8540a9ce0 0x7fd854159200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.957+0000 7fd859150700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8540aa160 con 0x7fd8540a9860 2024-08-17T02:27:00.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.957+0000 7fd859150700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8540aa440 con 0x7fd8540688d0 2024-08-17T02:27:00.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.957+0000 7fd859150700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8540aa720 con 0x7fd8540a9ce0 2024-08-17T02:27:00.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.957+0000 7fd853fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd8540688d0 0x7fd854068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.957+0000 7fd8537fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fd8540a9860 0x7fd854158af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50900/0 (socket says 172.21.15.153:50900) 2024-08-17T02:27:00.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.957+0000 7fd8537fe700 1 -- 172.21.15.153:0/3490212551 learned_addr learned my addr 172.21.15.153:0/3490212551 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:27:00.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.957+0000 7fd85894f700 1 --2- 172.21.15.153:0/3490212551 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd8540a9ce0 0x7fd854159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.957+0000 7fd853fff700 1 -- 172.21.15.153:0/3490212551 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd8540a9ce0 msgr2=0x7fd854159200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:00.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.957+0000 7fd853fff700 1 --2- 172.21.15.153:0/3490212551 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd8540a9ce0 0x7fd854159200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.957+0000 7fd853fff700 1 -- 172.21.15.153:0/3490212551 >> v1:172.21.15.153:6789/0 conn(0x7fd8540a9860 legacy=0x7fd854158af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.957+0000 7fd853fff700 1 -- 172.21.15.153:0/3490212551 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8540aaa00 con 0x7fd8540688d0 2024-08-17T02:27:00.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.957+0000 7fd853fff700 1 --2- 172.21.15.153:0/3490212551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8540688d0 0x7fd854068ca0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd844009e60 tx=0x7fd844009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d3acab368dbe38 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.957+0000 7fd852ffd700 1 -- 172.21.15.153:0/3490212551 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84400e070 con 0x7fd8540688d0 2024-08-17T02:27:00.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.957+0000 7fd852ffd700 1 -- 172.21.15.153:0/3490212551 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84400bc30 con 0x7fd8540688d0 2024-08-17T02:27:00.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.957+0000 7fd852ffd700 1 -- 172.21.15.153:0/3490212551 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd844012430 con 0x7fd8540688d0 2024-08-17T02:27:00.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.957+0000 7fd859150700 1 -- 172.21.15.153:0/3490212551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8540688d0 msgr2=0x7fd854068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.957+0000 7fd859150700 1 --2- 172.21.15.153:0/3490212551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8540688d0 0x7fd854068ca0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd844009e60 tx=0x7fd844009780 comp rx=0 tx=0).stop 2024-08-17T02:27:00.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.961+0000 7fd859150700 1 -- 172.21.15.153:0/3490212551 shutdown_connections 2024-08-17T02:27:00.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.961+0000 7fd859150700 1 --2- 172.21.15.153:0/3490212551 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd8540a9ce0 0x7fd854159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.961+0000 7fd859150700 1 --2- 172.21.15.153:0/3490212551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8540688d0 0x7fd854068ca0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.961+0000 7fd859150700 1 -- 172.21.15.153:0/3490212551 >> 172.21.15.153:0/3490212551 conn(0x7fd85406d8d0 msgr2=0x7fd85406dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:00.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.961+0000 7fd859150700 1 -- 172.21.15.153:0/3490212551 shutdown_connections 2024-08-17T02:27:00.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.961+0000 7fd859150700 1 -- 172.21.15.153:0/3490212551 wait complete. 2024-08-17T02:27:00.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.961+0000 7fd859150700 1 Processor -- start 2024-08-17T02:27:00.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.961+0000 7fd859150700 1 -- start start 2024-08-17T02:27:00.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.965+0000 7fd859150700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8540688d0 0x7fd854146f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.965+0000 7fd859150700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8540a9860 0x7fd854169120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.965+0000 7fd859150700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd85415ba30 0x7fd85415be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.965+0000 7fd859150700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd854155350 con 0x7fd8540688d0 2024-08-17T02:27:00.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.965+0000 7fd859150700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd854154740 con 0x7fd8540a9860 2024-08-17T02:27:00.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.965+0000 7fd859150700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd854154a20 con 0x7fd85415ba30 2024-08-17T02:27:00.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.965+0000 7fd853fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8540688d0 0x7fd854146f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.965+0000 7fd853fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8540688d0 0x7fd854146f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59774/0 (socket says 172.21.15.153:59774) 2024-08-17T02:27:00.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.965+0000 7fd853fff700 1 -- 172.21.15.153:0/3470963220 learned_addr learned my addr 172.21.15.153:0/3470963220 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:27:00.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.965+0000 7fd8537fe700 1 --2- 172.21.15.153:0/3470963220 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8540a9860 0x7fd854169120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.965+0000 7fd85894f700 1 --2- 172.21.15.153:0/3470963220 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd85415ba30 0x7fd85415be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.965+0000 7fd853fff700 1 -- 172.21.15.153:0/3470963220 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd85415ba30 msgr2=0x7fd85415be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.965+0000 7fd853fff700 1 --2- 172.21.15.153:0/3470963220 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd85415ba30 0x7fd85415be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.965+0000 7fd853fff700 1 -- 172.21.15.153:0/3470963220 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8540a9860 msgr2=0x7fd854169120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.965+0000 7fd853fff700 1 --2- 172.21.15.153:0/3470963220 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8540a9860 0x7fd854169120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.965+0000 7fd853fff700 1 -- 172.21.15.153:0/3470963220 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd844009a20 con 0x7fd8540688d0 2024-08-17T02:27:00.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.965+0000 7fd8537fe700 1 --2- 172.21.15.153:0/3470963220 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8540a9860 0x7fd854169120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:00.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.965+0000 7fd853fff700 1 --2- 172.21.15.153:0/3470963220 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8540688d0 0x7fd854146f80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd8440097c0 tx=0x7fd844019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.965+0000 7fd84bfff700 1 -- 172.21.15.153:0/3470963220 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd844012e80 con 0x7fd8540688d0 2024-08-17T02:27:00.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.965+0000 7fd84bfff700 1 -- 172.21.15.153:0/3470963220 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd844027470 con 0x7fd8540688d0 2024-08-17T02:27:00.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.965+0000 7fd859150700 1 -- 172.21.15.153:0/3470963220 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd854154d00 con 0x7fd8540688d0 2024-08-17T02:27:00.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.965+0000 7fd84bfff700 1 -- 172.21.15.153:0/3470963220 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd844027810 con 0x7fd8540688d0 2024-08-17T02:27:00.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.965+0000 7fd859150700 1 -- 172.21.15.153:0/3470963220 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8541474c0 con 0x7fd8540688d0 2024-08-17T02:27:00.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.969+0000 7fd859150700 1 -- 172.21.15.153:0/3470963220 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8540638f0 con 0x7fd8540688d0 2024-08-17T02:27:00.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.969+0000 7fd84bfff700 1 -- 172.21.15.153:0/3470963220 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd844024070 con 0x7fd8540688d0 2024-08-17T02:27:00.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.969+0000 7fd84bfff700 1 --2- 172.21.15.153:0/3470963220 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd834060860 0x7fd834062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.969+0000 7fd8537fe700 1 --2- 172.21.15.153:0/3470963220 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd834060860 0x7fd834062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.969+0000 7fd84bfff700 1 -- 172.21.15.153:0/3470963220 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd84407f7e0 con 0x7fd8540688d0 2024-08-17T02:27:00.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.969+0000 7fd8537fe700 1 --2- 172.21.15.153:0/3470963220 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd834060860 0x7fd834062d10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd8540cb760 tx=0x7fd83c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.981 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:00.977+0000 7fd84bfff700 1 -- 172.21.15.153:0/3470963220 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd84404fb90 con 0x7fd8540688d0 2024-08-17T02:27:01.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.201+0000 7fd859150700 1 -- 172.21.15.153:0/3470963220 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd85406e590 con 0x7fd8540688d0 2024-08-17T02:27:01.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.205+0000 7fd84bfff700 1 -- 172.21.15.153:0/3470963220 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7fd8440531b0 con 0x7fd8540688d0 2024-08-17T02:27:01.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.209+0000 7fd859150700 1 -- 172.21.15.153:0/3470963220 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd834060860 msgr2=0x7fd834062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.209+0000 7fd859150700 1 --2- 172.21.15.153:0/3470963220 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd834060860 0x7fd834062d10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd8540cb760 tx=0x7fd83c009040 comp rx=0 tx=0).stop 2024-08-17T02:27:01.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.209+0000 7fd859150700 1 -- 172.21.15.153:0/3470963220 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8540688d0 msgr2=0x7fd854146f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.209+0000 7fd859150700 1 --2- 172.21.15.153:0/3470963220 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8540688d0 0x7fd854146f80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd8440097c0 tx=0x7fd844019000 comp rx=0 tx=0).stop 2024-08-17T02:27:01.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.209+0000 7fd859150700 1 -- 172.21.15.153:0/3470963220 shutdown_connections 2024-08-17T02:27:01.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.209+0000 7fd859150700 1 --2- 172.21.15.153:0/3470963220 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd834060860 0x7fd834062d10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.209+0000 7fd859150700 1 --2- 172.21.15.153:0/3470963220 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd85415ba30 0x7fd85415be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.209+0000 7fd859150700 1 --2- 172.21.15.153:0/3470963220 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8540a9860 0x7fd854169120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.209+0000 7fd859150700 1 --2- 172.21.15.153:0/3470963220 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8540688d0 0x7fd854146f80 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.209+0000 7fd859150700 1 -- 172.21.15.153:0/3470963220 >> 172.21.15.153:0/3470963220 conn(0x7fd85406d8d0 msgr2=0x7fd854153240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:01.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.209+0000 7fd859150700 1 -- 172.21.15.153:0/3470963220 shutdown_connections 2024-08-17T02:27:01.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.209+0000 7fd859150700 1 -- 172.21.15.153:0/3470963220 wait complete. 2024-08-17T02:27:01.214 INFO:teuthology.orchestra.run.smithi153.stderr:updated caps for client.0 2024-08-17T02:27:01.225 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:01.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.329+0000 7f346359e700 1 Processor -- start 2024-08-17T02:27:01.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.329+0000 7f346359e700 1 -- start start 2024-08-17T02:27:01.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.329+0000 7f346359e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34640b0350 0x7f34640ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.329+0000 7f346359e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f346406df10 0x7f346406e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.329+0000 7f346359e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34640af2b0 con 0x7f3464155d20 2024-08-17T02:27:01.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.329+0000 7f346359e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34640b07a0 con 0x7f346406df10 2024-08-17T02:27:01.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.329+0000 7f346359e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f346406e8d0 con 0x7f34640b0350 2024-08-17T02:27:01.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.329+0000 7f3462d9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f346406df10 0x7f346406e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.329+0000 7f3462d9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f346406df10 0x7f346406e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59776/0 (socket says 172.21.15.153:59776) 2024-08-17T02:27:01.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.329+0000 7f3462d9d700 1 -- 172.21.15.153:0/1517008848 learned_addr learned my addr 172.21.15.153:0/1517008848 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:27:01.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.329+0000 7f3461d9b700 1 --2- 172.21.15.153:0/1517008848 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34640b0350 0x7f34640ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.329+0000 7f3462d9d700 1 -- 172.21.15.153:0/1517008848 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34640b0350 msgr2=0x7f34640ad7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:01.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.329+0000 7f3462d9d700 1 --2- 172.21.15.153:0/1517008848 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34640b0350 0x7f34640ad7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.329+0000 7f3462d9d700 1 -- 172.21.15.153:0/1517008848 >> v1:172.21.15.174:6789/0 conn(0x7f3464155d20 legacy=0x7f34640aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.329+0000 7f3462d9d700 1 -- 172.21.15.153:0/1517008848 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34640af590 con 0x7f346406df10 2024-08-17T02:27:01.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.333+0000 7f3462d9d700 1 --2- 172.21.15.153:0/1517008848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f346406df10 0x7f346406e390 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f345c0099e0 tx=0x7f345c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d7037e4af0c201c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.333+0000 7f346159a700 1 -- 172.21.15.153:0/1517008848 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345c00b820 con 0x7f346406df10 2024-08-17T02:27:01.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.333+0000 7f346159a700 1 -- 172.21.15.153:0/1517008848 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f345c00b980 con 0x7f346406df10 2024-08-17T02:27:01.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.333+0000 7f346159a700 1 -- 172.21.15.153:0/1517008848 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345c00bd20 con 0x7f346406df10 2024-08-17T02:27:01.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.333+0000 7f346359e700 1 -- 172.21.15.153:0/1517008848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f346406df10 msgr2=0x7f346406e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.333+0000 7f346359e700 1 --2- 172.21.15.153:0/1517008848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f346406df10 0x7f346406e390 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f345c0099e0 tx=0x7f345c009250 comp rx=0 tx=0).stop 2024-08-17T02:27:01.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.333+0000 7f346359e700 1 -- 172.21.15.153:0/1517008848 shutdown_connections 2024-08-17T02:27:01.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.333+0000 7f346359e700 1 --2- 172.21.15.153:0/1517008848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f346406df10 0x7f346406e390 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.333+0000 7f346359e700 1 --2- 172.21.15.153:0/1517008848 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34640b0350 0x7f34640ad7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.333+0000 7f346359e700 1 -- 172.21.15.153:0/1517008848 >> 172.21.15.153:0/1517008848 conn(0x7f34640678d0 msgr2=0x7f3464067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:01.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.333+0000 7f346359e700 1 -- 172.21.15.153:0/1517008848 shutdown_connections 2024-08-17T02:27:01.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.333+0000 7f346359e700 1 -- 172.21.15.153:0/1517008848 wait complete. 2024-08-17T02:27:01.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.337+0000 7f346359e700 1 Processor -- start 2024-08-17T02:27:01.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.337+0000 7f346359e700 1 -- start start 2024-08-17T02:27:01.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.337+0000 7f346359e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f346406df10 0x7f34640aad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.337+0000 7f346359e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34640b0350 0x7f34641469d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.337+0000 7f346359e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3464155d20 0x7f3464149e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.337+0000 7f346359e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34640a9d70 con 0x7f346406df10 2024-08-17T02:27:01.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.337+0000 7f346359e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34640a9fc0 con 0x7f3464155d20 2024-08-17T02:27:01.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.337+0000 7f346359e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34640aa2a0 con 0x7f34640b0350 2024-08-17T02:27:01.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.337+0000 7f346259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f346406df10 0x7f34640aad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.337+0000 7f346259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f346406df10 0x7f34640aad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59780/0 (socket says 172.21.15.153:59780) 2024-08-17T02:27:01.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.337+0000 7f346259c700 1 -- 172.21.15.153:0/2311806816 learned_addr learned my addr 172.21.15.153:0/2311806816 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:27:01.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.337+0000 7f3462d9d700 1 --2- 172.21.15.153:0/2311806816 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3464155d20 0x7f3464149e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.337+0000 7f3461d9b700 1 --2- 172.21.15.153:0/2311806816 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34640b0350 0x7f34641469d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.337+0000 7f346259c700 1 -- 172.21.15.153:0/2311806816 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34640b0350 msgr2=0x7f34641469d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.337+0000 7f346259c700 1 --2- 172.21.15.153:0/2311806816 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34640b0350 0x7f34641469d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.337+0000 7f346259c700 1 -- 172.21.15.153:0/2311806816 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3464155d20 msgr2=0x7f3464149e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.337+0000 7f346259c700 1 --2- 172.21.15.153:0/2311806816 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3464155d20 0x7f3464149e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.337+0000 7f346259c700 1 -- 172.21.15.153:0/2311806816 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f345c0094f0 con 0x7f346406df10 2024-08-17T02:27:01.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.341+0000 7f346259c700 1 --2- 172.21.15.153:0/2311806816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f346406df10 0x7f34640aad80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f345400c4e0 tx=0x7f345400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.341+0000 7f345a7fc700 1 -- 172.21.15.153:0/2311806816 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3454011590 con 0x7f346406df10 2024-08-17T02:27:01.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.341+0000 7f345a7fc700 1 -- 172.21.15.153:0/2311806816 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3454011710 con 0x7f346406df10 2024-08-17T02:27:01.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.341+0000 7f346359e700 1 -- 172.21.15.153:0/2311806816 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34640aa580 con 0x7f346406df10 2024-08-17T02:27:01.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.341+0000 7f345a7fc700 1 -- 172.21.15.153:0/2311806816 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3454011ad0 con 0x7f346406df10 2024-08-17T02:27:01.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.341+0000 7f346359e700 1 -- 172.21.15.153:0/2311806816 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34640ab2c0 con 0x7f346406df10 2024-08-17T02:27:01.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.341+0000 7f346359e700 1 -- 172.21.15.153:0/2311806816 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34640643a0 con 0x7f346406df10 2024-08-17T02:27:01.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.341+0000 7f345a7fc700 1 -- 172.21.15.153:0/2311806816 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f345401b3b0 con 0x7f346406df10 2024-08-17T02:27:01.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.345+0000 7f345a7fc700 1 --2- 172.21.15.153:0/2311806816 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3444060860 0x7f3444062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.345+0000 7f345a7fc700 1 -- 172.21.15.153:0/2311806816 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f345407bf30 con 0x7f346406df10 2024-08-17T02:27:01.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.345+0000 7f3461d9b700 1 --2- 172.21.15.153:0/2311806816 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3444060860 0x7f3444062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.345+0000 7f3461d9b700 1 --2- 172.21.15.153:0/2311806816 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3444060860 0x7f3444062d10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f344c009fd0 tx=0x7f344c009880 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.353+0000 7f345a7fc700 1 -- 172.21.15.153:0/2311806816 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f345404c380 con 0x7f346406df10 2024-08-17T02:27:01.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.549+0000 7f346359e700 1 -- 172.21.15.153:0/2311806816 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f346406f5f0 con 0x7f346406df10 2024-08-17T02:27:01.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.549+0000 7f345a7fc700 1 -- 172.21.15.153:0/2311806816 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f3454017020 con 0x7f346406df10 2024-08-17T02:27:01.552 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:27:01.552 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4885,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/747297575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":747297575},{"type":"v1","addr":"172.21.15.174:6833","nonce":747297575}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4891,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1080524090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1080524090},{"type":"v1","addr":"172.21.15.174:6835","nonce":1080524090}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5013,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2569513399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2569513399},{"type":"v1","addr":"172.21.15.153:6835","nonce":2569513399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:55.849257+0000","modified":"2024-08-17T02:26:59.510699+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5031},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5031":{"gid":5031,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6837/2567193475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":2567193475},{"type":"v1","addr":"172.21.15.153:6837","nonce":2567193475}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:27:01.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.553+0000 7f346359e700 1 -- 172.21.15.153:0/2311806816 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3444060860 msgr2=0x7f3444062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.553+0000 7f346359e700 1 --2- 172.21.15.153:0/2311806816 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3444060860 0x7f3444062d10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f344c009fd0 tx=0x7f344c009880 comp rx=0 tx=0).stop 2024-08-17T02:27:01.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.553+0000 7f346359e700 1 -- 172.21.15.153:0/2311806816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f346406df10 msgr2=0x7f34640aad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.553+0000 7f346359e700 1 --2- 172.21.15.153:0/2311806816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f346406df10 0x7f34640aad80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f345400c4e0 tx=0x7f345400c7f0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.553+0000 7f346359e700 1 -- 172.21.15.153:0/2311806816 shutdown_connections 2024-08-17T02:27:01.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.553+0000 7f346359e700 1 --2- 172.21.15.153:0/2311806816 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3444060860 0x7f3444062d10 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.553+0000 7f346359e700 1 --2- 172.21.15.153:0/2311806816 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3464155d20 0x7f3464149e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.553+0000 7f346359e700 1 --2- 172.21.15.153:0/2311806816 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34640b0350 0x7f34641469d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.553+0000 7f346359e700 1 --2- 172.21.15.153:0/2311806816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f346406df10 0x7f34640aad80 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.553+0000 7f346359e700 1 -- 172.21.15.153:0/2311806816 >> 172.21.15.153:0/2311806816 conn(0x7f34640678d0 msgr2=0x7f3464152190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:01.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.553+0000 7f346359e700 1 -- 172.21.15.153:0/2311806816 shutdown_connections 2024-08-17T02:27:01.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:01.553+0000 7f346359e700 1 -- 172.21.15.153:0/2311806816 wait complete. 2024-08-17T02:27:01.556 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 14 2024-08-17T02:27:01.969 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:26:55.849257+0000', 'modified': '2024-08-17T02:26:59.510699+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5031}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5031': {'gid': 5031, 'name': 'c', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.153:6837/2567193475', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6836', 'nonce': 2567193475}, {'type': 'v1', 'addr': '172.21.15.153:6837', 'nonce': 2567193475}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:27:01.970 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:27:01.970 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-08-17T02:27:02.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.089+0000 7f186f59e700 1 Processor -- start 2024-08-17T02:27:02.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.089+0000 7f186f59e700 1 -- start start 2024-08-17T02:27:02.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.089+0000 7f186f59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18701613e0 0x7f18701617b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.089+0000 7f186f59e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f18700b1a90 0x7f18700ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.089+0000 7f186f59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f18700adfa0 0x7f18700ae400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.089+0000 7f186f59e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18700b1ec0 con 0x7f18700adfa0 2024-08-17T02:27:02.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.089+0000 7f186f59e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18700acf00 con 0x7f18700b1a90 2024-08-17T02:27:02.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.089+0000 7f186f59e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18700ad1e0 con 0x7f18701613e0 2024-08-17T02:27:02.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.089+0000 7f186ed9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f18700adfa0 0x7f18700ae400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.089+0000 7f186ed9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f18700adfa0 0x7f18700ae400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59788/0 (socket says 172.21.15.153:59788) 2024-08-17T02:27:02.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.089+0000 7f186ed9d700 1 -- 172.21.15.153:0/2879282352 learned_addr learned my addr 172.21.15.153:0/2879282352 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:27:02.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.089+0000 7f186e59c700 1 --2- 172.21.15.153:0/2879282352 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18701613e0 0x7f18701617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.089+0000 7f186dd9b700 1 --2- 172.21.15.153:0/2879282352 >> v2:172.21.15.174:3300/0 conn(0x7f18700b1a90 0x7f18700ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.089+0000 7f186ed9d700 1 -- 172.21.15.153:0/2879282352 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18701613e0 msgr2=0x7f18701617b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:02.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.089+0000 7f186ed9d700 1 --2- 172.21.15.153:0/2879282352 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18701613e0 0x7f18701617b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.089+0000 7f186ed9d700 1 -- 172.21.15.153:0/2879282352 >> v2:172.21.15.174:3300/0 conn(0x7f18700b1a90 msgr2=0x7f18700ac6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:02.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.089+0000 7f186ed9d700 1 --2- 172.21.15.153:0/2879282352 >> v2:172.21.15.174:3300/0 conn(0x7f18700b1a90 0x7f18700ac6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.089+0000 7f186ed9d700 1 -- 172.21.15.153:0/2879282352 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18700ad4c0 con 0x7f18700adfa0 2024-08-17T02:27:02.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.089+0000 7f186ed9d700 1 --2- 172.21.15.153:0/2879282352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18700adfa0 0x7f18700ae400 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f18700b2f70 tx=0x7f1858009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae957b6e7561f9b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.089+0000 7f186d59a700 1 -- 172.21.15.153:0/2879282352 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185800b640 con 0x7f18700adfa0 2024-08-17T02:27:02.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.089+0000 7f186d59a700 1 -- 172.21.15.153:0/2879282352 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185800b7a0 con 0x7f18700adfa0 2024-08-17T02:27:02.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.089+0000 7f186d59a700 1 -- 172.21.15.153:0/2879282352 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185800bb60 con 0x7f18700adfa0 2024-08-17T02:27:02.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.093+0000 7f186f59e700 1 -- 172.21.15.153:0/2879282352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18700adfa0 msgr2=0x7f18700ae400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.093+0000 7f186f59e700 1 --2- 172.21.15.153:0/2879282352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18700adfa0 0x7f18700ae400 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f18700b2f70 tx=0x7f1858009250 comp rx=0 tx=0).stop 2024-08-17T02:27:02.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.093+0000 7f186f59e700 1 -- 172.21.15.153:0/2879282352 shutdown_connections 2024-08-17T02:27:02.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.093+0000 7f186f59e700 1 --2- 172.21.15.153:0/2879282352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18700adfa0 0x7f18700ae400 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.093+0000 7f186f59e700 1 --2- 172.21.15.153:0/2879282352 >> v2:172.21.15.174:3300/0 conn(0x7f18700b1a90 0x7f18700ac6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.093+0000 7f186f59e700 1 --2- 172.21.15.153:0/2879282352 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18701613e0 0x7f18701617b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.093+0000 7f186f59e700 1 -- 172.21.15.153:0/2879282352 >> 172.21.15.153:0/2879282352 conn(0x7f18700c9840 msgr2=0x7f18700c9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:02.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.093+0000 7f186f59e700 1 -- 172.21.15.153:0/2879282352 shutdown_connections 2024-08-17T02:27:02.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.093+0000 7f186f59e700 1 -- 172.21.15.153:0/2879282352 wait complete. 2024-08-17T02:27:02.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.097+0000 7f186f59e700 1 Processor -- start 2024-08-17T02:27:02.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.097+0000 7f186f59e700 1 -- start start 2024-08-17T02:27:02.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.097+0000 7f186f59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18700adfa0 0x7f187015dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.097+0000 7f186f59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18700b1a90 0x7f187015e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.097+0000 7f186f59e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18701613e0 0x7f187015eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.097+0000 7f186f59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1870155620 con 0x7f18700b1a90 2024-08-17T02:27:02.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.097+0000 7f186f59e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187015e250 con 0x7f18701613e0 2024-08-17T02:27:02.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.097+0000 7f186f59e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f187015fa40 con 0x7f18700adfa0 2024-08-17T02:27:02.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.097+0000 7f186dd9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18700b1a90 0x7f187015e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.097+0000 7f186dd9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18700b1a90 0x7f187015e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59802/0 (socket says 172.21.15.153:59802) 2024-08-17T02:27:02.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.097+0000 7f186dd9b700 1 -- 172.21.15.153:0/1492412150 learned_addr learned my addr 172.21.15.153:0/1492412150 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:27:02.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.097+0000 7f186e59c700 1 --2- 172.21.15.153:0/1492412150 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18700adfa0 0x7f187015dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.097+0000 7f186ed9d700 1 --2- 172.21.15.153:0/1492412150 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18701613e0 0x7f187015eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.097+0000 7f186dd9b700 1 -- 172.21.15.153:0/1492412150 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18700adfa0 msgr2=0x7f187015dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.097+0000 7f186dd9b700 1 --2- 172.21.15.153:0/1492412150 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18700adfa0 0x7f187015dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.097+0000 7f186dd9b700 1 -- 172.21.15.153:0/1492412150 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18701613e0 msgr2=0x7f187015eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.097+0000 7f186dd9b700 1 --2- 172.21.15.153:0/1492412150 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18701613e0 0x7f187015eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.097+0000 7f186dd9b700 1 -- 172.21.15.153:0/1492412150 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18580094f0 con 0x7f18700b1a90 2024-08-17T02:27:02.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.097+0000 7f186dd9b700 1 --2- 172.21.15.153:0/1492412150 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18700b1a90 0x7f187015e5f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f186000ecb0 tx=0x7f18600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.101+0000 7f18667fc700 1 -- 172.21.15.153:0/1492412150 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186000c850 con 0x7f18700b1a90 2024-08-17T02:27:02.104 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.101+0000 7f18667fc700 1 -- 172.21.15.153:0/1492412150 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186000c9b0 con 0x7f18700b1a90 2024-08-17T02:27:02.104 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.101+0000 7f186f59e700 1 -- 172.21.15.153:0/1492412150 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f187015f1a0 con 0x7f18700b1a90 2024-08-17T02:27:02.104 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.101+0000 7f18667fc700 1 -- 172.21.15.153:0/1492412150 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186000cd50 con 0x7f18700b1a90 2024-08-17T02:27:02.104 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.101+0000 7f186f59e700 1 -- 172.21.15.153:0/1492412150 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f187015f760 con 0x7f18700b1a90 2024-08-17T02:27:02.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.101+0000 7f18667fc700 1 -- 172.21.15.153:0/1492412150 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1860013680 con 0x7f18700b1a90 2024-08-17T02:27:02.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.101+0000 7f18667fc700 1 --2- 172.21.15.153:0/1492412150 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1850060890 0x7f1850062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.101+0000 7f186e59c700 1 --2- 172.21.15.153:0/1492412150 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1850060890 0x7f1850062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.105+0000 7f18667fc700 1 -- 172.21.15.153:0/1492412150 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f186007cd60 con 0x7f18700b1a90 2024-08-17T02:27:02.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.105+0000 7f186e59c700 1 --2- 172.21.15.153:0/1492412150 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1850060890 0x7f1850062d40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1868009fd0 tx=0x7f186800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.105+0000 7f18770fd740 1 Processor -- start 2024-08-17T02:27:02.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.105+0000 7f18770fd740 1 -- start start 2024-08-17T02:27:02.109 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.105+0000 7f18770fd740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x27aeae0 0x29e21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.109 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.105+0000 7f18770fd740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x27ae710 0x29e2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.109 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.105+0000 7f18770fd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27f9790 0x29e5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.109 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.105+0000 7f18770fd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x295aba0 con 0x27f9790 2024-08-17T02:27:02.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.105+0000 7f18770fd740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x2956b40 con 0x27ae710 2024-08-17T02:27:02.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.105+0000 7f18770fd740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x291c0a0 con 0x27aeae0 2024-08-17T02:27:02.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.105+0000 7f186ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27f9790 0x29e5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.105+0000 7f186dd9b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x27ae710 0x29e2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.105+0000 7f186e59c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x27aeae0 0x29e21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.105+0000 7f186dd9b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x27ae710 0x29e2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.153:55380/0 (socket says 172.21.15.153:55380) 2024-08-17T02:27:02.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.105+0000 7f186dd9b700 1 -- 172.21.15.153:0/515296868 learned_addr learned my addr 172.21.15.153:0/515296868 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:27:02.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.105+0000 7f186ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27f9790 0x29e5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59814/0 (socket says 172.21.15.153:59814) 2024-08-17T02:27:02.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.105+0000 7f186e59c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x27aeae0 0x29e21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.153:59308/0 (socket says 172.21.15.153:59308) 2024-08-17T02:27:02.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.105+0000 7f186dd9b700 1 -- 172.21.15.153:0/515296868 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x27aeae0 msgr2=0x29e21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:02.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.105+0000 7f186dd9b700 1 --2- 172.21.15.153:0/515296868 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x27aeae0 0x29e21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.105+0000 7f186dd9b700 1 -- 172.21.15.153:0/515296868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27f9790 msgr2=0x29e5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:02.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.105+0000 7f186dd9b700 1 --2- 172.21.15.153:0/515296868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27f9790 0x29e5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.105+0000 7f186dd9b700 1 -- 172.21.15.153:0/515296868 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x27fa9e0 con 0x27ae710 2024-08-17T02:27:02.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.105+0000 7f186ed9d700 1 --2- 172.21.15.153:0/515296868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27f9790 0x29e5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:02.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.105+0000 7f186dd9b700 1 --2- 172.21.15.153:0/515296868 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x27ae710 0x29e2710 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f186007b330 tx=0x7f186007b1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=934fcf566c2d9527 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.105+0000 7f184f7fe700 1 -- 172.21.15.153:0/515296868 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1860051610 con 0x27ae710 2024-08-17T02:27:02.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.105+0000 7f184f7fe700 1 -- 172.21.15.153:0/515296868 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1860054100 con 0x27ae710 2024-08-17T02:27:02.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.105+0000 7f184f7fe700 1 -- 172.21.15.153:0/515296868 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1860057e50 con 0x27ae710 2024-08-17T02:27:02.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.109+0000 7f18770fd740 1 -- 172.21.15.153:0/515296868 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x27ae710 msgr2=0x29e2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.109+0000 7f18770fd740 1 --2- 172.21.15.153:0/515296868 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x27ae710 0x29e2710 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f186007b330 tx=0x7f186007b1e0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.109+0000 7f18770fd740 1 -- 172.21.15.153:0/515296868 shutdown_connections 2024-08-17T02:27:02.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.109+0000 7f18770fd740 1 --2- 172.21.15.153:0/515296868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27f9790 0x29e5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.109+0000 7f18770fd740 1 --2- 172.21.15.153:0/515296868 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x27ae710 0x29e2710 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.109+0000 7f18770fd740 1 --2- 172.21.15.153:0/515296868 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x27aeae0 0x29e21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.109+0000 7f18770fd740 1 -- 172.21.15.153:0/515296868 >> 172.21.15.153:0/515296868 conn(0x27aeeb0 msgr2=0x29e80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:02.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.109+0000 7f18770fd740 1 -- 172.21.15.153:0/515296868 shutdown_connections 2024-08-17T02:27:02.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.109+0000 7f18770fd740 1 -- 172.21.15.153:0/515296868 wait complete. 2024-08-17T02:27:02.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.109+0000 7f18770fd740 1 -- start start 2024-08-17T02:27:02.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.109+0000 7f18770fd740 1 Processor -- start 2024-08-17T02:27:02.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.109+0000 7f18770fd740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x27ae710 0x2a2faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.109+0000 7f18770fd740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x27aeae0 0x2a2ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.109+0000 7f18770fd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27f9790 0x29e9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.109+0000 7f18770fd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x291bd40 con 0x27f9790 2024-08-17T02:27:02.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.109+0000 7f18770fd740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x28f4970 con 0x27ae710 2024-08-17T02:27:02.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.109+0000 7f18770fd740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x2956350 con 0x27aeae0 2024-08-17T02:27:02.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.109+0000 7f18770fd740 10 client.0 _ll_register_callbacks cb 0x28f8f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:27:02.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.109+0000 7f186ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27f9790 0x29e9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.109+0000 7f186ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27f9790 0x29e9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59820/0 (socket says 172.21.15.153:59820) 2024-08-17T02:27:02.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.109+0000 7f186ed9d700 1 -- 172.21.15.153:0/3135370939 learned_addr learned my addr 172.21.15.153:0/3135370939 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:27:02.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.113+0000 7f186dd9b700 1 --2- 172.21.15.153:0/3135370939 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x27aeae0 0x2a2ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.113+0000 7f186e59c700 1 --2- 172.21.15.153:0/3135370939 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x27ae710 0x2a2faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.113+0000 7f186ed9d700 1 -- 172.21.15.153:0/3135370939 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x27aeae0 msgr2=0x2a2ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:02.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.113+0000 7f186ed9d700 1 --2- 172.21.15.153:0/3135370939 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x27aeae0 0x2a2ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.113+0000 7f186ed9d700 1 -- 172.21.15.153:0/3135370939 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x27ae710 msgr2=0x2a2faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:02.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.113+0000 7f186ed9d700 1 --2- 172.21.15.153:0/3135370939 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x27ae710 0x2a2faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.113+0000 7f186ed9d700 1 -- 172.21.15.153:0/3135370939 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18700ad4c0 con 0x27f9790 2024-08-17T02:27:02.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.113+0000 7f186ed9d700 1 --2- 172.21.15.153:0/3135370939 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27f9790 0x29e9fd0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1858009f70 tx=0x7f1858017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64e9147570d9ba38 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.113+0000 7f184cff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-17T02:27:02.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.113+0000 7f184cff9700 1 -- 172.21.15.153:0/3135370939 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1858021070 con 0x27f9790 2024-08-17T02:27:02.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.113+0000 7f184cff9700 1 -- 172.21.15.153:0/3135370939 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f185801a630 con 0x27f9790 2024-08-17T02:27:02.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.113+0000 7f18770fd740 1 -- 172.21.15.153:0/3135370939 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x27bc260 con 0x27f9790 2024-08-17T02:27:02.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.113+0000 7f184cff9700 1 -- 172.21.15.153:0/3135370939 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f185801aa00 con 0x27f9790 2024-08-17T02:27:02.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.113+0000 7f18770fd740 10 client.5199 fetch_fsmap learned FSMap version 14 2024-08-17T02:27:02.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.113+0000 7f18770fd740 1 -- 172.21.15.153:0/3135370939 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x7f187015f760 con 0x27f9790 2024-08-17T02:27:02.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.113+0000 7f184cff9700 1 -- 172.21.15.153:0/3135370939 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x27bc260 con 0x27f9790 2024-08-17T02:27:02.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.113+0000 7f184cff9700 1 -- 172.21.15.153:0/3135370939 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 14) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f185801ab60 con 0x27f9790 2024-08-17T02:27:02.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.113+0000 7f18770fd740 10 client.5199 fetch_fsmap finished waiting for FSMap version 14 2024-08-17T02:27:02.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.113+0000 7f18770fd740 10 client.5199 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-17T02:27:02.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.113+0000 7f18770fd740 20 client.5199 populate_metadata read hostname 'smithi153' 2024-08-17T02:27:02.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.113+0000 7f18770fd740 1 --2- 172.21.15.153:0/3135370939 >> [v2:172.21.15.153:6836/2567193475,v1:172.21.15.153:6837/2567193475] conn(0x2a38c30 0x2a3b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.113+0000 7f18770fd740 4 client.5199 mds_command: new command op to 5031 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:27:02.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.113+0000 7f18770fd740 1 -- 172.21.15.153:0/3135370939 --> [v2:172.21.15.153:6836/2567193475,v1:172.21.15.153:6837/2567193475] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x28064e0 con 0x2a38c30 2024-08-17T02:27:02.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.113+0000 7f186e59c700 1 --2- 172.21.15.153:0/3135370939 >> [v2:172.21.15.153:6836/2567193475,v1:172.21.15.153:6837/2567193475] conn(0x2a38c30 0x2a3b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.113+0000 7f184cff9700 10 client.5199 ms_handle_connect on v2:172.21.15.153:6836/2567193475 2024-08-17T02:27:02.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.113+0000 7f186e59c700 1 --2- 172.21.15.153:0/3135370939 >> [v2:172.21.15.153:6836/2567193475,v1:172.21.15.153:6837/2567193475] conn(0x2a38c30 0x2a3b010 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96a003e0ec3fa816 server_cookie=beb6b51c9f810233 in_seq=0 out_seq=0 2024-08-17T02:27:02.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.113+0000 7f184cff9700 1 -- 172.21.15.153:0/3135370939 <== mds.0 v2:172.21.15.153:6836/2567193475 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x28064e0 con 0x2a38c30 2024-08-17T02:27:02.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.113+0000 7f184cff9700 10 client.5199 handle_command_reply: tid=0 2024-08-17T02:27:02.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.113+0000 7f18770fd740 1 client.5199 shutdown 2024-08-17T02:27:02.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.117+0000 7f18770fd740 1 -- 172.21.15.153:0/3135370939 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27f9790 msgr2=0x29e9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.117+0000 7f18770fd740 1 --2- 172.21.15.153:0/3135370939 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27f9790 0x29e9fd0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1858009f70 tx=0x7f1858017000 comp rx=0 tx=0).stop 2024-08-17T02:27:02.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.117+0000 7f18770fd740 1 -- 172.21.15.153:0/3135370939 shutdown_connections 2024-08-17T02:27:02.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.117+0000 7f18770fd740 1 --2- 172.21.15.153:0/3135370939 >> [v2:172.21.15.153:6836/2567193475,v1:172.21.15.153:6837/2567193475] conn(0x2a38c30 0x2a3b010 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.117+0000 7f18770fd740 1 --2- 172.21.15.153:0/3135370939 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27f9790 0x29e9fd0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.117+0000 7f184cff9700 0 client.5199 ms_handle_reset on v2:172.21.15.153:6836/2567193475 2024-08-17T02:27:02.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.117+0000 7f18770fd740 1 --2- 172.21.15.153:0/3135370939 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x27aeae0 0x2a2ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.117+0000 7f18770fd740 1 --2- 172.21.15.153:0/3135370939 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x27ae710 0x2a2faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.117+0000 7f18770fd740 1 -- 172.21.15.153:0/3135370939 >> 172.21.15.153:0/3135370939 conn(0x27aeeb0 msgr2=0x29e7ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:02.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.117+0000 7f18770fd740 1 -- 172.21.15.153:0/3135370939 shutdown_connections 2024-08-17T02:27:02.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.117+0000 7f18770fd740 1 -- 172.21.15.153:0/3135370939 wait complete. 2024-08-17T02:27:02.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.117+0000 7f18770fd740 20 client.5199 trim_cache size 0 max 16384 2024-08-17T02:27:02.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.137+0000 7f18770fd740 1 Processor -- start 2024-08-17T02:27:02.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.137+0000 7f18770fd740 1 -- start start 2024-08-17T02:27:02.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.137+0000 7f18770fd740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x27ae710 0x29e5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.137+0000 7f18770fd740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x27aeae0 0x29e61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.137+0000 7f18770fd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27f9790 0x29e1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.137+0000 7f18770fd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x28277c0 con 0x27f9790 2024-08-17T02:27:02.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.137+0000 7f18770fd740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x2954500 con 0x27ae710 2024-08-17T02:27:02.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.137+0000 7f18770fd740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x29209c0 con 0x27aeae0 2024-08-17T02:27:02.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.137+0000 7f186ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27f9790 0x29e1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.137+0000 7f186ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27f9790 0x29e1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59826/0 (socket says 172.21.15.153:59826) 2024-08-17T02:27:02.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.137+0000 7f186ed9d700 1 -- 172.21.15.153:0/1066816204 learned_addr learned my addr 172.21.15.153:0/1066816204 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:27:02.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.137+0000 7f186dd9b700 1 --2- 172.21.15.153:0/1066816204 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x27aeae0 0x29e61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.137+0000 7f186e59c700 1 --2- 172.21.15.153:0/1066816204 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x27ae710 0x29e5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.137+0000 7f186ed9d700 1 -- 172.21.15.153:0/1066816204 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x27aeae0 msgr2=0x29e61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:02.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.137+0000 7f186ed9d700 1 --2- 172.21.15.153:0/1066816204 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x27aeae0 0x29e61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.137+0000 7f186ed9d700 1 -- 172.21.15.153:0/1066816204 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x27ae710 msgr2=0x29e5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:02.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.137+0000 7f186ed9d700 1 --2- 172.21.15.153:0/1066816204 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x27ae710 0x29e5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.137+0000 7f186ed9d700 1 -- 172.21.15.153:0/1066816204 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2924370 con 0x27f9790 2024-08-17T02:27:02.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.137+0000 7f186e59c700 1 --2- 172.21.15.153:0/1066816204 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x27ae710 0x29e5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:02.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.141+0000 7f186ed9d700 1 --2- 172.21.15.153:0/1066816204 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27f9790 0x29e1b50 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1858006ee0 tx=0x7f1858024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d3b1a9191ea31e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.141+0000 7f184ffff700 1 -- 172.21.15.153:0/1066816204 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1858021040 con 0x27f9790 2024-08-17T02:27:02.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.141+0000 7f184ffff700 1 -- 172.21.15.153:0/1066816204 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1858022040 con 0x27f9790 2024-08-17T02:27:02.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.141+0000 7f184ffff700 1 -- 172.21.15.153:0/1066816204 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185801aa00 con 0x27f9790 2024-08-17T02:27:02.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.141+0000 7f18770fd740 1 -- 172.21.15.153:0/1066816204 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27f9790 msgr2=0x29e1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.141+0000 7f18770fd740 1 --2- 172.21.15.153:0/1066816204 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27f9790 0x29e1b50 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1858006ee0 tx=0x7f1858024000 comp rx=0 tx=0).stop 2024-08-17T02:27:02.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.141+0000 7f18770fd740 1 -- 172.21.15.153:0/1066816204 shutdown_connections 2024-08-17T02:27:02.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.141+0000 7f18770fd740 1 --2- 172.21.15.153:0/1066816204 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27f9790 0x29e1b50 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.141+0000 7f18770fd740 1 --2- 172.21.15.153:0/1066816204 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x27aeae0 0x29e61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.141+0000 7f18770fd740 1 --2- 172.21.15.153:0/1066816204 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x27ae710 0x29e5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.141+0000 7f18770fd740 1 -- 172.21.15.153:0/1066816204 >> 172.21.15.153:0/1066816204 conn(0x27aeeb0 msgr2=0x2a2ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:02.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.141+0000 7f18770fd740 1 -- 172.21.15.153:0/1066816204 shutdown_connections 2024-08-17T02:27:02.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.141+0000 7f18770fd740 1 -- 172.21.15.153:0/1066816204 wait complete. 2024-08-17T02:27:02.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.141+0000 7f18770fd740 1 -- start start 2024-08-17T02:27:02.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.141+0000 7f18770fd740 1 Processor -- start 2024-08-17T02:27:02.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.145+0000 7f18770fd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27ae710 0x2a3bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.145+0000 7f18770fd740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x27aeae0 0x2a43e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.145+0000 7f18770fd740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x27f9790 0x2a443d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.145+0000 7f18770fd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2951080 con 0x27ae710 2024-08-17T02:27:02.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.145+0000 7f18770fd740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x27ac430 con 0x27aeae0 2024-08-17T02:27:02.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.145+0000 7f18770fd740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x29573e0 con 0x27f9790 2024-08-17T02:27:02.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.145+0000 7f18770fd740 10 client.0 _ll_register_callbacks cb 0x277a9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:27:02.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.145+0000 7f186e59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27ae710 0x2a3bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.145+0000 7f186e59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27ae710 0x2a3bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59832/0 (socket says 172.21.15.153:59832) 2024-08-17T02:27:02.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.145+0000 7f186e59c700 1 -- 172.21.15.153:0/3511165243 learned_addr learned my addr 172.21.15.153:0/3511165243 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:27:02.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.145+0000 7f186dd9b700 1 --2- 172.21.15.153:0/3511165243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x27aeae0 0x2a43e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.145+0000 7f186ed9d700 1 --2- 172.21.15.153:0/3511165243 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x27f9790 0x2a443d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.145+0000 7f186e59c700 1 -- 172.21.15.153:0/3511165243 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x27f9790 msgr2=0x2a443d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:02.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.145+0000 7f186e59c700 1 --2- 172.21.15.153:0/3511165243 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x27f9790 0x2a443d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.145+0000 7f186e59c700 1 -- 172.21.15.153:0/3511165243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x27aeae0 msgr2=0x2a43e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:02.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.145+0000 7f186e59c700 1 --2- 172.21.15.153:0/3511165243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x27aeae0 0x2a43e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.145+0000 7f186e59c700 1 -- 172.21.15.153:0/3511165243 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f187015f760 con 0x27ae710 2024-08-17T02:27:02.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.145+0000 7f186e59c700 1 --2- 172.21.15.153:0/3511165243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27ae710 0x2a3bfa0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f186802b410 tx=0x7f1868026040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6a9b14d02ca5f67 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.145+0000 7f184cff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-17T02:27:02.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.145+0000 7f184cff9700 1 -- 172.21.15.153:0/3511165243 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186801c040 con 0x27ae710 2024-08-17T02:27:02.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.145+0000 7f18770fd740 1 -- 172.21.15.153:0/3511165243 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1860054100 con 0x27ae710 2024-08-17T02:27:02.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.145+0000 7f184cff9700 1 -- 172.21.15.153:0/3511165243 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f186802b780 con 0x27ae710 2024-08-17T02:27:02.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.145+0000 7f184cff9700 1 -- 172.21.15.153:0/3511165243 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f186800e040 con 0x27ae710 2024-08-17T02:27:02.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.145+0000 7f18770fd740 10 client.5205 fetch_fsmap learned FSMap version 14 2024-08-17T02:27:02.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.145+0000 7f18770fd740 1 -- 172.21.15.153:0/3511165243 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x290ad80 con 0x27ae710 2024-08-17T02:27:02.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.145+0000 7f184cff9700 1 -- 172.21.15.153:0/3511165243 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1860054100 con 0x27ae710 2024-08-17T02:27:02.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.145+0000 7f184cff9700 1 -- 172.21.15.153:0/3511165243 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 14) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f186802bb90 con 0x27ae710 2024-08-17T02:27:02.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.145+0000 7f18770fd740 10 client.5205 fetch_fsmap finished waiting for FSMap version 14 2024-08-17T02:27:02.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.145+0000 7f18770fd740 10 client.5205 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-17T02:27:02.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.145+0000 7f18770fd740 20 client.5205 populate_metadata read hostname 'smithi153' 2024-08-17T02:27:02.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.145+0000 7f18770fd740 1 --2- 172.21.15.153:0/3511165243 >> [v2:172.21.15.153:6836/2567193475,v1:172.21.15.153:6837/2567193475] conn(0x2a44910 0x2a876e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.145+0000 7f18770fd740 4 client.5205 mds_command: new command op to 5031 tid=0[{"prefix": "status"}] 2024-08-17T02:27:02.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.145+0000 7f18770fd740 1 -- 172.21.15.153:0/3511165243 --> [v2:172.21.15.153:6836/2567193475,v1:172.21.15.153:6837/2567193475] -- command(tid 0: {"prefix": "status"}) v1 -- 0x282b260 con 0x2a44910 2024-08-17T02:27:02.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.145+0000 7f186dd9b700 1 --2- 172.21.15.153:0/3511165243 >> [v2:172.21.15.153:6836/2567193475,v1:172.21.15.153:6837/2567193475] conn(0x2a44910 0x2a876e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.145+0000 7f184cff9700 10 client.5205 ms_handle_connect on v2:172.21.15.153:6836/2567193475 2024-08-17T02:27:02.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.145+0000 7f186dd9b700 1 --2- 172.21.15.153:0/3511165243 >> [v2:172.21.15.153:6836/2567193475,v1:172.21.15.153:6837/2567193475] conn(0x2a44910 0x2a876e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e351288c3d5925e server_cookie=15436792237bfdaa in_seq=0 out_seq=0 2024-08-17T02:27:02.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.149+0000 7f184cff9700 1 -- 172.21.15.153:0/3511165243 <== mds.0 v2:172.21.15.153:6836/2567193475 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x282b260 con 0x2a44910 2024-08-17T02:27:02.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.149+0000 7f184cff9700 10 client.5205 handle_command_reply: tid=0 2024-08-17T02:27:02.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.149+0000 7f18770fd740 1 client.5205 shutdown 2024-08-17T02:27:02.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.149+0000 7f18770fd740 1 -- 172.21.15.153:0/3511165243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27ae710 msgr2=0x2a3bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.149+0000 7f18770fd740 1 --2- 172.21.15.153:0/3511165243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27ae710 0x2a3bfa0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f186802b410 tx=0x7f1868026040 comp rx=0 tx=0).stop 2024-08-17T02:27:02.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.149+0000 7f18770fd740 1 -- 172.21.15.153:0/3511165243 shutdown_connections 2024-08-17T02:27:02.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.149+0000 7f18770fd740 1 --2- 172.21.15.153:0/3511165243 >> [v2:172.21.15.153:6836/2567193475,v1:172.21.15.153:6837/2567193475] conn(0x2a44910 0x2a876e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.149+0000 7f18770fd740 1 --2- 172.21.15.153:0/3511165243 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x27f9790 0x2a443d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.149+0000 7f18770fd740 1 --2- 172.21.15.153:0/3511165243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x27aeae0 0x2a43e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.149+0000 7f18770fd740 1 --2- 172.21.15.153:0/3511165243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27ae710 0x2a3bfa0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.149+0000 7f18770fd740 1 -- 172.21.15.153:0/3511165243 >> 172.21.15.153:0/3511165243 conn(0x27aeeb0 msgr2=0x29e7240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:02.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.149+0000 7f184cff9700 0 client.5205 ms_handle_reset on v2:172.21.15.153:6836/2567193475 2024-08-17T02:27:02.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.149+0000 7f18770fd740 1 -- 172.21.15.153:0/3511165243 shutdown_connections 2024-08-17T02:27:02.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.149+0000 7f18770fd740 1 -- 172.21.15.153:0/3511165243 wait complete. 2024-08-17T02:27:02.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.149+0000 7f18770fd740 20 client.5205 trim_cache size 0 max 16384 2024-08-17T02:27:02.154 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-08-17T02:27:02.154 INFO:teuthology.orchestra.run.smithi153.stdout: "cluster_fsid": "56d41c33-b929-456d-96be-2aac4ecd299d", 2024-08-17T02:27:02.154 INFO:teuthology.orchestra.run.smithi153.stdout: "whoami": 0, 2024-08-17T02:27:02.155 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 5031, 2024-08-17T02:27:02.155 INFO:teuthology.orchestra.run.smithi153.stdout: "want_state": "up:active", 2024-08-17T02:27:02.155 INFO:teuthology.orchestra.run.smithi153.stdout: "state": "up:active", 2024-08-17T02:27:02.155 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs", 2024-08-17T02:27:02.155 INFO:teuthology.orchestra.run.smithi153.stdout: "rank_uptime": 5.6418548089999998, 2024-08-17T02:27:02.155 INFO:teuthology.orchestra.run.smithi153.stdout: "mdsmap_epoch": 14, 2024-08-17T02:27:02.155 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch": 32, 2024-08-17T02:27:02.155 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch_barrier": 32, 2024-08-17T02:27:02.155 INFO:teuthology.orchestra.run.smithi153.stdout: "uptime": 12.607504586999999 2024-08-17T02:27:02.155 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-08-17T02:27:02.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.149+0000 7f186f59e700 1 -- 172.21.15.153:0/1492412150 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1850060890 msgr2=0x7f1850062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.149+0000 7f186f59e700 1 --2- 172.21.15.153:0/1492412150 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1850060890 0x7f1850062d40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1868009fd0 tx=0x7f186800b040 comp rx=0 tx=0).stop 2024-08-17T02:27:02.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.149+0000 7f186f59e700 1 -- 172.21.15.153:0/1492412150 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18700b1a90 msgr2=0x7f187015e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.149+0000 7f186f59e700 1 --2- 172.21.15.153:0/1492412150 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18700b1a90 0x7f187015e5f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f186000ecb0 tx=0x7f18600091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.149+0000 7f186f59e700 1 -- 172.21.15.153:0/1492412150 shutdown_connections 2024-08-17T02:27:02.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.149+0000 7f186f59e700 1 --2- 172.21.15.153:0/1492412150 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1850060890 0x7f1850062d40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.149+0000 7f186f59e700 1 --2- 172.21.15.153:0/1492412150 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18701613e0 0x7f187015eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.149+0000 7f186f59e700 1 --2- 172.21.15.153:0/1492412150 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18700b1a90 0x7f187015e5f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.149+0000 7f186f59e700 1 --2- 172.21.15.153:0/1492412150 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18700adfa0 0x7f187015dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.149+0000 7f186f59e700 1 -- 172.21.15.153:0/1492412150 >> 172.21.15.153:0/1492412150 conn(0x7f18700c9840 msgr2=0x7f18700cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:02.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.149+0000 7f186f59e700 1 -- 172.21.15.153:0/1492412150 shutdown_connections 2024-08-17T02:27:02.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.149+0000 7f186f59e700 1 -- 172.21.15.153:0/1492412150 wait complete. 2024-08-17T02:27:02.168 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:27:02.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.277+0000 7f7da55fc700 1 Processor -- start 2024-08-17T02:27:02.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.277+0000 7f7da55fc700 1 -- start start 2024-08-17T02:27:02.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.277+0000 7f7da55fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7da0156c40 0x7f7da00cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.277+0000 7f7da55fc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7da0068db0 0x7f7da00ca1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.277+0000 7f7da55fc700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7da01585b0 con 0x7f7da0157010 2024-08-17T02:27:02.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.277+0000 7f7da55fc700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7da00c9fd0 con 0x7f7da0156c40 2024-08-17T02:27:02.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.277+0000 7f7da55fc700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7da01579c0 con 0x7f7da0068db0 2024-08-17T02:27:02.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.281+0000 7f7d9ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7da0156c40 0x7f7da00cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.281+0000 7f7d9ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7da0156c40 0x7f7da00cbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35806/0 (socket says 172.21.15.153:35806) 2024-08-17T02:27:02.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.281+0000 7f7d977fe700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f7da0157010 0x7f7da00686a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.153:54150/0 (socket says 172.21.15.153:54150) 2024-08-17T02:27:02.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.281+0000 7f7d9ffff700 1 -- 172.21.15.153:0/4026345880 learned_addr learned my addr 172.21.15.153:0/4026345880 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:27:02.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.281+0000 7f7da4dfb700 1 --2- 172.21.15.153:0/4026345880 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7da0068db0 0x7f7da00ca1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.281+0000 7f7d9f7fe700 1 -- 172.21.15.153:0/4026345880 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3494662746 0 0) 0x7f7da01585b0 con 0x7f7da0157010 2024-08-17T02:27:02.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.281+0000 7f7d9f7fe700 1 -- 172.21.15.153:0/4026345880 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d8c003570 con 0x7f7da0157010 2024-08-17T02:27:02.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.281+0000 7f7da4dfb700 1 -- 172.21.15.153:0/4026345880 >> v2:172.21.15.153:3300/0 conn(0x7f7da0156c40 msgr2=0x7f7da00cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:02.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.281+0000 7f7da4dfb700 1 --2- 172.21.15.153:0/4026345880 >> v2:172.21.15.153:3300/0 conn(0x7f7da0156c40 0x7f7da00cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.281+0000 7f7da4dfb700 1 -- 172.21.15.153:0/4026345880 >> v1:172.21.15.174:6789/0 conn(0x7f7da0157010 legacy=0x7f7da00686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.281+0000 7f7da4dfb700 1 -- 172.21.15.153:0/4026345880 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da0157c80 con 0x7f7da0068db0 2024-08-17T02:27:02.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.281+0000 7f7da4dfb700 1 --2- 172.21.15.153:0/4026345880 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7da0068db0 0x7f7da00ca1f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7d98009e60 tx=0x7f7d98009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f49bad29dea0592f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.281+0000 7f7d9f7fe700 1 -- 172.21.15.153:0/4026345880 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9800e070 con 0x7f7da0068db0 2024-08-17T02:27:02.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.281+0000 7f7d9f7fe700 1 -- 172.21.15.153:0/4026345880 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d9800bab0 con 0x7f7da0068db0 2024-08-17T02:27:02.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.281+0000 7f7d9f7fe700 1 -- 172.21.15.153:0/4026345880 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9800be30 con 0x7f7da0068db0 2024-08-17T02:27:02.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.281+0000 7f7da55fc700 1 -- 172.21.15.153:0/4026345880 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7da0068db0 msgr2=0x7f7da00ca1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.281+0000 7f7da55fc700 1 --2- 172.21.15.153:0/4026345880 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7da0068db0 0x7f7da00ca1f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7d98009e60 tx=0x7f7d98009780 comp rx=0 tx=0).stop 2024-08-17T02:27:02.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.281+0000 7f7da55fc700 1 -- 172.21.15.153:0/4026345880 shutdown_connections 2024-08-17T02:27:02.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.281+0000 7f7da55fc700 1 --2- 172.21.15.153:0/4026345880 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7da0068db0 0x7f7da00ca1f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.281+0000 7f7da55fc700 1 --2- 172.21.15.153:0/4026345880 >> v2:172.21.15.153:3300/0 conn(0x7f7da0156c40 0x7f7da00cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.281+0000 7f7da55fc700 1 -- 172.21.15.153:0/4026345880 >> 172.21.15.153:0/4026345880 conn(0x7f7da006d800 msgr2=0x7f7da006dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:02.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.281+0000 7f7da55fc700 1 -- 172.21.15.153:0/4026345880 shutdown_connections 2024-08-17T02:27:02.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.281+0000 7f7da55fc700 1 -- 172.21.15.153:0/4026345880 wait complete. 2024-08-17T02:27:02.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.285+0000 7f7da55fc700 1 Processor -- start 2024-08-17T02:27:02.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.285+0000 7f7da55fc700 1 -- start start 2024-08-17T02:27:02.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.285+0000 7f7da55fc700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7da0068db0 0x7f7da0140320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.285+0000 7f7da55fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7da0156c40 0x7f7da0155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.285+0000 7f7da55fc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7da0157010 0x7f7da0155960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.285+0000 7f7da55fc700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da0144080 con 0x7f7da0156c40 2024-08-17T02:27:02.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.285+0000 7f7da55fc700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da0144920 con 0x7f7da0068db0 2024-08-17T02:27:02.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.285+0000 7f7da55fc700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7da0140860 con 0x7f7da0157010 2024-08-17T02:27:02.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.285+0000 7f7d977fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7da0156c40 0x7f7da0155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.285+0000 7f7d977fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7da0156c40 0x7f7da0155420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35822/0 (socket says 172.21.15.153:35822) 2024-08-17T02:27:02.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.285+0000 7f7d977fe700 1 -- 172.21.15.153:0/1319383999 learned_addr learned my addr 172.21.15.153:0/1319383999 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:27:02.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.285+0000 7f7da4dfb700 1 --2- 172.21.15.153:0/1319383999 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7da0157010 0x7f7da0155960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.285+0000 7f7d9ffff700 1 --2- 172.21.15.153:0/1319383999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7da0068db0 0x7f7da0140320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.285+0000 7f7d977fe700 1 -- 172.21.15.153:0/1319383999 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7da0157010 msgr2=0x7f7da0155960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.285+0000 7f7d977fe700 1 --2- 172.21.15.153:0/1319383999 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7da0157010 0x7f7da0155960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.285+0000 7f7d977fe700 1 -- 172.21.15.153:0/1319383999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7da0068db0 msgr2=0x7f7da0140320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.285+0000 7f7d977fe700 1 --2- 172.21.15.153:0/1319383999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7da0068db0 0x7f7da0140320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.285+0000 7f7d977fe700 1 -- 172.21.15.153:0/1319383999 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d98009a20 con 0x7f7da0156c40 2024-08-17T02:27:02.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.285+0000 7f7d9ffff700 1 --2- 172.21.15.153:0/1319383999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7da0068db0 0x7f7da0140320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:02.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.285+0000 7f7d977fe700 1 --2- 172.21.15.153:0/1319383999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7da0156c40 0x7f7da0155420 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7d8800c590 tx=0x7f7d88007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.285+0000 7f7d9cff9700 1 -- 172.21.15.153:0/1319383999 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d88005b40 con 0x7f7da0156c40 2024-08-17T02:27:02.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.285+0000 7f7d9cff9700 1 -- 172.21.15.153:0/1319383999 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d88005ca0 con 0x7f7da0156c40 2024-08-17T02:27:02.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.285+0000 7f7da55fc700 1 -- 172.21.15.153:0/1319383999 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7da00c2230 con 0x7f7da0156c40 2024-08-17T02:27:02.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.285+0000 7f7d9cff9700 1 -- 172.21.15.153:0/1319383999 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d88007320 con 0x7f7da0156c40 2024-08-17T02:27:02.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.285+0000 7f7da55fc700 1 -- 172.21.15.153:0/1319383999 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7da01445b0 con 0x7f7da0156c40 2024-08-17T02:27:02.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.289+0000 7f7da55fc700 1 -- 172.21.15.153:0/1319383999 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7da0144a90 con 0x7f7da0156c40 2024-08-17T02:27:02.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.289+0000 7f7d9cff9700 1 -- 172.21.15.153:0/1319383999 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7d8801b3b0 con 0x7f7da0156c40 2024-08-17T02:27:02.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.289+0000 7f7d9cff9700 1 --2- 172.21.15.153:0/1319383999 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7d80060890 0x7f7d80062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.289+0000 7f7d9cff9700 1 -- 172.21.15.153:0/1319383999 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7d8807c0b0 con 0x7f7da0156c40 2024-08-17T02:27:02.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.289+0000 7f7d9ffff700 1 --2- 172.21.15.153:0/1319383999 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7d80060890 0x7f7d80062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.289+0000 7f7d9ffff700 1 --2- 172.21.15.153:0/1319383999 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7d80060890 0x7f7d80062d40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7d90006d40 tx=0x7f7d90008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.301+0000 7f7d9cff9700 1 -- 172.21.15.153:0/1319383999 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f7d8804c500 con 0x7f7da0156c40 2024-08-17T02:27:02.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.497+0000 7f7da55fc700 1 -- 172.21.15.153:0/1319383999 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7da00638f0 con 0x7f7da0156c40 2024-08-17T02:27:02.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.501+0000 7f7d9cff9700 1 -- 172.21.15.153:0/1319383999 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7d88017060 con 0x7f7da0156c40 2024-08-17T02:27:02.503 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:27:02.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.501+0000 7f7da55fc700 1 -- 172.21.15.153:0/1319383999 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7d80060890 msgr2=0x7f7d80062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.501+0000 7f7da55fc700 1 --2- 172.21.15.153:0/1319383999 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7d80060890 0x7f7d80062d40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7d90006d40 tx=0x7f7d90008040 comp rx=0 tx=0).stop 2024-08-17T02:27:02.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.501+0000 7f7da55fc700 1 -- 172.21.15.153:0/1319383999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7da0156c40 msgr2=0x7f7da0155420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.501+0000 7f7da55fc700 1 --2- 172.21.15.153:0/1319383999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7da0156c40 0x7f7da0155420 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7d8800c590 tx=0x7f7d88007dc0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.501+0000 7f7da55fc700 1 -- 172.21.15.153:0/1319383999 shutdown_connections 2024-08-17T02:27:02.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.501+0000 7f7da55fc700 1 --2- 172.21.15.153:0/1319383999 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7d80060890 0x7f7d80062d40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.501+0000 7f7da55fc700 1 --2- 172.21.15.153:0/1319383999 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7da0157010 0x7f7da0155960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.501+0000 7f7da55fc700 1 --2- 172.21.15.153:0/1319383999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7da0156c40 0x7f7da0155420 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.501+0000 7f7da55fc700 1 --2- 172.21.15.153:0/1319383999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7da0068db0 0x7f7da0140320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.501+0000 7f7da55fc700 1 -- 172.21.15.153:0/1319383999 >> 172.21.15.153:0/1319383999 conn(0x7f7da006d800 msgr2=0x7f7da015b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:02.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.501+0000 7f7da55fc700 1 -- 172.21.15.153:0/1319383999 shutdown_connections 2024-08-17T02:27:02.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:02.501+0000 7f7da55fc700 1 -- 172.21.15.153:0/1319383999 wait complete. 2024-08-17T02:27:02.516 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:27:02.517 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:27:02.517 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2024-08-17T02:27:02.517 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:27:02.517 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:27:02.517 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:27:02.517 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:27:02.517 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:27:02.517 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:27:02.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:02.518 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2024-08-17T02:27:02.526 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:27:02.526 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:27:02.526 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:27:02.527 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:02.527 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-08-17T02:27:02.527 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:02.527 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:27:02.527 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:02.527 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:27:02.527 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:02.527 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:27:02.527 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:02.527 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:27:02.527 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:02.528 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-08-17T02:27:02.528 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42519sec preferred_lft 42519sec 2024-08-17T02:27:02.528 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link 2024-08-17T02:27:02.528 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:02.528 INFO:teuthology.orchestra.run.smithi153.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-17T02:27:02.528 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 02:42:ca:5f:b2:93 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:02.528 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-17T02:27:02.528 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:02.528 INFO:teuthology.orchestra.run.smithi153.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:27:02.528 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether a2:cf:88:b6:06:39 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:02.528 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:27:02.528 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:02.528 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::1c95:d9ff:fe34:e022/64 scope link 2024-08-17T02:27:02.529 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:02.529 INFO:teuthology.orchestra.run.smithi153.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:27:02.529 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether a2:cf:88:b6:06:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:27:02.529 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::a0cf:88ff:feb6:639/64 scope link 2024-08-17T02:27:02.529 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:02.529 INFO:teuthology.orchestra.run.smithi153.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:27:02.529 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether d2:e2:73:e3:04:60 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:27:02.529 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::d0e2:73ff:fee3:460/64 scope link 2024-08-17T02:27:02.529 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:02.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:02.529 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:27:02.585 INFO:teuthology.orchestra.run.smithi153.stdout:1 2024-08-17T02:27:02.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:02.587 DEBUG:teuthology.orchestra.run.smithi153:> route 2024-08-17T02:27:02.596 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2024-08-17T02:27:02.596 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:27:02.596 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-08-17T02:27:02.596 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:27:02.596 INFO:teuthology.orchestra.run.smithi153.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-17T02:27:02.596 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-08-17T02:27:02.596 INFO:teuthology.orchestra.run.smithi153.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-17T02:27:02.596 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:27:02.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:02.596 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2024-08-17T02:27:02.597 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-08-17T02:27:02.597 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:27:02.597 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:27:02.597 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:27:02.597 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-08-17T02:27:02.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:02.632 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-08-17T02:27:02.640 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:27:02.640 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:27:02.640 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:27:02.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:02.640 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2024-08-17T02:27:02.696 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-08-17T02:27:02.697 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:27:02.697 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:27:02.704 INFO:teuthology.orchestra.run.smithi153.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:27:02.704 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:27:02.704 DEBUG:teuthology.orchestra.run.smithi153:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:27:02.709 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-08-17T02:27:02.725 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:27:02.725 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:27:02.781 INFO:teuthology.orchestra.run.smithi153.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:27:02.782 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:27:02.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:02.783 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-08-17T02:27:02.788 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-17T02:27:02.788 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-08-17T02:27:02.790 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-08-17T02:27:02.809 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:27:02.809 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:27:02.819 INFO:teuthology.orchestra.run.smithi153.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:27:02.819 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:27:02.820 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:02.820 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-08-17T02:27:02.877 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi153.stderr:2024-08-17T02:27:02.873+0000 7f96e22c9380 -1 init, newargv = 0x5603412b2900 newargc=15 2024-08-17T02:27:02.878 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi153.stderr:ceph-fuse[32833]: starting ceph client 2024-08-17T02:27:02.886 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi153.stderr:ceph-fuse[32833]: starting fuse 2024-08-17T02:27:03.971 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-08-17T02:27:03.990 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:27:03.990 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:27:04.049 INFO:teuthology.orchestra.run.smithi153.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:27:04.050 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:27:04.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:04.051 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-08-17T02:27:04.058 INFO:teuthology.orchestra.run.smithi153.stdout:52 2024-08-17T02:27:04.058 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-08-17T02:27:04.058 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-17T02:27:04.059 DEBUG:teuthology.orchestra.run.smithi153:> import glob 2024-08-17T02:27:04.059 DEBUG:teuthology.orchestra.run.smithi153:> import re 2024-08-17T02:27:04.059 DEBUG:teuthology.orchestra.run.smithi153:> import os 2024-08-17T02:27:04.059 DEBUG:teuthology.orchestra.run.smithi153:> import subprocess 2024-08-17T02:27:04.059 DEBUG:teuthology.orchestra.run.smithi153:> 2024-08-17T02:27:04.059 DEBUG:teuthology.orchestra.run.smithi153:> def _find_admin_socket(client_name): 2024-08-17T02:27:04.059 DEBUG:teuthology.orchestra.run.smithi153:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-08-17T02:27:04.059 DEBUG:teuthology.orchestra.run.smithi153:> files = glob.glob(asok_path) 2024-08-17T02:27:04.059 DEBUG:teuthology.orchestra.run.smithi153:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-08-17T02:27:04.059 DEBUG:teuthology.orchestra.run.smithi153:> 2024-08-17T02:27:04.059 DEBUG:teuthology.orchestra.run.smithi153:> # Given a non-glob path, it better be there 2024-08-17T02:27:04.059 DEBUG:teuthology.orchestra.run.smithi153:> if "*" not in asok_path: 2024-08-17T02:27:04.059 DEBUG:teuthology.orchestra.run.smithi153:> assert(len(files) == 1) 2024-08-17T02:27:04.059 DEBUG:teuthology.orchestra.run.smithi153:> return files[0] 2024-08-17T02:27:04.060 DEBUG:teuthology.orchestra.run.smithi153:> 2024-08-17T02:27:04.060 DEBUG:teuthology.orchestra.run.smithi153:> for f in files: 2024-08-17T02:27:04.060 DEBUG:teuthology.orchestra.run.smithi153:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-17T02:27:04.060 DEBUG:teuthology.orchestra.run.smithi153:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-17T02:27:04.060 DEBUG:teuthology.orchestra.run.smithi153:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-17T02:27:04.060 DEBUG:teuthology.orchestra.run.smithi153:> contents = proc_f.read() 2024-08-17T02:27:04.060 DEBUG:teuthology.orchestra.run.smithi153:> if mountpoint in contents: 2024-08-17T02:27:04.060 DEBUG:teuthology.orchestra.run.smithi153:> return f 2024-08-17T02:27:04.060 DEBUG:teuthology.orchestra.run.smithi153:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-17T02:27:04.060 DEBUG:teuthology.orchestra.run.smithi153:> 2024-08-17T02:27:04.060 DEBUG:teuthology.orchestra.run.smithi153:> print(_find_admin_socket("client.0")) 2024-08-17T02:27:04.060 DEBUG:teuthology.orchestra.run.smithi153:> ' 2024-08-17T02:27:04.140 INFO:teuthology.orchestra.run.smithi153.stdout:/var/run/ceph/ceph-client.0.32833.asok 2024-08-17T02:27:04.324 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.32833.asok 2024-08-17T02:27:04.324 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:04.324 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.32833.asok status 2024-08-17T02:27:04.431 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-08-17T02:27:04.431 INFO:teuthology.orchestra.run.smithi153.stdout: "metadata": { 2024-08-17T02:27:04.431 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_sha1": "2577e8139c6b8786f9d6d6ea21b8da9244b9260e", 2024-08-17T02:27:04.431 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_version": "ceph version 17.2.7-1375-g2577e813 (2577e8139c6b8786f9d6d6ea21b8da9244b9260e) quincy (stable)", 2024-08-17T02:27:04.431 INFO:teuthology.orchestra.run.smithi153.stdout: "entity_id": "0", 2024-08-17T02:27:04.431 INFO:teuthology.orchestra.run.smithi153.stdout: "hostname": "smithi153", 2024-08-17T02:27:04.431 INFO:teuthology.orchestra.run.smithi153.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-08-17T02:27:04.431 INFO:teuthology.orchestra.run.smithi153.stdout: "pid": "32833", 2024-08-17T02:27:04.432 INFO:teuthology.orchestra.run.smithi153.stdout: "root": "/" 2024-08-17T02:27:04.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-17T02:27:04.432 INFO:teuthology.orchestra.run.smithi153.stdout: "dentry_count": 0, 2024-08-17T02:27:04.432 INFO:teuthology.orchestra.run.smithi153.stdout: "dentry_pinned_count": 0, 2024-08-17T02:27:04.432 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 5217, 2024-08-17T02:27:04.432 INFO:teuthology.orchestra.run.smithi153.stdout: "inst": { 2024-08-17T02:27:04.432 INFO:teuthology.orchestra.run.smithi153.stdout: "name": { 2024-08-17T02:27:04.432 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "client", 2024-08-17T02:27:04.432 INFO:teuthology.orchestra.run.smithi153.stdout: "num": 5217 2024-08-17T02:27:04.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-17T02:27:04.432 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": { 2024-08-17T02:27:04.432 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "v1", 2024-08-17T02:27:04.432 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:27:04.433 INFO:teuthology.orchestra.run.smithi153.stdout: "nonce": 2799766407 2024-08-17T02:27:04.433 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-17T02:27:04.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-17T02:27:04.433 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": { 2024-08-17T02:27:04.433 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "v1", 2024-08-17T02:27:04.433 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:27:04.433 INFO:teuthology.orchestra.run.smithi153.stdout: "nonce": 2799766407 2024-08-17T02:27:04.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-17T02:27:04.433 INFO:teuthology.orchestra.run.smithi153.stdout: "inst_str": "client.5217 192.168.0.1:0/2799766407", 2024-08-17T02:27:04.433 INFO:teuthology.orchestra.run.smithi153.stdout: "addr_str": "192.168.0.1:0/2799766407", 2024-08-17T02:27:04.433 INFO:teuthology.orchestra.run.smithi153.stdout: "inode_count": 1, 2024-08-17T02:27:04.433 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_epoch": 14, 2024-08-17T02:27:04.434 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_epoch": 32, 2024-08-17T02:27:04.434 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_epoch_barrier": 0, 2024-08-17T02:27:04.434 INFO:teuthology.orchestra.run.smithi153.stdout: "blocklisted": false, 2024-08-17T02:27:04.434 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs" 2024-08-17T02:27:04.434 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-08-17T02:27:04.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:04.441 DEBUG:teuthology.orchestra.run.smithi153:> stat --file-system '--printf=%T 2024-08-17T02:27:04.441 DEBUG:teuthology.orchestra.run.smithi153:> ' -- /home/ubuntu/cephtest/mnt.0 2024-08-17T02:27:04.447 INFO:teuthology.orchestra.run.smithi153.stdout:fuseblk 2024-08-17T02:27:04.448 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-08-17T02:27:04.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:04.448 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:27:04.461 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:27:04.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.576+0000 7fd4eb323700 1 Processor -- start 2024-08-17T02:27:04.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.576+0000 7fd4eb323700 1 -- start start 2024-08-17T02:27:04.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.580+0000 7fd4eb323700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4e4156d80 0x7fd4e40aec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:04.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.580+0000 7fd4eb323700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd4e40af170 0x7fd4e4067840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:04.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.580+0000 7fd4eb323700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e40cc8c0 con 0x7fd4e4067d80 2024-08-17T02:27:04.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.580+0000 7fd4eb323700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4e40af5c0 con 0x7fd4e40af170 2024-08-17T02:27:04.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.580+0000 7fd4eb323700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e40681e0 con 0x7fd4e4156d80 2024-08-17T02:27:04.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.580+0000 7fd4e9b20700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd4e40af170 0x7fd4e4067840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:04.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.580+0000 7fd4e9b20700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd4e40af170 0x7fd4e4067840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35828/0 (socket says 172.21.15.153:35828) 2024-08-17T02:27:04.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.580+0000 7fd4e9b20700 1 -- 172.21.15.153:0/1218759377 learned_addr learned my addr 172.21.15.153:0/1218759377 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:27:04.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.580+0000 7fd4ea321700 1 --2- 172.21.15.153:0/1218759377 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4e4156d80 0x7fd4e40aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:04.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.580+0000 7fd4e9b20700 1 -- 172.21.15.153:0/1218759377 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4e4156d80 msgr2=0x7fd4e40aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:04.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.580+0000 7fd4e9b20700 1 --2- 172.21.15.153:0/1218759377 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4e4156d80 0x7fd4e40aec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.580+0000 7fd4e931f700 1 -- 172.21.15.153:0/1218759377 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3885728368 0 0) 0x7fd4e40cc8c0 con 0x7fd4e4067d80 2024-08-17T02:27:04.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.580+0000 7fd4e9b20700 1 -- 172.21.15.153:0/1218759377 >> v1:172.21.15.174:6789/0 conn(0x7fd4e4067d80 legacy=0x7fd4e40cac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:04.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.580+0000 7fd4e9b20700 1 -- 172.21.15.153:0/1218759377 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e4068450 con 0x7fd4e40af170 2024-08-17T02:27:04.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.580+0000 7fd4e9b20700 1 --2- 172.21.15.153:0/1218759377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4e40af170 0x7fd4e4067840 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd4d40099b0 tx=0x7fd4d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d5635519836cca3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:04.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.580+0000 7fd4e931f700 1 -- 172.21.15.153:0/1218759377 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d4009ea0 con 0x7fd4e40af170 2024-08-17T02:27:04.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.580+0000 7fd4e931f700 1 -- 172.21.15.153:0/1218759377 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d400b860 con 0x7fd4e40af170 2024-08-17T02:27:04.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.580+0000 7fd4e931f700 1 -- 172.21.15.153:0/1218759377 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d400bc00 con 0x7fd4e40af170 2024-08-17T02:27:04.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.580+0000 7fd4eb323700 1 -- 172.21.15.153:0/1218759377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4e40af170 msgr2=0x7fd4e4067840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:04.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.580+0000 7fd4eb323700 1 --2- 172.21.15.153:0/1218759377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4e40af170 0x7fd4e4067840 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd4d40099b0 tx=0x7fd4d4009250 comp rx=0 tx=0).stop 2024-08-17T02:27:04.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.580+0000 7fd4eb323700 1 -- 172.21.15.153:0/1218759377 shutdown_connections 2024-08-17T02:27:04.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.580+0000 7fd4eb323700 1 --2- 172.21.15.153:0/1218759377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4e40af170 0x7fd4e4067840 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.580+0000 7fd4eb323700 1 --2- 172.21.15.153:0/1218759377 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4e4156d80 0x7fd4e40aec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.580+0000 7fd4eb323700 1 -- 172.21.15.153:0/1218759377 >> 172.21.15.153:0/1218759377 conn(0x7fd4e406e070 msgr2=0x7fd4e40b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:04.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.580+0000 7fd4eb323700 1 -- 172.21.15.153:0/1218759377 shutdown_connections 2024-08-17T02:27:04.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.580+0000 7fd4eb323700 1 -- 172.21.15.153:0/1218759377 wait complete. 2024-08-17T02:27:04.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.584+0000 7fd4eb323700 1 Processor -- start 2024-08-17T02:27:04.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.584+0000 7fd4eb323700 1 -- start start 2024-08-17T02:27:04.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.584+0000 7fd4eb323700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4e4067d80 0x7fd4e414e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:04.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.584+0000 7fd4eb323700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4e40af170 0x7fd4e4159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:04.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.584+0000 7fd4eb323700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4e4156d80 0x7fd4e415a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:04.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.584+0000 7fd4eb323700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e40afdc0 con 0x7fd4e40af170 2024-08-17T02:27:04.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.584+0000 7fd4eb323700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e4159950 con 0x7fd4e4156d80 2024-08-17T02:27:04.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.584+0000 7fd4eb323700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e40affd0 con 0x7fd4e4067d80 2024-08-17T02:27:04.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.584+0000 7fd4e9b20700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4e40af170 0x7fd4e4159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:04.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.584+0000 7fd4ea321700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4e4067d80 0x7fd4e414e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:04.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.584+0000 7fd4e9b20700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4e40af170 0x7fd4e4159d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35834/0 (socket says 172.21.15.153:35834) 2024-08-17T02:27:04.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.584+0000 7fd4ea321700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4e4067d80 0x7fd4e414e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.153:41856/0 (socket says 172.21.15.153:41856) 2024-08-17T02:27:04.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.584+0000 7fd4e9b20700 1 -- 172.21.15.153:0/2264912305 learned_addr learned my addr 172.21.15.153:0/2264912305 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:27:04.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.584+0000 7fd4eab22700 1 --2- 172.21.15.153:0/2264912305 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4e4156d80 0x7fd4e415a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:04.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.584+0000 7fd4e9b20700 1 -- 172.21.15.153:0/2264912305 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4e4067d80 msgr2=0x7fd4e414e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:04.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.584+0000 7fd4e9b20700 1 --2- 172.21.15.153:0/2264912305 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4e4067d80 0x7fd4e414e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.584+0000 7fd4e9b20700 1 -- 172.21.15.153:0/2264912305 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4e4156d80 msgr2=0x7fd4e415a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:04.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.584+0000 7fd4e9b20700 1 --2- 172.21.15.153:0/2264912305 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4e4156d80 0x7fd4e415a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.584+0000 7fd4e9b20700 1 -- 172.21.15.153:0/2264912305 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d40094f0 con 0x7fd4e40af170 2024-08-17T02:27:04.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.588+0000 7fd4e9b20700 1 --2- 172.21.15.153:0/2264912305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4e40af170 0x7fd4e4159d20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd4e406fbe0 tx=0x7fd4d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:04.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.588+0000 7fd4da7fc700 1 -- 172.21.15.153:0/2264912305 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d4000d10 con 0x7fd4e40af170 2024-08-17T02:27:04.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.588+0000 7fd4da7fc700 1 -- 172.21.15.153:0/2264912305 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d400bbe0 con 0x7fd4e40af170 2024-08-17T02:27:04.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.588+0000 7fd4eb323700 1 -- 172.21.15.153:0/2264912305 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e40b02b0 con 0x7fd4e40af170 2024-08-17T02:27:04.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.588+0000 7fd4da7fc700 1 -- 172.21.15.153:0/2264912305 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d4011670 con 0x7fd4e40af170 2024-08-17T02:27:04.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.588+0000 7fd4eb323700 1 -- 172.21.15.153:0/2264912305 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e40b2200 con 0x7fd4e40af170 2024-08-17T02:27:04.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.588+0000 7fd4da7fc700 1 -- 172.21.15.153:0/2264912305 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd4d40119e0 con 0x7fd4e40af170 2024-08-17T02:27:04.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.588+0000 7fd4eb323700 1 -- 172.21.15.153:0/2264912305 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4e41534c0 con 0x7fd4e40af170 2024-08-17T02:27:04.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.588+0000 7fd4da7fc700 1 --2- 172.21.15.153:0/2264912305 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd4c8060860 0x7fd4c8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:04.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.588+0000 7fd4da7fc700 1 -- 172.21.15.153:0/2264912305 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd4d407e390 con 0x7fd4e40af170 2024-08-17T02:27:04.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.588+0000 7fd4ea321700 1 --2- 172.21.15.153:0/2264912305 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd4c8060860 0x7fd4c8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:04.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.592+0000 7fd4ea321700 1 --2- 172.21.15.153:0/2264912305 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd4c8060860 0x7fd4c8062d10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd4e406bc60 tx=0x7fd4e00091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:04.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.596+0000 7fd4da7fc700 1 -- 172.21.15.153:0/2264912305 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd4e41534c0 con 0x7fd4e40af170 2024-08-17T02:27:04.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.796+0000 7fd4eb323700 1 -- 172.21.15.153:0/2264912305 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd4e41534c0 con 0x7fd4e40af170 2024-08-17T02:27:04.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.796+0000 7fd4da7fc700 1 -- 172.21.15.153:0/2264912305 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd4e41534c0 con 0x7fd4e40af170 2024-08-17T02:27:04.800 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:27:04.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.800+0000 7fd4eb323700 1 -- 172.21.15.153:0/2264912305 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd4c8060860 msgr2=0x7fd4c8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:04.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.800+0000 7fd4eb323700 1 --2- 172.21.15.153:0/2264912305 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd4c8060860 0x7fd4c8062d10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd4e406bc60 tx=0x7fd4e00091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.800+0000 7fd4eb323700 1 -- 172.21.15.153:0/2264912305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4e40af170 msgr2=0x7fd4e4159d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:04.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.800+0000 7fd4eb323700 1 --2- 172.21.15.153:0/2264912305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4e40af170 0x7fd4e4159d20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd4e406fbe0 tx=0x7fd4d4017000 comp rx=0 tx=0).stop 2024-08-17T02:27:04.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.800+0000 7fd4eb323700 1 -- 172.21.15.153:0/2264912305 shutdown_connections 2024-08-17T02:27:04.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.800+0000 7fd4eb323700 1 --2- 172.21.15.153:0/2264912305 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd4c8060860 0x7fd4c8062d10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.800+0000 7fd4eb323700 1 --2- 172.21.15.153:0/2264912305 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4e4156d80 0x7fd4e415a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.800+0000 7fd4eb323700 1 --2- 172.21.15.153:0/2264912305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4e40af170 0x7fd4e4159d20 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.800+0000 7fd4eb323700 1 --2- 172.21.15.153:0/2264912305 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4e4067d80 0x7fd4e414e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.800+0000 7fd4eb323700 1 -- 172.21.15.153:0/2264912305 >> 172.21.15.153:0/2264912305 conn(0x7fd4e406e070 msgr2=0x7fd4e4152db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:04.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.800+0000 7fd4eb323700 1 -- 172.21.15.153:0/2264912305 shutdown_connections 2024-08-17T02:27:04.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:04.800+0000 7fd4eb323700 1 -- 172.21.15.153:0/2264912305 wait complete. 2024-08-17T02:27:04.815 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:27:04.815 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:27:04.815 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi174.front.sepia.ceph.com 2024-08-17T02:27:04.815 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:27:04.815 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:27:04.815 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:27:04.816 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:27:04.816 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:27:04.816 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:27:04.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:04.816 DEBUG:teuthology.orchestra.run.smithi174:> ip addr 2024-08-17T02:27:04.824 INFO:teuthology.orchestra.run.smithi174.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:27:04.825 INFO:teuthology.orchestra.run.smithi174.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:27:04.825 INFO:teuthology.orchestra.run.smithi174.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:27:04.825 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:04.825 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 ::1/128 scope host 2024-08-17T02:27:04.825 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:04.825 INFO:teuthology.orchestra.run.smithi174.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:27:04.825 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e0 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:04.825 INFO:teuthology.orchestra.run.smithi174.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:27:04.825 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e1 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:04.825 INFO:teuthology.orchestra.run.smithi174.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:27:04.825 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1a brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:04.825 INFO:teuthology.orchestra.run.smithi174.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:27:04.825 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1b brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:04.826 INFO:teuthology.orchestra.run.smithi174.stdout: inet 172.21.15.174/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-08-17T02:27:04.826 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft 42508sec preferred_lft 42508sec 2024-08-17T02:27:04.826 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::ec4:7aff:fe88:771b/64 scope link 2024-08-17T02:27:04.826 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:04.826 INFO:teuthology.orchestra.run.smithi174.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-17T02:27:04.826 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 02:42:a3:71:98:af brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:04.826 INFO:teuthology.orchestra.run.smithi174.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-17T02:27:04.826 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:04.826 INFO:teuthology.orchestra.run.smithi174.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:27:04.826 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 42:83:79:c9:cd:e3 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:04.826 INFO:teuthology.orchestra.run.smithi174.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:27:04.826 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:04.827 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::981d:53ff:fee6:6727/64 scope link 2024-08-17T02:27:04.827 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:04.827 INFO:teuthology.orchestra.run.smithi174.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:27:04.827 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 42:83:79:c9:cd:e3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:27:04.827 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::4083:79ff:fec9:cde3/64 scope link 2024-08-17T02:27:04.827 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:04.827 INFO:teuthology.orchestra.run.smithi174.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:27:04.827 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 66:c8:ba:33:2e:4a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:27:04.827 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::64c8:baff:fe33:2e4a/64 scope link 2024-08-17T02:27:04.827 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:04.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:04.828 DEBUG:teuthology.orchestra.run.smithi174:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:27:04.842 INFO:teuthology.orchestra.run.smithi174.stdout:1 2024-08-17T02:27:04.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:04.844 DEBUG:teuthology.orchestra.run.smithi174:> route 2024-08-17T02:27:04.853 INFO:teuthology.orchestra.run.smithi174.stdout:Kernel IP routing table 2024-08-17T02:27:04.853 INFO:teuthology.orchestra.run.smithi174.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:27:04.853 INFO:teuthology.orchestra.run.smithi174.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-08-17T02:27:04.853 INFO:teuthology.orchestra.run.smithi174.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:27:04.853 INFO:teuthology.orchestra.run.smithi174.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-17T02:27:04.853 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-08-17T02:27:04.853 INFO:teuthology.orchestra.run.smithi174.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-17T02:27:04.853 INFO:teuthology.orchestra.run.smithi174.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:27:04.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:04.853 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec bash -c ' 2024-08-17T02:27:04.853 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2024-08-17T02:27:04.853 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:27:04.854 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:27:04.854 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:27:04.854 DEBUG:teuthology.orchestra.run.smithi174:> ') 2024-08-17T02:27:04.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:04.938 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2024-08-17T02:27:04.943 INFO:teuthology.orchestra.run.smithi174.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:27:04.943 INFO:teuthology.orchestra.run.smithi174.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:27:04.944 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:27:04.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:04.944 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set brx.0 up 2024-08-17T02:27:04.960 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-08-17T02:27:04.960 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:27:04.960 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:27:04.965 INFO:teuthology.orchestra.run.smithi174.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:27:04.966 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:27:04.966 DEBUG:teuthology.orchestra.run.smithi174:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:27:05.014 DEBUG:teuthology.orchestra.run.smithi174:> sudo modprobe fuse 2024-08-17T02:27:05.031 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:27:05.031 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:27:05.045 INFO:teuthology.orchestra.run.smithi174.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:27:05.046 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:27:05.046 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:05.047 DEBUG:teuthology.orchestra.run.smithi174:> ls /sys/fs/fuse/connections 2024-08-17T02:27:05.094 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-17T02:27:05.095 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-08-17T02:27:05.097 DEBUG:teuthology.orchestra.run.smithi174:> sudo modprobe fuse 2024-08-17T02:27:05.113 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:27:05.113 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:27:05.128 INFO:teuthology.orchestra.run.smithi174.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:27:05.129 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:27:05.129 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:05.130 DEBUG:teuthology.orchestra.run.smithi174:> ls /sys/fs/fuse/connections 2024-08-17T02:27:05.178 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi174.stderr:2024-08-17T02:27:05.174+0000 7f7ad1290380 -1 init, newargv = 0x5570657dc5b0 newargc=15 2024-08-17T02:27:05.178 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi174.stderr:ceph-fuse[30396]: starting ceph client 2024-08-17T02:27:05.187 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi174.stderr:ceph-fuse[30396]: starting fuse 2024-08-17T02:27:06.282 DEBUG:teuthology.orchestra.run.smithi174:> sudo modprobe fuse 2024-08-17T02:27:06.300 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:27:06.300 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:27:06.310 INFO:teuthology.orchestra.run.smithi174.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:27:06.311 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:27:06.311 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:06.312 DEBUG:teuthology.orchestra.run.smithi174:> ls /sys/fs/fuse/connections 2024-08-17T02:27:06.358 INFO:teuthology.orchestra.run.smithi174.stdout:52 2024-08-17T02:27:06.358 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-08-17T02:27:06.359 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-17T02:27:06.359 DEBUG:teuthology.orchestra.run.smithi174:> import glob 2024-08-17T02:27:06.359 DEBUG:teuthology.orchestra.run.smithi174:> import re 2024-08-17T02:27:06.359 DEBUG:teuthology.orchestra.run.smithi174:> import os 2024-08-17T02:27:06.359 DEBUG:teuthology.orchestra.run.smithi174:> import subprocess 2024-08-17T02:27:06.359 DEBUG:teuthology.orchestra.run.smithi174:> 2024-08-17T02:27:06.359 DEBUG:teuthology.orchestra.run.smithi174:> def _find_admin_socket(client_name): 2024-08-17T02:27:06.359 DEBUG:teuthology.orchestra.run.smithi174:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-08-17T02:27:06.359 DEBUG:teuthology.orchestra.run.smithi174:> files = glob.glob(asok_path) 2024-08-17T02:27:06.359 DEBUG:teuthology.orchestra.run.smithi174:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-08-17T02:27:06.359 DEBUG:teuthology.orchestra.run.smithi174:> 2024-08-17T02:27:06.359 DEBUG:teuthology.orchestra.run.smithi174:> # Given a non-glob path, it better be there 2024-08-17T02:27:06.360 DEBUG:teuthology.orchestra.run.smithi174:> if "*" not in asok_path: 2024-08-17T02:27:06.360 DEBUG:teuthology.orchestra.run.smithi174:> assert(len(files) == 1) 2024-08-17T02:27:06.360 DEBUG:teuthology.orchestra.run.smithi174:> return files[0] 2024-08-17T02:27:06.360 DEBUG:teuthology.orchestra.run.smithi174:> 2024-08-17T02:27:06.360 DEBUG:teuthology.orchestra.run.smithi174:> for f in files: 2024-08-17T02:27:06.360 DEBUG:teuthology.orchestra.run.smithi174:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-17T02:27:06.360 DEBUG:teuthology.orchestra.run.smithi174:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-17T02:27:06.360 DEBUG:teuthology.orchestra.run.smithi174:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-17T02:27:06.360 DEBUG:teuthology.orchestra.run.smithi174:> contents = proc_f.read() 2024-08-17T02:27:06.360 DEBUG:teuthology.orchestra.run.smithi174:> if mountpoint in contents: 2024-08-17T02:27:06.360 DEBUG:teuthology.orchestra.run.smithi174:> return f 2024-08-17T02:27:06.360 DEBUG:teuthology.orchestra.run.smithi174:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-17T02:27:06.360 DEBUG:teuthology.orchestra.run.smithi174:> 2024-08-17T02:27:06.360 DEBUG:teuthology.orchestra.run.smithi174:> print(_find_admin_socket("client.1")) 2024-08-17T02:27:06.360 DEBUG:teuthology.orchestra.run.smithi174:> ' 2024-08-17T02:27:06.441 INFO:teuthology.orchestra.run.smithi174.stdout:/var/run/ceph/ceph-client.1.30396.asok 2024-08-17T02:27:06.627 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.30396.asok 2024-08-17T02:27:06.627 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:06.627 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.30396.asok status 2024-08-17T02:27:06.725 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-08-17T02:27:06.725 INFO:teuthology.orchestra.run.smithi174.stdout: "metadata": { 2024-08-17T02:27:06.725 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_sha1": "2577e8139c6b8786f9d6d6ea21b8da9244b9260e", 2024-08-17T02:27:06.725 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_version": "ceph version 17.2.7-1375-g2577e813 (2577e8139c6b8786f9d6d6ea21b8da9244b9260e) quincy (stable)", 2024-08-17T02:27:06.725 INFO:teuthology.orchestra.run.smithi174.stdout: "entity_id": "1", 2024-08-17T02:27:06.726 INFO:teuthology.orchestra.run.smithi174.stdout: "hostname": "smithi174", 2024-08-17T02:27:06.726 INFO:teuthology.orchestra.run.smithi174.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-08-17T02:27:06.726 INFO:teuthology.orchestra.run.smithi174.stdout: "pid": "30396", 2024-08-17T02:27:06.726 INFO:teuthology.orchestra.run.smithi174.stdout: "root": "/" 2024-08-17T02:27:06.726 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-08-17T02:27:06.726 INFO:teuthology.orchestra.run.smithi174.stdout: "dentry_count": 0, 2024-08-17T02:27:06.726 INFO:teuthology.orchestra.run.smithi174.stdout: "dentry_pinned_count": 0, 2024-08-17T02:27:06.726 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 5095, 2024-08-17T02:27:06.726 INFO:teuthology.orchestra.run.smithi174.stdout: "inst": { 2024-08-17T02:27:06.726 INFO:teuthology.orchestra.run.smithi174.stdout: "name": { 2024-08-17T02:27:06.726 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "client", 2024-08-17T02:27:06.726 INFO:teuthology.orchestra.run.smithi174.stdout: "num": 5095 2024-08-17T02:27:06.726 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-08-17T02:27:06.727 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": { 2024-08-17T02:27:06.727 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "v1", 2024-08-17T02:27:06.727 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:27:06.727 INFO:teuthology.orchestra.run.smithi174.stdout: "nonce": 3886855887 2024-08-17T02:27:06.727 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-08-17T02:27:06.727 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-08-17T02:27:06.727 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": { 2024-08-17T02:27:06.727 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "v1", 2024-08-17T02:27:06.727 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:27:06.727 INFO:teuthology.orchestra.run.smithi174.stdout: "nonce": 3886855887 2024-08-17T02:27:06.727 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-08-17T02:27:06.727 INFO:teuthology.orchestra.run.smithi174.stdout: "inst_str": "client.5095 192.168.0.1:0/3886855887", 2024-08-17T02:27:06.727 INFO:teuthology.orchestra.run.smithi174.stdout: "addr_str": "192.168.0.1:0/3886855887", 2024-08-17T02:27:06.728 INFO:teuthology.orchestra.run.smithi174.stdout: "inode_count": 1, 2024-08-17T02:27:06.728 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_epoch": 14, 2024-08-17T02:27:06.728 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_epoch": 32, 2024-08-17T02:27:06.728 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_epoch_barrier": 0, 2024-08-17T02:27:06.728 INFO:teuthology.orchestra.run.smithi174.stdout: "blocklisted": false, 2024-08-17T02:27:06.728 INFO:teuthology.orchestra.run.smithi174.stdout: "fs_name": "cephfs" 2024-08-17T02:27:06.728 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-08-17T02:27:06.734 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:06.734 DEBUG:teuthology.orchestra.run.smithi174:> stat --file-system '--printf=%T 2024-08-17T02:27:06.735 DEBUG:teuthology.orchestra.run.smithi174:> ' -- /home/ubuntu/cephtest/mnt.1 2024-08-17T02:27:06.742 INFO:teuthology.orchestra.run.smithi174.stdout:fuseblk 2024-08-17T02:27:06.742 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-08-17T02:27:06.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:06.743 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:27:06.753 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-08-17T02:27:06.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.872+0000 7fcf06fa9700 1 Processor -- start 2024-08-17T02:27:06.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.872+0000 7fcf06fa9700 1 -- start start 2024-08-17T02:27:06.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.876+0000 7fcf06fa9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcf000cc400 0x7fcf000c6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.876+0000 7fcf06fa9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf000c5bb0 con 0x7fcf000ce640 2024-08-17T02:27:06.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.876+0000 7fcf06fa9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf000b32f0 con 0x7fcf000b2e70 2024-08-17T02:27:06.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.876+0000 7fcf06fa9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf000c4fa0 con 0x7fcf000cc400 2024-08-17T02:27:06.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.876+0000 7fcf05fa7700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fcf000ce640 0x7fcf000cea10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:51778/0 (socket says 172.21.15.153:51778) 2024-08-17T02:27:06.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.876+0000 7fcf05fa7700 1 -- 172.21.15.153:0/1314812120 learned_addr learned my addr 172.21.15.153:0/1314812120 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:27:06.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.876+0000 7fcf067a8700 1 --2- 172.21.15.153:0/1314812120 >> v2:172.21.15.174:3300/0 conn(0x7fcf000cc400 0x7fcf000c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.876+0000 7fcf04fa5700 1 -- 172.21.15.153:0/1314812120 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2433882474 0 0) 0x7fcf000c5bb0 con 0x7fcf000ce640 2024-08-17T02:27:06.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.876+0000 7fcf04fa5700 1 -- 172.21.15.153:0/1314812120 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcee8003570 con 0x7fcf000ce640 2024-08-17T02:27:06.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.876+0000 7fcf067a8700 1 -- 172.21.15.153:0/1314812120 >> v1:172.21.15.174:6789/0 conn(0x7fcf000b2e70 legacy=0x7fcf000cbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.876+0000 7fcf067a8700 1 -- 172.21.15.153:0/1314812120 >> v1:172.21.15.153:6789/0 conn(0x7fcf000ce640 legacy=0x7fcf000cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.876+0000 7fcf04fa5700 1 -- 172.21.15.153:0/1314812120 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3238646199 0 0) 0x7fcee8003570 con 0x7fcf000ce640 2024-08-17T02:27:06.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.876+0000 7fcf067a8700 1 -- 172.21.15.153:0/1314812120 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf000c5280 con 0x7fcf000cc400 2024-08-17T02:27:06.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.876+0000 7fcf067a8700 1 --2- 172.21.15.153:0/1314812120 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf000cc400 0x7fcf000c6040 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcef0009e60 tx=0x7fcef0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bea33aeca279700 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:06.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.876+0000 7fcf04fa5700 1 -- 172.21.15.153:0/1314812120 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef000e070 con 0x7fcf000cc400 2024-08-17T02:27:06.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.876+0000 7fcf04fa5700 1 -- 172.21.15.153:0/1314812120 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef000bb60 con 0x7fcf000cc400 2024-08-17T02:27:06.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.876+0000 7fcf04fa5700 1 -- 172.21.15.153:0/1314812120 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef0012430 con 0x7fcf000cc400 2024-08-17T02:27:06.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.880+0000 7fcf06fa9700 1 -- 172.21.15.153:0/1314812120 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf000cc400 msgr2=0x7fcf000c6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.880+0000 7fcf06fa9700 1 --2- 172.21.15.153:0/1314812120 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf000cc400 0x7fcf000c6040 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcef0009e60 tx=0x7fcef0009780 comp rx=0 tx=0).stop 2024-08-17T02:27:06.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.880+0000 7fcf06fa9700 1 -- 172.21.15.153:0/1314812120 shutdown_connections 2024-08-17T02:27:06.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.880+0000 7fcf06fa9700 1 --2- 172.21.15.153:0/1314812120 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf000cc400 0x7fcf000c6040 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.880+0000 7fcf06fa9700 1 -- 172.21.15.153:0/1314812120 >> 172.21.15.153:0/1314812120 conn(0x7fcf00099410 msgr2=0x7fcf000675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:06.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.880+0000 7fcf06fa9700 1 -- 172.21.15.153:0/1314812120 shutdown_connections 2024-08-17T02:27:06.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.880+0000 7fcf06fa9700 1 -- 172.21.15.153:0/1314812120 wait complete. 2024-08-17T02:27:06.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.880+0000 7fcf06fa9700 1 Processor -- start 2024-08-17T02:27:06.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.880+0000 7fcf06fa9700 1 -- start start 2024-08-17T02:27:06.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.884+0000 7fcf06fa9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf000b2e70 0x7fcf00154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.884+0000 7fcf06fa9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf000cc400 0x7fcf00153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.884+0000 7fcf06fa9700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf000ce640 0x7fcf000693a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.884+0000 7fcf06fa9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf00155460 con 0x7fcf000b2e70 2024-08-17T02:27:06.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.884+0000 7fcf06fa9700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf00155740 con 0x7fcf000ce640 2024-08-17T02:27:06.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.884+0000 7fcf06fa9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf001696c0 con 0x7fcf000cc400 2024-08-17T02:27:06.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.884+0000 7fcf05fa7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf000b2e70 0x7fcf00154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.884+0000 7fcf05fa7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf000b2e70 0x7fcf00154d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35846/0 (socket says 172.21.15.153:35846) 2024-08-17T02:27:06.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.884+0000 7fcf05fa7700 1 -- 172.21.15.153:0/2104663212 learned_addr learned my addr 172.21.15.153:0/2104663212 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:27:06.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.884+0000 7fcf057a6700 1 --2- 172.21.15.153:0/2104663212 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf000cc400 0x7fcf00153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.884+0000 7fcf067a8700 1 --2- 172.21.15.153:0/2104663212 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf000ce640 0x7fcf000693a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.884+0000 7fcf05fa7700 1 -- 172.21.15.153:0/2104663212 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf000cc400 msgr2=0x7fcf00153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.884+0000 7fcf05fa7700 1 --2- 172.21.15.153:0/2104663212 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf000cc400 0x7fcf00153230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.884+0000 7fcf05fa7700 1 -- 172.21.15.153:0/2104663212 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf000ce640 msgr2=0x7fcf000693a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.884+0000 7fcf05fa7700 1 --2- 172.21.15.153:0/2104663212 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf000ce640 0x7fcf000693a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.884+0000 7fcf05fa7700 1 -- 172.21.15.153:0/2104663212 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef0009a20 con 0x7fcf000b2e70 2024-08-17T02:27:06.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.884+0000 7fcf05fa7700 1 --2- 172.21.15.153:0/2104663212 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf000b2e70 0x7fcf00154d80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fcef8001440 tx=0x7fcef8007b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:06.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.884+0000 7fcefdffb700 1 -- 172.21.15.153:0/2104663212 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef8007360 con 0x7fcf000b2e70 2024-08-17T02:27:06.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.884+0000 7fcefdffb700 1 -- 172.21.15.153:0/2104663212 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef80074c0 con 0x7fcf000b2e70 2024-08-17T02:27:06.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.884+0000 7fcefdffb700 1 -- 172.21.15.153:0/2104663212 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef8004830 con 0x7fcf000b2e70 2024-08-17T02:27:06.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.884+0000 7fcf06fa9700 1 -- 172.21.15.153:0/2104663212 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf001699a0 con 0x7fcf000b2e70 2024-08-17T02:27:06.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.884+0000 7fcf06fa9700 1 -- 172.21.15.153:0/2104663212 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf00153770 con 0x7fcf000b2e70 2024-08-17T02:27:06.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.888+0000 7fcf06fa9700 1 -- 172.21.15.153:0/2104663212 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf000644b0 con 0x7fcf000b2e70 2024-08-17T02:27:06.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.888+0000 7fcefdffb700 1 -- 172.21.15.153:0/2104663212 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fcef8004be0 con 0x7fcf000b2e70 2024-08-17T02:27:06.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.888+0000 7fcefdffb700 1 --2- 172.21.15.153:0/2104663212 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fceec060860 0x7fceec062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.888+0000 7fcefdffb700 1 -- 172.21.15.153:0/2104663212 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcef807c980 con 0x7fcf000b2e70 2024-08-17T02:27:06.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.888+0000 7fcf057a6700 1 --2- 172.21.15.153:0/2104663212 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fceec060860 0x7fceec062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.888+0000 7fcf057a6700 1 --2- 172.21.15.153:0/2104663212 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fceec060860 0x7fceec062d10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcf000ca270 tx=0x7fcef4007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:06.901 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:06.896+0000 7fcefdffb700 1 -- 172.21.15.153:0/2104663212 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fcef804cdb0 con 0x7fcf000b2e70 2024-08-17T02:27:07.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.100+0000 7fcf06fa9700 1 -- 172.21.15.153:0/2104663212 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcf0015eb20 con 0x7fcf000b2e70 2024-08-17T02:27:07.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.540+0000 7fcefdffb700 1 -- 172.21.15.153:0/2104663212 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v15) v1 ==== 136+0+0 (secure 0 0 0) 0x7fcef80503d0 con 0x7fcf000b2e70 2024-08-17T02:27:07.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.544+0000 7fcf06fa9700 1 -- 172.21.15.153:0/2104663212 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fceec060860 msgr2=0x7fceec062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.544+0000 7fcf06fa9700 1 --2- 172.21.15.153:0/2104663212 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fceec060860 0x7fceec062d10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcf000ca270 tx=0x7fcef4007ec0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.544+0000 7fcf06fa9700 1 -- 172.21.15.153:0/2104663212 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf000b2e70 msgr2=0x7fcf00154d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.544+0000 7fcf06fa9700 1 --2- 172.21.15.153:0/2104663212 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf000b2e70 0x7fcf00154d80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fcef8001440 tx=0x7fcef8007b90 comp rx=0 tx=0).stop 2024-08-17T02:27:07.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.544+0000 7fcf06fa9700 1 -- 172.21.15.153:0/2104663212 shutdown_connections 2024-08-17T02:27:07.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.544+0000 7fcf06fa9700 1 --2- 172.21.15.153:0/2104663212 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fceec060860 0x7fceec062d10 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.544+0000 7fcf06fa9700 1 --2- 172.21.15.153:0/2104663212 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf000ce640 0x7fcf000693a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.544+0000 7fcf06fa9700 1 --2- 172.21.15.153:0/2104663212 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf000cc400 0x7fcf00153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.544+0000 7fcf06fa9700 1 --2- 172.21.15.153:0/2104663212 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf000b2e70 0x7fcf00154d80 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.544+0000 7fcf06fa9700 1 -- 172.21.15.153:0/2104663212 >> 172.21.15.153:0/2104663212 conn(0x7fcf00099410 msgr2=0x7fcf000b54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:07.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.544+0000 7fcf06fa9700 1 -- 172.21.15.153:0/2104663212 shutdown_connections 2024-08-17T02:27:07.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.544+0000 7fcf06fa9700 1 -- 172.21.15.153:0/2104663212 wait complete. 2024-08-17T02:27:07.568 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:27:07.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.680+0000 7ff6b33e0700 1 Processor -- start 2024-08-17T02:27:07.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.680+0000 7ff6b33e0700 1 -- start start 2024-08-17T02:27:07.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.684+0000 7ff6b33e0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6ac15a620 0x7ff6ac0ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.684+0000 7ff6b33e0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff6ac0ae2a0 0x7ff6ac0a95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.684+0000 7ff6b33e0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6ac0a9160 con 0x7ff6ac0b0f10 2024-08-17T02:27:07.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.684+0000 7ff6b33e0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6ac0aff10 con 0x7ff6ac0ae2a0 2024-08-17T02:27:07.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.684+0000 7ff6b33e0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac0b1680 con 0x7ff6ac15a620 2024-08-17T02:27:07.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.684+0000 7ff6b197d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff6ac0ae2a0 0x7ff6ac0a95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.684+0000 7ff6b117c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6ac15a620 0x7ff6ac0ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.684+0000 7ff6b197d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff6ac0ae2a0 0x7ff6ac0a95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.153:46532/0 (socket says 172.21.15.153:46532) 2024-08-17T02:27:07.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.684+0000 7ff6b197d700 1 -- 172.21.15.153:0/2800092524 learned_addr learned my addr 172.21.15.153:0/2800092524 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:27:07.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.684+0000 7ff6b197d700 1 -- 172.21.15.153:0/2800092524 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6ac15a620 msgr2=0x7ff6ac0ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:07.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.684+0000 7ff6b197d700 1 --2- 172.21.15.153:0/2800092524 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6ac15a620 0x7ff6ac0ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.684+0000 7ff6b197d700 1 -- 172.21.15.153:0/2800092524 >> v1:172.21.15.174:6789/0 conn(0x7ff6ac0b0f10 legacy=0x7ff6ac0adb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.684+0000 7ff6b197d700 1 -- 172.21.15.153:0/2800092524 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ac0b1960 con 0x7ff6ac0ae2a0 2024-08-17T02:27:07.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.684+0000 7ff6b197d700 1 --2- 172.21.15.153:0/2800092524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6ac0ae2a0 0x7ff6ac0a95f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff6a40099b0 tx=0x7ff6a4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c60a0d70e3cbcfa5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:07.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.684+0000 7ff6a3fff700 1 -- 172.21.15.153:0/2800092524 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4009ea0 con 0x7ff6ac0ae2a0 2024-08-17T02:27:07.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.684+0000 7ff6a3fff700 1 -- 172.21.15.153:0/2800092524 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a400b860 con 0x7ff6ac0ae2a0 2024-08-17T02:27:07.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.684+0000 7ff6a3fff700 1 -- 172.21.15.153:0/2800092524 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a400bc00 con 0x7ff6ac0ae2a0 2024-08-17T02:27:07.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.684+0000 7ff6b33e0700 1 -- 172.21.15.153:0/2800092524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6ac0ae2a0 msgr2=0x7ff6ac0a95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.684+0000 7ff6b33e0700 1 --2- 172.21.15.153:0/2800092524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6ac0ae2a0 0x7ff6ac0a95f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff6a40099b0 tx=0x7ff6a4009250 comp rx=0 tx=0).stop 2024-08-17T02:27:07.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.684+0000 7ff6b33e0700 1 -- 172.21.15.153:0/2800092524 shutdown_connections 2024-08-17T02:27:07.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.684+0000 7ff6b33e0700 1 --2- 172.21.15.153:0/2800092524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6ac0ae2a0 0x7ff6ac0a95f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.684+0000 7ff6b33e0700 1 --2- 172.21.15.153:0/2800092524 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6ac15a620 0x7ff6ac0ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.684+0000 7ff6b33e0700 1 -- 172.21.15.153:0/2800092524 >> 172.21.15.153:0/2800092524 conn(0x7ff6ac067810 msgr2=0x7ff6ac067c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:07.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.684+0000 7ff6b33e0700 1 -- 172.21.15.153:0/2800092524 shutdown_connections 2024-08-17T02:27:07.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.684+0000 7ff6b33e0700 1 -- 172.21.15.153:0/2800092524 wait complete. 2024-08-17T02:27:07.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.688+0000 7ff6b33e0700 1 Processor -- start 2024-08-17T02:27:07.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.688+0000 7ff6b33e0700 1 -- start start 2024-08-17T02:27:07.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.688+0000 7ff6b33e0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6ac0ae2a0 0x7ff6ac147890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.688+0000 7ff6b33e0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6ac0b0f10 0x7ff6ac0c0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.688+0000 7ff6b33e0700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6ac15a620 0x7ff6ac1483a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.688+0000 7ff6b33e0700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac099000 con 0x7ff6ac0b0f10 2024-08-17T02:27:07.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.688+0000 7ff6b33e0700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac099490 con 0x7ff6ac15a620 2024-08-17T02:27:07.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.688+0000 7ff6b33e0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac0983f0 con 0x7ff6ac0ae2a0 2024-08-17T02:27:07.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.688+0000 7ff6b097b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6ac0b0f10 0x7ff6ac0c0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.688+0000 7ff6b097b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6ac0b0f10 0x7ff6ac0c0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35856/0 (socket says 172.21.15.153:35856) 2024-08-17T02:27:07.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.688+0000 7ff6b097b700 1 -- 172.21.15.153:0/1038708979 learned_addr learned my addr 172.21.15.153:0/1038708979 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:27:07.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.688+0000 7ff6b117c700 1 --2- 172.21.15.153:0/1038708979 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6ac0ae2a0 0x7ff6ac147890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.688+0000 7ff6b197d700 1 --2- 172.21.15.153:0/1038708979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6ac15a620 0x7ff6ac1483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.688+0000 7ff6b097b700 1 -- 172.21.15.153:0/1038708979 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6ac0ae2a0 msgr2=0x7ff6ac147890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.688+0000 7ff6b097b700 1 --2- 172.21.15.153:0/1038708979 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6ac0ae2a0 0x7ff6ac147890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.688+0000 7ff6b097b700 1 -- 172.21.15.153:0/1038708979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6ac15a620 msgr2=0x7ff6ac1483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.688+0000 7ff6b097b700 1 --2- 172.21.15.153:0/1038708979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6ac15a620 0x7ff6ac1483a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.688+0000 7ff6b097b700 1 -- 172.21.15.153:0/1038708979 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a40094f0 con 0x7ff6ac0b0f10 2024-08-17T02:27:07.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.688+0000 7ff6b117c700 1 --2- 172.21.15.153:0/1038708979 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6ac0ae2a0 0x7ff6ac147890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:07.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.688+0000 7ff6b097b700 1 --2- 172.21.15.153:0/1038708979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6ac0b0f10 0x7ff6ac0c0ca0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff6a800cb10 tx=0x7ff6a80017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:07.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.692+0000 7ff6a17fa700 1 -- 172.21.15.153:0/1038708979 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a80020c0 con 0x7ff6ac0b0f10 2024-08-17T02:27:07.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.692+0000 7ff6a17fa700 1 -- 172.21.15.153:0/1038708979 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a8006ba0 con 0x7ff6ac0b0f10 2024-08-17T02:27:07.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.692+0000 7ff6a17fa700 1 -- 172.21.15.153:0/1038708979 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a800a7e0 con 0x7ff6ac0b0f10 2024-08-17T02:27:07.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.692+0000 7ff6b33e0700 1 -- 172.21.15.153:0/1038708979 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6ac0986d0 con 0x7ff6ac0b0f10 2024-08-17T02:27:07.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.692+0000 7ff6b33e0700 1 -- 172.21.15.153:0/1038708979 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6ac098c90 con 0x7ff6ac0b0f10 2024-08-17T02:27:07.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.692+0000 7ff6b33e0700 1 -- 172.21.15.153:0/1038708979 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6ac0645c0 con 0x7ff6ac0b0f10 2024-08-17T02:27:07.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.692+0000 7ff6a17fa700 1 -- 172.21.15.153:0/1038708979 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff6a800ab90 con 0x7ff6ac0b0f10 2024-08-17T02:27:07.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.692+0000 7ff6a17fa700 1 --2- 172.21.15.153:0/1038708979 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff690060860 0x7ff690062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.692+0000 7ff6a17fa700 1 -- 172.21.15.153:0/1038708979 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff6a807c9f0 con 0x7ff6ac0b0f10 2024-08-17T02:27:07.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.692+0000 7ff6b117c700 1 --2- 172.21.15.153:0/1038708979 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff690060860 0x7ff690062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.696+0000 7ff6b117c700 1 --2- 172.21.15.153:0/1038708979 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff690060860 0x7ff690062d10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff69c006f00 tx=0x7ff69c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:07.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.696+0000 7ff6a17fa700 1 -- 172.21.15.153:0/1038708979 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff6a804ce40 con 0x7ff6ac0b0f10 2024-08-17T02:27:07.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.884+0000 7ff6b33e0700 1 -- 172.21.15.153:0/1038708979 --> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6ac0adf10 con 0x7ff690060860 2024-08-17T02:27:07.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.888+0000 7ff6a17fa700 1 -- 172.21.15.153:0/1038708979 <== mgr.4104 v2:172.21.15.153:6832/24147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7ff6ac0adf10 con 0x7ff690060860 2024-08-17T02:27:07.891 INFO:teuthology.orchestra.run.smithi153.stdout:[ 2024-08-17T02:27:07.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-08-17T02:27:07.891 INFO:teuthology.orchestra.run.smithi153.stdout: "name": "cephfs" 2024-08-17T02:27:07.891 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-17T02:27:07.891 INFO:teuthology.orchestra.run.smithi153.stdout:] 2024-08-17T02:27:07.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.888+0000 7ff6b33e0700 1 -- 172.21.15.153:0/1038708979 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff690060860 msgr2=0x7ff690062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.888+0000 7ff6b33e0700 1 --2- 172.21.15.153:0/1038708979 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff690060860 0x7ff690062d10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff69c006f00 tx=0x7ff69c008040 comp rx=0 tx=0).stop 2024-08-17T02:27:07.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.888+0000 7ff6b33e0700 1 -- 172.21.15.153:0/1038708979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6ac0b0f10 msgr2=0x7ff6ac0c0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.888+0000 7ff6b33e0700 1 --2- 172.21.15.153:0/1038708979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6ac0b0f10 0x7ff6ac0c0ca0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff6a800cb10 tx=0x7ff6a80017b0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.888+0000 7ff6b33e0700 1 -- 172.21.15.153:0/1038708979 shutdown_connections 2024-08-17T02:27:07.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.888+0000 7ff6b33e0700 1 --2- 172.21.15.153:0/1038708979 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff690060860 0x7ff690062d10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.888+0000 7ff6b33e0700 1 --2- 172.21.15.153:0/1038708979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6ac15a620 0x7ff6ac1483a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.888+0000 7ff6b33e0700 1 --2- 172.21.15.153:0/1038708979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6ac0b0f10 0x7ff6ac0c0ca0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.888+0000 7ff6b33e0700 1 --2- 172.21.15.153:0/1038708979 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6ac0ae2a0 0x7ff6ac147890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.888+0000 7ff6b33e0700 1 -- 172.21.15.153:0/1038708979 >> 172.21.15.153:0/1038708979 conn(0x7ff6ac067810 msgr2=0x7ff6ac06e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:07.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.888+0000 7ff6b33e0700 1 -- 172.21.15.153:0/1038708979 shutdown_connections 2024-08-17T02:27:07.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:07.888+0000 7ff6b33e0700 1 -- 172.21.15.153:0/1038708979 wait complete. 2024-08-17T02:27:07.905 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:27:08.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.012+0000 7f4c3ebde700 1 Processor -- start 2024-08-17T02:27:08.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.012+0000 7f4c3ebde700 1 -- start start 2024-08-17T02:27:08.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.012+0000 7f4c3ebde700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c38157010 0x7f4c380aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.012+0000 7f4c3ebde700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c380b0fa0 con 0x7f4c38068db0 2024-08-17T02:27:08.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.012+0000 7f4c3ebde700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c380b03f0 con 0x7f4c381573e0 2024-08-17T02:27:08.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.012+0000 7f4c3ebde700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c380b0670 con 0x7f4c38157010 2024-08-17T02:27:08.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.012+0000 7f4c3e3dd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f4c38068db0 0x7f4c380b1430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:51782/0 (socket says 172.21.15.153:51782) 2024-08-17T02:27:08.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.012+0000 7f4c3e3dd700 1 -- 172.21.15.153:0/4146301706 learned_addr learned my addr 172.21.15.153:0/4146301706 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:27:08.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.012+0000 7f4c3dbdc700 1 --2- 172.21.15.153:0/4146301706 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c38157010 0x7f4c380aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.012+0000 7f4c3cbda700 1 -- 172.21.15.153:0/4146301706 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1742285003 0 0) 0x7f4c380b0fa0 con 0x7f4c38068db0 2024-08-17T02:27:08.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.012+0000 7f4c3cbda700 1 -- 172.21.15.153:0/4146301706 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c24003570 con 0x7f4c38068db0 2024-08-17T02:27:08.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.012+0000 7f4c3cbda700 1 -- 172.21.15.153:0/4146301706 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3732130244 0 0) 0x7f4c380b03f0 con 0x7f4c381573e0 2024-08-17T02:27:08.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.012+0000 7f4c3cbda700 1 -- 172.21.15.153:0/4146301706 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c380b0fa0 con 0x7f4c381573e0 2024-08-17T02:27:08.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.012+0000 7f4c3dbdc700 1 -- 172.21.15.153:0/4146301706 >> v1:172.21.15.174:6789/0 conn(0x7f4c381573e0 legacy=0x7f4c380686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.012+0000 7f4c3dbdc700 1 -- 172.21.15.153:0/4146301706 >> v1:172.21.15.153:6789/0 conn(0x7f4c38068db0 legacy=0x7f4c380b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.012+0000 7f4c3dbdc700 1 -- 172.21.15.153:0/4146301706 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c380b0950 con 0x7f4c38157010 2024-08-17T02:27:08.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.012+0000 7f4c3dbdc700 1 --2- 172.21.15.153:0/4146301706 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c38157010 0x7f4c380aed60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4c34009910 tx=0x7f4c340091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f45408aba0d93f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.012+0000 7f4c3cbda700 1 -- 172.21.15.153:0/4146301706 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c34011630 con 0x7f4c38157010 2024-08-17T02:27:08.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.012+0000 7f4c3cbda700 1 -- 172.21.15.153:0/4146301706 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c34011790 con 0x7f4c38157010 2024-08-17T02:27:08.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.012+0000 7f4c3cbda700 1 -- 172.21.15.153:0/4146301706 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c34011b30 con 0x7f4c38157010 2024-08-17T02:27:08.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.016+0000 7f4c3ebde700 1 -- 172.21.15.153:0/4146301706 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c38157010 msgr2=0x7f4c380aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.016+0000 7f4c3ebde700 1 --2- 172.21.15.153:0/4146301706 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c38157010 0x7f4c380aed60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4c34009910 tx=0x7f4c340091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.016+0000 7f4c3ebde700 1 -- 172.21.15.153:0/4146301706 shutdown_connections 2024-08-17T02:27:08.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.016+0000 7f4c3ebde700 1 --2- 172.21.15.153:0/4146301706 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c38157010 0x7f4c380aed60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.016+0000 7f4c3ebde700 1 -- 172.21.15.153:0/4146301706 >> 172.21.15.153:0/4146301706 conn(0x7f4c380cd040 msgr2=0x7f4c3806d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:08.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.016+0000 7f4c3ebde700 1 -- 172.21.15.153:0/4146301706 shutdown_connections 2024-08-17T02:27:08.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.016+0000 7f4c3ebde700 1 -- 172.21.15.153:0/4146301706 wait complete. 2024-08-17T02:27:08.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.016+0000 7f4c3ebde700 1 Processor -- start 2024-08-17T02:27:08.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.016+0000 7f4c3ebde700 1 -- start start 2024-08-17T02:27:08.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.020+0000 7f4c3ebde700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c38068db0 0x7f4c38141360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.020+0000 7f4c3ebde700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c38157010 0x7f4c381584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.020+0000 7f4c3ebde700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c381573e0 0x7f4c381589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.020+0000 7f4c3ebde700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c380aa350 con 0x7f4c38157010 2024-08-17T02:27:08.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.020+0000 7f4c3ebde700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c380a56f0 con 0x7f4c38068db0 2024-08-17T02:27:08.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.020+0000 7f4c3ebde700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c380a9d40 con 0x7f4c381573e0 2024-08-17T02:27:08.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.020+0000 7f4c3d3db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c38157010 0x7f4c381584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.020+0000 7f4c3d3db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c38157010 0x7f4c381584a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35862/0 (socket says 172.21.15.153:35862) 2024-08-17T02:27:08.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.020+0000 7f4c3d3db700 1 -- 172.21.15.153:0/361394433 learned_addr learned my addr 172.21.15.153:0/361394433 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:27:08.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.020+0000 7f4c3dbdc700 1 --2- 172.21.15.153:0/361394433 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c38068db0 0x7f4c38141360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.020+0000 7f4c3e3dd700 1 --2- 172.21.15.153:0/361394433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c381573e0 0x7f4c381589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.020+0000 7f4c3d3db700 1 -- 172.21.15.153:0/361394433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c381573e0 msgr2=0x7f4c381589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.020+0000 7f4c3d3db700 1 --2- 172.21.15.153:0/361394433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c381573e0 0x7f4c381589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.020+0000 7f4c3d3db700 1 -- 172.21.15.153:0/361394433 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c38068db0 msgr2=0x7f4c38141360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.020+0000 7f4c3d3db700 1 --2- 172.21.15.153:0/361394433 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c38068db0 0x7f4c38141360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.020+0000 7f4c3d3db700 1 -- 172.21.15.153:0/361394433 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c34009420 con 0x7f4c38157010 2024-08-17T02:27:08.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.020+0000 7f4c3e3dd700 1 --2- 172.21.15.153:0/361394433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c381573e0 0x7f4c381589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:08.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.020+0000 7f4c3d3db700 1 --2- 172.21.15.153:0/361394433 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c38157010 0x7f4c381584a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4c2800c580 tx=0x7f4c28007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.020+0000 7f4c2dffb700 1 -- 172.21.15.153:0/361394433 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c28010510 con 0x7f4c38157010 2024-08-17T02:27:08.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.020+0000 7f4c2dffb700 1 -- 172.21.15.153:0/361394433 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c28010670 con 0x7f4c38157010 2024-08-17T02:27:08.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.020+0000 7f4c3ebde700 1 -- 172.21.15.153:0/361394433 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c38159070 con 0x7f4c38157010 2024-08-17T02:27:08.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.020+0000 7f4c2dffb700 1 -- 172.21.15.153:0/361394433 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c28010a30 con 0x7f4c38157010 2024-08-17T02:27:08.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.020+0000 7f4c3ebde700 1 -- 172.21.15.153:0/361394433 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c380a9fe0 con 0x7f4c38157010 2024-08-17T02:27:08.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.020+0000 7f4c3ebde700 1 -- 172.21.15.153:0/361394433 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c380aa500 con 0x7f4c38157010 2024-08-17T02:27:08.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.020+0000 7f4c2dffb700 1 -- 172.21.15.153:0/361394433 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4c2801b400 con 0x7f4c38157010 2024-08-17T02:27:08.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.024+0000 7f4c2dffb700 1 --2- 172.21.15.153:0/361394433 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4c1c060860 0x7f4c1c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.024+0000 7f4c2dffb700 1 -- 172.21.15.153:0/361394433 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4c2807c840 con 0x7f4c38157010 2024-08-17T02:27:08.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.024+0000 7f4c3dbdc700 1 --2- 172.21.15.153:0/361394433 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4c1c060860 0x7f4c1c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.024+0000 7f4c3dbdc700 1 --2- 172.21.15.153:0/361394433 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4c1c060860 0x7f4c1c062d10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4c380a9b30 tx=0x7f4c34017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.028+0000 7f4c2dffb700 1 -- 172.21.15.153:0/361394433 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f4c380aa500 con 0x7f4c38157010 2024-08-17T02:27:08.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.188+0000 7f4c3ebde700 1 -- 172.21.15.153:0/361394433 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4c38159550 con 0x7f4c38157010 2024-08-17T02:27:08.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.192+0000 7f4c2dffb700 1 -- 172.21.15.153:0/361394433 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4c2804cc90 con 0x7f4c38157010 2024-08-17T02:27:08.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.192+0000 7f4c3ebde700 1 -- 172.21.15.153:0/361394433 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4c1c060860 msgr2=0x7f4c1c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.192+0000 7f4c3ebde700 1 --2- 172.21.15.153:0/361394433 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4c1c060860 0x7f4c1c062d10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4c380a9b30 tx=0x7f4c34017000 comp rx=0 tx=0).stop 2024-08-17T02:27:08.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.192+0000 7f4c3ebde700 1 -- 172.21.15.153:0/361394433 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c38157010 msgr2=0x7f4c381584a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.192+0000 7f4c3ebde700 1 --2- 172.21.15.153:0/361394433 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c38157010 0x7f4c381584a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4c2800c580 tx=0x7f4c28007e10 comp rx=0 tx=0).stop 2024-08-17T02:27:08.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.192+0000 7f4c3ebde700 1 -- 172.21.15.153:0/361394433 shutdown_connections 2024-08-17T02:27:08.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.192+0000 7f4c3ebde700 1 --2- 172.21.15.153:0/361394433 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4c1c060860 0x7f4c1c062d10 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.192+0000 7f4c3ebde700 1 --2- 172.21.15.153:0/361394433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c381573e0 0x7f4c381589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.192+0000 7f4c3ebde700 1 --2- 172.21.15.153:0/361394433 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c38157010 0x7f4c381584a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.192+0000 7f4c3ebde700 1 --2- 172.21.15.153:0/361394433 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c38068db0 0x7f4c38141360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.192+0000 7f4c3ebde700 1 -- 172.21.15.153:0/361394433 >> 172.21.15.153:0/361394433 conn(0x7f4c380cd040 msgr2=0x7f4c3806d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:08.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.192+0000 7f4c3ebde700 1 -- 172.21.15.153:0/361394433 shutdown_connections 2024-08-17T02:27:08.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.192+0000 7f4c3ebde700 1 -- 172.21.15.153:0/361394433 wait complete. 2024-08-17T02:27:08.209 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create volume_0000000000118573 2024-08-17T02:27:08.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.316+0000 7f0542d05700 1 Processor -- start 2024-08-17T02:27:08.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.316+0000 7f0542d05700 1 -- start start 2024-08-17T02:27:08.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.316+0000 7f0542d05700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f053c0af190 0x7f053c0b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.316+0000 7f0542d05700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f053c140f70 con 0x7f053c06e470 2024-08-17T02:27:08.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.316+0000 7f0542d05700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f053c141250 con 0x7f053c06e840 2024-08-17T02:27:08.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.316+0000 7f0542d05700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f053c141530 con 0x7f053c0af190 2024-08-17T02:27:08.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.316+0000 7f0541d03700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f053c06e470 0x7f053c0aea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:51784/0 (socket says 172.21.15.153:51784) 2024-08-17T02:27:08.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.320+0000 7f0541d03700 1 -- 172.21.15.153:0/1973858415 learned_addr learned my addr 172.21.15.153:0/1973858415 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:27:08.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.320+0000 7f0541502700 1 --2- 172.21.15.153:0/1973858415 >> v2:172.21.15.174:3300/0 conn(0x7f053c0af190 0x7f053c0b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.320+0000 7f0540d01700 1 -- 172.21.15.153:0/1973858415 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2512141291 0 0) 0x7f053c140f70 con 0x7f053c06e470 2024-08-17T02:27:08.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.320+0000 7f0540d01700 1 -- 172.21.15.153:0/1973858415 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0528003570 con 0x7f053c06e470 2024-08-17T02:27:08.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.320+0000 7f0540d01700 1 -- 172.21.15.153:0/1973858415 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 326423308 0 0) 0x7f053c141250 con 0x7f053c06e840 2024-08-17T02:27:08.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.320+0000 7f0540d01700 1 -- 172.21.15.153:0/1973858415 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f053c140f70 con 0x7f053c06e840 2024-08-17T02:27:08.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.320+0000 7f0541502700 1 -- 172.21.15.153:0/1973858415 >> v1:172.21.15.174:6789/0 conn(0x7f053c06e840 legacy=0x7f053c0b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.320+0000 7f0540d01700 1 -- 172.21.15.153:0/1973858415 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1644993736 0 0) 0x7f0528003570 con 0x7f053c06e470 2024-08-17T02:27:08.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.320+0000 7f0541502700 1 -- 172.21.15.153:0/1973858415 >> v1:172.21.15.153:6789/0 conn(0x7f053c06e470 legacy=0x7f053c0aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.320+0000 7f0541502700 1 -- 172.21.15.153:0/1973858415 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f053c141810 con 0x7f053c0af190 2024-08-17T02:27:08.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.320+0000 7f0541502700 1 --2- 172.21.15.153:0/1973858415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f053c0af190 0x7f053c0b0ef0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0530009e60 tx=0x7f0530009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6936270b1fa39e58 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.320+0000 7f0540d01700 1 -- 172.21.15.153:0/1973858415 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053000e070 con 0x7f053c0af190 2024-08-17T02:27:08.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.320+0000 7f0540d01700 1 -- 172.21.15.153:0/1973858415 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053000b7a0 con 0x7f053c0af190 2024-08-17T02:27:08.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.320+0000 7f0540d01700 1 -- 172.21.15.153:0/1973858415 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0538001470 con 0x7f053c0af190 2024-08-17T02:27:08.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.320+0000 7f0542d05700 1 -- 172.21.15.153:0/1973858415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f053c0af190 msgr2=0x7f053c0b0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.320+0000 7f0542d05700 1 --2- 172.21.15.153:0/1973858415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f053c0af190 0x7f053c0b0ef0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0530009e60 tx=0x7f0530009780 comp rx=0 tx=0).stop 2024-08-17T02:27:08.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.320+0000 7f0542d05700 1 -- 172.21.15.153:0/1973858415 shutdown_connections 2024-08-17T02:27:08.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.320+0000 7f0542d05700 1 --2- 172.21.15.153:0/1973858415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f053c0af190 0x7f053c0b0ef0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.320+0000 7f0542d05700 1 -- 172.21.15.153:0/1973858415 >> 172.21.15.153:0/1973858415 conn(0x7f053c0678a0 msgr2=0x7f053c067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:08.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.320+0000 7f0542d05700 1 -- 172.21.15.153:0/1973858415 shutdown_connections 2024-08-17T02:27:08.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.320+0000 7f0542d05700 1 -- 172.21.15.153:0/1973858415 wait complete. 2024-08-17T02:27:08.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.324+0000 7f0542d05700 1 Processor -- start 2024-08-17T02:27:08.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.324+0000 7f0542d05700 1 -- start start 2024-08-17T02:27:08.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.324+0000 7f0542d05700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f053c06e470 0x7f053c1595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.324+0000 7f0542d05700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f053c06e840 0x7f053c16dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.324+0000 7f0542d05700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f053c0af190 0x7f053c0a7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.324+0000 7f0542d05700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053c0a6db0 con 0x7f053c06e470 2024-08-17T02:27:08.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.324+0000 7f0542d05700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053c0a6180 con 0x7f053c06e840 2024-08-17T02:27:08.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.324+0000 7f0542d05700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f053c0a6460 con 0x7f053c0af190 2024-08-17T02:27:08.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.324+0000 7f0541d03700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f053c06e470 0x7f053c1595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.324+0000 7f0541d03700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f053c06e470 0x7f053c1595c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35878/0 (socket says 172.21.15.153:35878) 2024-08-17T02:27:08.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.324+0000 7f0541d03700 1 -- 172.21.15.153:0/2409996276 learned_addr learned my addr 172.21.15.153:0/2409996276 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:27:08.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.324+0000 7f0541502700 1 --2- 172.21.15.153:0/2409996276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f053c06e840 0x7f053c16dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.324+0000 7f0542504700 1 --2- 172.21.15.153:0/2409996276 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f053c0af190 0x7f053c0a7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.324+0000 7f0541d03700 1 -- 172.21.15.153:0/2409996276 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f053c0af190 msgr2=0x7f053c0a7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.324+0000 7f0541d03700 1 --2- 172.21.15.153:0/2409996276 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f053c0af190 0x7f053c0a7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.324+0000 7f0541d03700 1 -- 172.21.15.153:0/2409996276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f053c06e840 msgr2=0x7f053c16dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.324+0000 7f0541d03700 1 --2- 172.21.15.153:0/2409996276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f053c06e840 0x7f053c16dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.324+0000 7f0541d03700 1 -- 172.21.15.153:0/2409996276 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0530009a20 con 0x7f053c06e470 2024-08-17T02:27:08.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.324+0000 7f0541502700 1 --2- 172.21.15.153:0/2409996276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f053c06e840 0x7f053c16dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:08.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.324+0000 7f0541d03700 1 --2- 172.21.15.153:0/2409996276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f053c06e470 0x7f053c1595c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f053800c840 tx=0x7f0538001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.324+0000 7f052dffb700 1 -- 172.21.15.153:0/2409996276 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0538007360 con 0x7f053c06e470 2024-08-17T02:27:08.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.324+0000 7f052dffb700 1 -- 172.21.15.153:0/2409996276 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05380074e0 con 0x7f053c06e470 2024-08-17T02:27:08.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.324+0000 7f0542d05700 1 -- 172.21.15.153:0/2409996276 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f053c0a6760 con 0x7f053c06e470 2024-08-17T02:27:08.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.324+0000 7f052dffb700 1 -- 172.21.15.153:0/2409996276 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0538004830 con 0x7f053c06e470 2024-08-17T02:27:08.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.324+0000 7f0542d05700 1 -- 172.21.15.153:0/2409996276 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f053c159b00 con 0x7f053c06e470 2024-08-17T02:27:08.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.328+0000 7f0542d05700 1 -- 172.21.15.153:0/2409996276 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f053c0a6be0 con 0x7f053c06e470 2024-08-17T02:27:08.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.328+0000 7f052dffb700 1 -- 172.21.15.153:0/2409996276 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0538004ba0 con 0x7f053c06e470 2024-08-17T02:27:08.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.328+0000 7f052dffb700 1 --2- 172.21.15.153:0/2409996276 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f0520060860 0x7f0520062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.328+0000 7f052dffb700 1 -- 172.21.15.153:0/2409996276 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f053807c280 con 0x7f053c06e470 2024-08-17T02:27:08.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.328+0000 7f0541502700 1 --2- 172.21.15.153:0/2409996276 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f0520060860 0x7f0520062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.328+0000 7f0541502700 1 --2- 172.21.15.153:0/2409996276 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f0520060860 0x7f0520062d10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f053c0af590 tx=0x7f0530017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.336+0000 7f052dffb700 1 -- 172.21.15.153:0/2409996276 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f053804c750 con 0x7f053c06e470 2024-08-17T02:27:08.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:08.524+0000 7f0542d05700 1 -- 172.21.15.153:0/2409996276 --> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "volume_0000000000118573", "target": ["mon-mgr", ""]}) v1 -- 0x7f053c0a6ef0 con 0x7f0520060860 2024-08-17T02:27:10.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.656+0000 7f052dffb700 1 -- 172.21.15.153:0/2409996276 <== mgr.4104 v2:172.21.15.153:6832/24147 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7f053000bea0 con 0x7f0520060860 2024-08-17T02:27:10.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.660+0000 7f0542d05700 1 -- 172.21.15.153:0/2409996276 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f0520060860 msgr2=0x7f0520062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.660+0000 7f0542d05700 1 --2- 172.21.15.153:0/2409996276 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f0520060860 0x7f0520062d10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f053c0af590 tx=0x7f0530017000 comp rx=0 tx=0).stop 2024-08-17T02:27:10.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.660+0000 7f0542d05700 1 -- 172.21.15.153:0/2409996276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f053c06e470 msgr2=0x7f053c1595c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.660+0000 7f0542d05700 1 --2- 172.21.15.153:0/2409996276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f053c06e470 0x7f053c1595c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f053800c840 tx=0x7f0538001a30 comp rx=0 tx=0).stop 2024-08-17T02:27:10.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.660+0000 7f0542d05700 1 -- 172.21.15.153:0/2409996276 shutdown_connections 2024-08-17T02:27:10.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.660+0000 7f0542d05700 1 --2- 172.21.15.153:0/2409996276 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f0520060860 0x7f0520062d10 secure :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f053c0af590 tx=0x7f0530017000 comp rx=0 tx=0).stop 2024-08-17T02:27:10.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.660+0000 7f0542d05700 1 --2- 172.21.15.153:0/2409996276 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f053c0af190 0x7f053c0a7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.660+0000 7f0542d05700 1 --2- 172.21.15.153:0/2409996276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f053c06e840 0x7f053c16dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.660+0000 7f0542d05700 1 --2- 172.21.15.153:0/2409996276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f053c06e470 0x7f053c1595c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.660+0000 7f0542d05700 1 -- 172.21.15.153:0/2409996276 >> 172.21.15.153:0/2409996276 conn(0x7f053c0678a0 msgr2=0x7f053c06d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:10.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.660+0000 7f0542d05700 1 -- 172.21.15.153:0/2409996276 shutdown_connections 2024-08-17T02:27:10.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.660+0000 7f0542d05700 1 -- 172.21.15.153:0/2409996276 wait complete. 2024-08-17T02:27:10.665 INFO:teuthology.orchestra.run.smithi153.stderr:Volume created successfully (no MDS daemons created) 2024-08-17T02:27:10.677 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:27:10.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.772+0000 7f1ce726d700 1 Processor -- start 2024-08-17T02:27:10.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.772+0000 7f1ce726d700 1 -- start start 2024-08-17T02:27:10.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.776+0000 7f1ce726d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1ce006e890 0x7f1ce0068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.776+0000 7f1ce726d700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce00af070 con 0x7f1ce00688d0 2024-08-17T02:27:10.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.776+0000 7f1ce726d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce00cac60 con 0x7f1ce015a980 2024-08-17T02:27:10.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.776+0000 7f1ce726d700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce00abed0 con 0x7f1ce006e890 2024-08-17T02:27:10.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.776+0000 7f1ce5009700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f1ce00688d0 0x7f1ce015a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:51792/0 (socket says 172.21.15.153:51792) 2024-08-17T02:27:10.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.776+0000 7f1ce5009700 1 -- 172.21.15.153:0/2414989811 learned_addr learned my addr 172.21.15.153:0/2414989811 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:27:10.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.776+0000 7f1ce4808700 1 --2- 172.21.15.153:0/2414989811 >> v2:172.21.15.153:3300/0 conn(0x7f1ce006e890 0x7f1ce0068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.776+0000 7f1ce4808700 1 -- 172.21.15.153:0/2414989811 >> v1:172.21.15.174:6789/0 conn(0x7f1ce015a980 legacy=0x7f1ce00cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.776+0000 7f1ce4808700 1 -- 172.21.15.153:0/2414989811 >> v1:172.21.15.153:6789/0 conn(0x7f1ce00688d0 legacy=0x7f1ce015a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.776+0000 7f1ce4808700 1 -- 172.21.15.153:0/2414989811 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce00ca610 con 0x7f1ce006e890 2024-08-17T02:27:10.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.776+0000 7f1cd7fff700 1 -- 172.21.15.153:0/2414989811 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1753574900 0 0) 0x7f1ce00af070 con 0x7f1ce00688d0 2024-08-17T02:27:10.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.776+0000 7f1ce4808700 1 --2- 172.21.15.153:0/2414989811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ce006e890 0x7f1ce0068ca0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1cd00098e0 tx=0x7f1cd00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4191d5a1947aaf0a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:10.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.776+0000 7f1cd7fff700 1 -- 172.21.15.153:0/2414989811 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd0009e80 con 0x7f1ce006e890 2024-08-17T02:27:10.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.776+0000 7f1cd7fff700 1 -- 172.21.15.153:0/2414989811 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd000b860 con 0x7f1ce006e890 2024-08-17T02:27:10.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.776+0000 7f1cd7fff700 1 -- 172.21.15.153:0/2414989811 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd000bbe0 con 0x7f1ce006e890 2024-08-17T02:27:10.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.780+0000 7f1ce726d700 1 -- 172.21.15.153:0/2414989811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ce006e890 msgr2=0x7f1ce0068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.780+0000 7f1ce726d700 1 --2- 172.21.15.153:0/2414989811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ce006e890 0x7f1ce0068ca0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1cd00098e0 tx=0x7f1cd00091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.780+0000 7f1ce726d700 1 -- 172.21.15.153:0/2414989811 shutdown_connections 2024-08-17T02:27:10.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.780+0000 7f1ce726d700 1 --2- 172.21.15.153:0/2414989811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ce006e890 0x7f1ce0068ca0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.780+0000 7f1ce726d700 1 -- 172.21.15.153:0/2414989811 >> 172.21.15.153:0/2414989811 conn(0x7f1ce00cd160 msgr2=0x7f1ce006d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:10.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.780+0000 7f1ce726d700 1 -- 172.21.15.153:0/2414989811 shutdown_connections 2024-08-17T02:27:10.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.780+0000 7f1ce726d700 1 -- 172.21.15.153:0/2414989811 wait complete. 2024-08-17T02:27:10.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.780+0000 7f1ce726d700 1 Processor -- start 2024-08-17T02:27:10.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.780+0000 7f1ce726d700 1 -- start start 2024-08-17T02:27:10.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.780+0000 7f1ce726d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ce00688d0 0x7f1ce014bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.780+0000 7f1ce726d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ce006e890 0x7f1ce01578e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.780+0000 7f1ce726d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ce015a980 0x7f1ce0152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.780+0000 7f1ce726d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce014e2d0 con 0x7f1ce00688d0 2024-08-17T02:27:10.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.780+0000 7f1ce726d700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce0151ed0 con 0x7f1ce015a980 2024-08-17T02:27:10.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.780+0000 7f1ce726d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce0151300 con 0x7f1ce006e890 2024-08-17T02:27:10.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.780+0000 7f1ce5009700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ce00688d0 0x7f1ce014bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.780+0000 7f1ce5009700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ce00688d0 0x7f1ce014bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35896/0 (socket says 172.21.15.153:35896) 2024-08-17T02:27:10.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.780+0000 7f1ce5009700 1 -- 172.21.15.153:0/2563096525 learned_addr learned my addr 172.21.15.153:0/2563096525 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:27:10.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.780+0000 7f1ce4808700 1 --2- 172.21.15.153:0/2563096525 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ce006e890 0x7f1ce01578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.780+0000 7f1ce580a700 1 --2- 172.21.15.153:0/2563096525 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ce015a980 0x7f1ce0152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.780+0000 7f1ce5009700 1 -- 172.21.15.153:0/2563096525 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ce006e890 msgr2=0x7f1ce01578e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.780+0000 7f1ce5009700 1 --2- 172.21.15.153:0/2563096525 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ce006e890 0x7f1ce01578e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.780+0000 7f1ce5009700 1 -- 172.21.15.153:0/2563096525 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ce015a980 msgr2=0x7f1ce0152360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.780+0000 7f1ce5009700 1 --2- 172.21.15.153:0/2563096525 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ce015a980 0x7f1ce0152360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.780+0000 7f1ce5009700 1 -- 172.21.15.153:0/2563096525 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd0009420 con 0x7f1ce00688d0 2024-08-17T02:27:10.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.784+0000 7f1ce5009700 1 --2- 172.21.15.153:0/2563096525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ce00688d0 0x7f1ce014bb90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc00c840 tx=0x7f1cdc007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:10.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.784+0000 7f1cd57fa700 1 -- 172.21.15.153:0/2563096525 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc005c00 con 0x7f1ce00688d0 2024-08-17T02:27:10.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.784+0000 7f1cd57fa700 1 -- 172.21.15.153:0/2563096525 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cdc005d80 con 0x7f1ce00688d0 2024-08-17T02:27:10.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.784+0000 7f1cd57fa700 1 -- 172.21.15.153:0/2563096525 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc007320 con 0x7f1ce00688d0 2024-08-17T02:27:10.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.784+0000 7f1ce726d700 1 -- 172.21.15.153:0/2563096525 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce01515a0 con 0x7f1ce00688d0 2024-08-17T02:27:10.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.784+0000 7f1ce726d700 1 -- 172.21.15.153:0/2563096525 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce0151b60 con 0x7f1ce00688d0 2024-08-17T02:27:10.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.784+0000 7f1ce726d700 1 -- 172.21.15.153:0/2563096525 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ce00645c0 con 0x7f1ce00688d0 2024-08-17T02:27:10.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.784+0000 7f1cd57fa700 1 -- 172.21.15.153:0/2563096525 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1cdc01b3b0 con 0x7f1ce00688d0 2024-08-17T02:27:10.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.784+0000 7f1cd57fa700 1 --2- 172.21.15.153:0/2563096525 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1cc4060860 0x7f1cc4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.784+0000 7f1cd57fa700 1 -- 172.21.15.153:0/2563096525 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f1cdc07c500 con 0x7f1ce00688d0 2024-08-17T02:27:10.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.784+0000 7f1ce4808700 1 --2- 172.21.15.153:0/2563096525 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1cc4060860 0x7f1cc4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.788+0000 7f1ce4808700 1 --2- 172.21.15.153:0/2563096525 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1cc4060860 0x7f1cc4062d10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1ce006ecd0 tx=0x7f1cd0017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:10.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.792+0000 7f1cd57fa700 1 -- 172.21.15.153:0/2563096525 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1cdc04c5d0 con 0x7f1ce00688d0 2024-08-17T02:27:10.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.976+0000 7f1ce726d700 1 -- 172.21.15.153:0/2563096525 --> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ce0152010 con 0x7f1cc4060860 2024-08-17T02:27:10.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.976+0000 7f1cd57fa700 1 -- 172.21.15.153:0/2563096525 <== mgr.4104 v2:172.21.15.153:6832/24147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+96 (secure 0 0 0) 0x7f1cd0002f70 con 0x7f1cc4060860 2024-08-17T02:27:10.982 INFO:teuthology.orchestra.run.smithi153.stdout:[ 2024-08-17T02:27:10.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-08-17T02:27:10.982 INFO:teuthology.orchestra.run.smithi153.stdout: "name": "cephfs" 2024-08-17T02:27:10.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-17T02:27:10.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-08-17T02:27:10.982 INFO:teuthology.orchestra.run.smithi153.stdout: "name": "volume_0000000000118573" 2024-08-17T02:27:10.982 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-17T02:27:10.983 INFO:teuthology.orchestra.run.smithi153.stdout:] 2024-08-17T02:27:10.984 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.980+0000 7f1ce726d700 1 -- 172.21.15.153:0/2563096525 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1cc4060860 msgr2=0x7f1cc4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.980+0000 7f1ce726d700 1 --2- 172.21.15.153:0/2563096525 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1cc4060860 0x7f1cc4062d10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1ce006ecd0 tx=0x7f1cd0017000 comp rx=0 tx=0).stop 2024-08-17T02:27:10.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.980+0000 7f1ce726d700 1 -- 172.21.15.153:0/2563096525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ce00688d0 msgr2=0x7f1ce014bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.980+0000 7f1ce726d700 1 --2- 172.21.15.153:0/2563096525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ce00688d0 0x7f1ce014bb90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc00c840 tx=0x7f1cdc007d90 comp rx=0 tx=0).stop 2024-08-17T02:27:10.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.980+0000 7f1ce726d700 1 -- 172.21.15.153:0/2563096525 shutdown_connections 2024-08-17T02:27:10.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.980+0000 7f1ce726d700 1 --2- 172.21.15.153:0/2563096525 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1cc4060860 0x7f1cc4062d10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.980+0000 7f1ce726d700 1 --2- 172.21.15.153:0/2563096525 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ce015a980 0x7f1ce0152360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.980+0000 7f1ce726d700 1 --2- 172.21.15.153:0/2563096525 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ce006e890 0x7f1ce01578e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.980+0000 7f1ce726d700 1 --2- 172.21.15.153:0/2563096525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ce00688d0 0x7f1ce014bb90 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.980+0000 7f1ce726d700 1 -- 172.21.15.153:0/2563096525 >> 172.21.15.153:0/2563096525 conn(0x7f1ce00cd160 msgr2=0x7f1ce0068ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:10.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.980+0000 7f1ce726d700 1 -- 172.21.15.153:0/2563096525 shutdown_connections 2024-08-17T02:27:10.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:10.980+0000 7f1ce726d700 1 -- 172.21.15.153:0/2563096525 wait complete. 2024-08-17T02:27:11.000 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool ls detail --format=json 2024-08-17T02:27:11.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.112+0000 7f4f9359e700 1 Processor -- start 2024-08-17T02:27:11.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.112+0000 7f4f9359e700 1 -- start start 2024-08-17T02:27:11.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.112+0000 7f4f9359e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f940af190 0x7f4f940b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.112+0000 7f4f9359e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4f9406e840 0x7f4f940b1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.112+0000 7f4f9359e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f94140f70 con 0x7f4f9406e470 2024-08-17T02:27:11.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.112+0000 7f4f9359e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f94141250 con 0x7f4f9406e840 2024-08-17T02:27:11.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.112+0000 7f4f9359e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f94141530 con 0x7f4f940af190 2024-08-17T02:27:11.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.112+0000 7f4f92d9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4f9406e840 0x7f4f940b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.112+0000 7f4f92d9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4f9406e840 0x7f4f940b1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35900/0 (socket says 172.21.15.153:35900) 2024-08-17T02:27:11.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.112+0000 7f4f92d9d700 1 -- 172.21.15.153:0/1719041674 learned_addr learned my addr 172.21.15.153:0/1719041674 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:27:11.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.112+0000 7f4f9259c700 1 --1- 172.21.15.153:0/1719041674 >> v1:172.21.15.153:6789/0 conn(0x7f4f9406e470 0x7f4f940aea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:51802/0 (socket says 172.21.15.153:51802) 2024-08-17T02:27:11.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.112+0000 7f4f91d9b700 1 --2- 172.21.15.153:0/1719041674 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f940af190 0x7f4f940b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.112+0000 7f4f92d9d700 1 -- 172.21.15.153:0/1719041674 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f940af190 msgr2=0x7f4f940b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:11.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.112+0000 7f4f92d9d700 1 --2- 172.21.15.153:0/1719041674 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f940af190 0x7f4f940b0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.112+0000 7f4f92d9d700 1 -- 172.21.15.153:0/1719041674 >> v1:172.21.15.153:6789/0 conn(0x7f4f9406e470 legacy=0x7f4f940aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.112+0000 7f4f92d9d700 1 -- 172.21.15.153:0/1719041674 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f94141810 con 0x7f4f9406e840 2024-08-17T02:27:11.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.112+0000 7f4f92d9d700 1 --2- 172.21.15.153:0/1719041674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f9406e840 0x7f4f940b1430 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009f20 tx=0x7f4f8c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d60f01dd0e4e0cf1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:11.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.112+0000 7f4f9159a700 1 -- 172.21.15.153:0/1719041674 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c00e070 con 0x7f4f9406e840 2024-08-17T02:27:11.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.112+0000 7f4f9159a700 1 -- 172.21.15.153:0/1719041674 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8c00ba80 con 0x7f4f9406e840 2024-08-17T02:27:11.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.112+0000 7f4f9159a700 1 -- 172.21.15.153:0/1719041674 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c0092e0 con 0x7f4f9406e840 2024-08-17T02:27:11.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.112+0000 7f4f9359e700 1 -- 172.21.15.153:0/1719041674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f9406e840 msgr2=0x7f4f940b1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.112+0000 7f4f9359e700 1 --2- 172.21.15.153:0/1719041674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f9406e840 0x7f4f940b1430 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009f20 tx=0x7f4f8c009840 comp rx=0 tx=0).stop 2024-08-17T02:27:11.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.112+0000 7f4f9359e700 1 -- 172.21.15.153:0/1719041674 shutdown_connections 2024-08-17T02:27:11.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.112+0000 7f4f9359e700 1 --2- 172.21.15.153:0/1719041674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f9406e840 0x7f4f940b1430 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.112+0000 7f4f9359e700 1 --2- 172.21.15.153:0/1719041674 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f940af190 0x7f4f940b0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.112+0000 7f4f9359e700 1 -- 172.21.15.153:0/1719041674 >> 172.21.15.153:0/1719041674 conn(0x7f4f940678a0 msgr2=0x7f4f94067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:11.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.112+0000 7f4f9359e700 1 -- 172.21.15.153:0/1719041674 shutdown_connections 2024-08-17T02:27:11.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.112+0000 7f4f9359e700 1 -- 172.21.15.153:0/1719041674 wait complete. 2024-08-17T02:27:11.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.116+0000 7f4f9359e700 1 Processor -- start 2024-08-17T02:27:11.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.116+0000 7f4f9359e700 1 -- start start 2024-08-17T02:27:11.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.116+0000 7f4f9359e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4f9406e470 0x7f4f9416d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.116+0000 7f4f9359e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f9406e840 0x7f4f940c2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.116+0000 7f4f9359e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f940af190 0x7f4f9415c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.116+0000 7f4f9359e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9415ccd0 con 0x7f4f940af190 2024-08-17T02:27:11.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.116+0000 7f4f9359e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f940c2fe0 con 0x7f4f9406e470 2024-08-17T02:27:11.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.116+0000 7f4f9359e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f940c8040 con 0x7f4f9406e840 2024-08-17T02:27:11.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.116+0000 7f4f92d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f940af190 0x7f4f9415c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.116+0000 7f4f92d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f940af190 0x7f4f9415c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35902/0 (socket says 172.21.15.153:35902) 2024-08-17T02:27:11.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.116+0000 7f4f92d9d700 1 -- 172.21.15.153:0/1436460242 learned_addr learned my addr 172.21.15.153:0/1436460242 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:27:11.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.120+0000 7f4f9259c700 1 --2- 172.21.15.153:0/1436460242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4f9406e470 0x7f4f9416d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.120+0000 7f4f91d9b700 1 --2- 172.21.15.153:0/1436460242 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f9406e840 0x7f4f940c2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.120+0000 7f4f92d9d700 1 -- 172.21.15.153:0/1436460242 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f9406e840 msgr2=0x7f4f940c2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.120+0000 7f4f92d9d700 1 --2- 172.21.15.153:0/1436460242 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f9406e840 0x7f4f940c2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.120+0000 7f4f92d9d700 1 -- 172.21.15.153:0/1436460242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4f9406e470 msgr2=0x7f4f9416d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.120+0000 7f4f92d9d700 1 --2- 172.21.15.153:0/1436460242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4f9406e470 0x7f4f9416d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.120+0000 7f4f92d9d700 1 -- 172.21.15.153:0/1436460242 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f8c009ae0 con 0x7f4f940af190 2024-08-17T02:27:11.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.120+0000 7f4f92d9d700 1 --2- 172.21.15.153:0/1436460242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f940af190 0x7f4f9415c1a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c008950 tx=0x7f4f8c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:11.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.120+0000 7f4f827fc700 1 -- 172.21.15.153:0/1436460242 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c0092e0 con 0x7f4f940af190 2024-08-17T02:27:11.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.120+0000 7f4f827fc700 1 -- 172.21.15.153:0/1436460242 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8c008d40 con 0x7f4f940af190 2024-08-17T02:27:11.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.120+0000 7f4f9359e700 1 -- 172.21.15.153:0/1436460242 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f9415c6e0 con 0x7f4f940af190 2024-08-17T02:27:11.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.120+0000 7f4f827fc700 1 -- 172.21.15.153:0/1436460242 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c0266b0 con 0x7f4f940af190 2024-08-17T02:27:11.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.120+0000 7f4f9359e700 1 -- 172.21.15.153:0/1436460242 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f9416de50 con 0x7f4f940af190 2024-08-17T02:27:11.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.120+0000 7f4f9359e700 1 -- 172.21.15.153:0/1436460242 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f94064330 con 0x7f4f940af190 2024-08-17T02:27:11.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.120+0000 7f4f827fc700 1 -- 172.21.15.153:0/1436460242 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4f8c003040 con 0x7f4f940af190 2024-08-17T02:27:11.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.124+0000 7f4f827fc700 1 --2- 172.21.15.153:0/1436460242 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4f74060860 0x7f4f74062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.124+0000 7f4f827fc700 1 -- 172.21.15.153:0/1436460242 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f4f8c07ee70 con 0x7f4f940af190 2024-08-17T02:27:11.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.124+0000 7f4f9259c700 1 --2- 172.21.15.153:0/1436460242 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4f74060860 0x7f4f74062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.124+0000 7f4f9259c700 1 --2- 172.21.15.153:0/1436460242 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4f74060860 0x7f4f74062d10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4f940b0500 tx=0x7f4f88007eb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:11.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.128+0000 7f4f827fc700 1 -- 172.21.15.153:0/1436460242 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f4f8c04eff0 con 0x7f4f940af190 2024-08-17T02:27:11.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.288+0000 7f4f9359e700 1 -- 172.21.15.153:0/1436460242 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool ls", "detail": "detail", "format": "json"} v 0) v1 -- 0x7f4f9406ed70 con 0x7f4f940af190 2024-08-17T02:27:11.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.292+0000 7f4f827fc700 1 -- 172.21.15.153:0/1436460242 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls", "detail": "detail", "format": "json"}]=0 v35) v1 ==== 97+0+8050 (secure 0 0 0) 0x7f4f8c052610 con 0x7f4f940af190 2024-08-17T02:27:11.295 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:27:11.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.292+0000 7f4f9359e700 1 -- 172.21.15.153:0/1436460242 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4f74060860 msgr2=0x7f4f74062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.292+0000 7f4f9359e700 1 --2- 172.21.15.153:0/1436460242 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4f74060860 0x7f4f74062d10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4f940b0500 tx=0x7f4f88007eb0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.292+0000 7f4f9359e700 1 -- 172.21.15.153:0/1436460242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f940af190 msgr2=0x7f4f9415c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.292+0000 7f4f9359e700 1 --2- 172.21.15.153:0/1436460242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f940af190 0x7f4f9415c1a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c008950 tx=0x7f4f8c018000 comp rx=0 tx=0).stop 2024-08-17T02:27:11.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.292+0000 7f4f9359e700 1 -- 172.21.15.153:0/1436460242 shutdown_connections 2024-08-17T02:27:11.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.292+0000 7f4f9359e700 1 --2- 172.21.15.153:0/1436460242 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4f74060860 0x7f4f74062d10 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.292+0000 7f4f9359e700 1 --2- 172.21.15.153:0/1436460242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f940af190 0x7f4f9415c1a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.292+0000 7f4f9359e700 1 --2- 172.21.15.153:0/1436460242 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f9406e840 0x7f4f940c2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.292+0000 7f4f9359e700 1 --2- 172.21.15.153:0/1436460242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4f9406e470 0x7f4f9416d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.292+0000 7f4f9359e700 1 -- 172.21.15.153:0/1436460242 >> 172.21.15.153:0/1436460242 conn(0x7f4f940678a0 msgr2=0x7f4f9415f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:11.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.292+0000 7f4f9359e700 1 -- 172.21.15.153:0/1436460242 shutdown_connections 2024-08-17T02:27:11.299 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.292+0000 7f4f9359e700 1 -- 172.21.15.153:0/1436460242 wait complete. 2024-08-17T02:27:11.309 INFO:teuthology.orchestra.run.smithi153.stdout:[{"pool_id":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:58.093273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool_id":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:54.363196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool_id":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:54.837150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool_id":6,"pool_name":"cephfs.volume_0000000000118573.meta","create_time":"2024-08-17T02:27:08.568651+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000118573"}}},{"pool_id":7,"pool_name":"cephfs.volume_0000000000118573.data","create_time":"2024-08-17T02:27:08.668955+0000","flags":163841,"flags_names":"hashpspool,creating,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000118573"}}}] 2024-08-17T02:27:11.309 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs get volume_0000000000118573 --format=json 2024-08-17T02:27:11.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.416+0000 7fadbd36c700 1 Processor -- start 2024-08-17T02:27:11.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.416+0000 7fadbd36c700 1 -- start start 2024-08-17T02:27:11.423 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.420+0000 7fadbd36c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fadb80c34d0 0x7fadb80cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.423 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.420+0000 7fadbd36c700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadb80cf200 con 0x7fadb80c38a0 2024-08-17T02:27:11.423 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.420+0000 7fadbd36c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadb80ce320 con 0x7fadb80cd860 2024-08-17T02:27:11.423 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.420+0000 7fadbd36c700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadb80ce5f0 con 0x7fadb80c34d0 2024-08-17T02:27:11.423 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.420+0000 7fadb6ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fadb80c34d0 0x7fadb80cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.423 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.420+0000 7fadb67fc700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fadb80c38a0 0x7fadb80ad330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:51816/0 (socket says 172.21.15.153:51816) 2024-08-17T02:27:11.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.420+0000 7fadb67fc700 1 -- 172.21.15.153:0/421648841 learned_addr learned my addr 172.21.15.153:0/421648841 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:27:11.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.420+0000 7fadb5ffb700 1 -- 172.21.15.153:0/421648841 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1671340555 0 0) 0x7fadb80cf200 con 0x7fadb80c38a0 2024-08-17T02:27:11.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.420+0000 7fadb6ffd700 1 -- 172.21.15.153:0/421648841 >> v1:172.21.15.174:6789/0 conn(0x7fadb80cd860 legacy=0x7fadb80cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.420+0000 7fadb6ffd700 1 -- 172.21.15.153:0/421648841 >> v1:172.21.15.153:6789/0 conn(0x7fadb80c38a0 legacy=0x7fadb80ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.420+0000 7fadb6ffd700 1 -- 172.21.15.153:0/421648841 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb80ce8d0 con 0x7fadb80c34d0 2024-08-17T02:27:11.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.420+0000 7fadb6ffd700 1 --2- 172.21.15.153:0/421648841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fadb80c34d0 0x7fadb80cdde0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fada80098e0 tx=0x7fada80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e8e7333ba235737 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:11.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.420+0000 7fadb5ffb700 1 -- 172.21.15.153:0/421648841 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada8009e80 con 0x7fadb80c34d0 2024-08-17T02:27:11.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.420+0000 7fadb5ffb700 1 -- 172.21.15.153:0/421648841 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada800b860 con 0x7fadb80c34d0 2024-08-17T02:27:11.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.420+0000 7fadb5ffb700 1 -- 172.21.15.153:0/421648841 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada800bbe0 con 0x7fadb80c34d0 2024-08-17T02:27:11.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.420+0000 7fadbd36c700 1 -- 172.21.15.153:0/421648841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fadb80c34d0 msgr2=0x7fadb80cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.420+0000 7fadbd36c700 1 --2- 172.21.15.153:0/421648841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fadb80c34d0 0x7fadb80cdde0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fada80098e0 tx=0x7fada80091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.420+0000 7fadbd36c700 1 -- 172.21.15.153:0/421648841 shutdown_connections 2024-08-17T02:27:11.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.420+0000 7fadbd36c700 1 --2- 172.21.15.153:0/421648841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fadb80c34d0 0x7fadb80cdde0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.420+0000 7fadbd36c700 1 -- 172.21.15.153:0/421648841 >> 172.21.15.153:0/421648841 conn(0x7fadb8099500 msgr2=0x7fadb80675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:11.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.420+0000 7fadbd36c700 1 -- 172.21.15.153:0/421648841 shutdown_connections 2024-08-17T02:27:11.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.420+0000 7fadbd36c700 1 -- 172.21.15.153:0/421648841 wait complete. 2024-08-17T02:27:11.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.424+0000 7fadbd36c700 1 Processor -- start 2024-08-17T02:27:11.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.424+0000 7fadbd36c700 1 -- start start 2024-08-17T02:27:11.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.424+0000 7fadbd36c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadb80c34d0 0x7fadb806e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.424+0000 7fadbd36c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadb80c38a0 0x7fadb815f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.424+0000 7fadbd36c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fadb80cd860 0x7fadb81712e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.424+0000 7fadbd36c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb806cc70 con 0x7fadb80cd860 2024-08-17T02:27:11.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.424+0000 7fadbd36c700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb816dea0 con 0x7fadb80c38a0 2024-08-17T02:27:11.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.424+0000 7fadbd36c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadb815fb30 con 0x7fadb80c34d0 2024-08-17T02:27:11.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.424+0000 7fadb77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fadb80cd860 0x7fadb81712e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.424+0000 7fadb77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fadb80cd860 0x7fadb81712e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35918/0 (socket says 172.21.15.153:35918) 2024-08-17T02:27:11.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.424+0000 7fadb77fe700 1 -- 172.21.15.153:0/1103327300 learned_addr learned my addr 172.21.15.153:0/1103327300 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:27:11.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.424+0000 7fadb67fc700 1 --2- 172.21.15.153:0/1103327300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadb80c38a0 0x7fadb815f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.424+0000 7fadb6ffd700 1 --2- 172.21.15.153:0/1103327300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadb80c34d0 0x7fadb806e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.424+0000 7fadb77fe700 1 -- 172.21.15.153:0/1103327300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadb80c34d0 msgr2=0x7fadb806e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.424+0000 7fadb77fe700 1 --2- 172.21.15.153:0/1103327300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadb80c34d0 0x7fadb806e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.424+0000 7fadb77fe700 1 -- 172.21.15.153:0/1103327300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadb80c38a0 msgr2=0x7fadb815f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.424+0000 7fadb77fe700 1 --2- 172.21.15.153:0/1103327300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadb80c38a0 0x7fadb815f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.424+0000 7fadb77fe700 1 -- 172.21.15.153:0/1103327300 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada8009420 con 0x7fadb80cd860 2024-08-17T02:27:11.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.424+0000 7fadb67fc700 1 --2- 172.21.15.153:0/1103327300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadb80c38a0 0x7fadb815f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:11.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.424+0000 7fadb77fe700 1 --2- 172.21.15.153:0/1103327300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fadb80cd860 0x7fadb81712e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fadb000c870 tx=0x7fadb0001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:11.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.424+0000 7fadaeffd700 1 -- 172.21.15.153:0/1103327300 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb0012630 con 0x7fadb80cd860 2024-08-17T02:27:11.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.424+0000 7fadaeffd700 1 -- 172.21.15.153:0/1103327300 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb00127b0 con 0x7fadb80cd860 2024-08-17T02:27:11.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.424+0000 7fadbd36c700 1 -- 172.21.15.153:0/1103327300 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadb80b1ea0 con 0x7fadb80cd860 2024-08-17T02:27:11.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.424+0000 7fadaeffd700 1 -- 172.21.15.153:0/1103327300 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb0012b70 con 0x7fadb80cd860 2024-08-17T02:27:11.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.424+0000 7fadbd36c700 1 -- 172.21.15.153:0/1103327300 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadb80b24e0 con 0x7fadb80cd860 2024-08-17T02:27:11.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.428+0000 7fadbd36c700 1 -- 172.21.15.153:0/1103327300 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadb816e010 con 0x7fadb80cd860 2024-08-17T02:27:11.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.428+0000 7fadaeffd700 1 -- 172.21.15.153:0/1103327300 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fadb0003030 con 0x7fadb80cd860 2024-08-17T02:27:11.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.428+0000 7fadaeffd700 1 --2- 172.21.15.153:0/1103327300 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fad98060860 0x7fad98062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.428+0000 7fadaeffd700 1 -- 172.21.15.153:0/1103327300 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fadb007cf30 con 0x7fadb80cd860 2024-08-17T02:27:11.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.428+0000 7fadb6ffd700 1 --2- 172.21.15.153:0/1103327300 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fad98060860 0x7fad98062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.428+0000 7fadb6ffd700 1 --2- 172.21.15.153:0/1103327300 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fad98060860 0x7fad98062d10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fada80093f0 tx=0x7fada8017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:11.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.432+0000 7fadaeffd700 1 -- 172.21.15.153:0/1103327300 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fadb816e010 con 0x7fadb80cd860 2024-08-17T02:27:11.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.632+0000 7fadbd36c700 1 -- 172.21.15.153:0/1103327300 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs get", "fs_name": "volume_0000000000118573", "format": "json"} v 0) v1 -- 0x7fadb816e010 con 0x7fadb80cd860 2024-08-17T02:27:11.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.636+0000 7fadaeffd700 1 -- 172.21.15.153:0/1103327300 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs get", "fs_name": "volume_0000000000118573", "format": "json"}]=0 v16) v1 ==== 110+0+1849 (secure 0 0 0) 0x7fadb816e010 con 0x7fadb80cd860 2024-08-17T02:27:11.639 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:27:11.639 INFO:teuthology.orchestra.run.smithi153.stdout:{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:09.642872+0000","modified":"2024-08-17T02:27:10.627317+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5013},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5013":{"gid":5013,"name":"a","rank":0,"incarnation":16,"state":"up:creating","state_seq":1,"addr":"172.21.15.153:6835/2569513399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2569513399},{"type":"v1","addr":"172.21.15.153:6835","nonce":2569513399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000118573","balancer":"","standby_count_wanted":0},"id":3} 2024-08-17T02:27:11.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.640+0000 7fadbd36c700 1 -- 172.21.15.153:0/1103327300 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fad98060860 msgr2=0x7fad98062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.640+0000 7fadbd36c700 1 --2- 172.21.15.153:0/1103327300 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fad98060860 0x7fad98062d10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fada80093f0 tx=0x7fada8017000 comp rx=0 tx=0).stop 2024-08-17T02:27:11.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.640+0000 7fadbd36c700 1 -- 172.21.15.153:0/1103327300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fadb80cd860 msgr2=0x7fadb81712e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.640+0000 7fadbd36c700 1 --2- 172.21.15.153:0/1103327300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fadb80cd860 0x7fadb81712e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fadb000c870 tx=0x7fadb0001670 comp rx=0 tx=0).stop 2024-08-17T02:27:11.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.640+0000 7fadbd36c700 1 -- 172.21.15.153:0/1103327300 shutdown_connections 2024-08-17T02:27:11.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.640+0000 7fadbd36c700 1 --2- 172.21.15.153:0/1103327300 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fad98060860 0x7fad98062d10 secure :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fada80093f0 tx=0x7fada8017000 comp rx=0 tx=0).stop 2024-08-17T02:27:11.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.640+0000 7fadbd36c700 1 --2- 172.21.15.153:0/1103327300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fadb80cd860 0x7fadb81712e0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.640+0000 7fadbd36c700 1 --2- 172.21.15.153:0/1103327300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadb80c38a0 0x7fadb815f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.640+0000 7fadbd36c700 1 --2- 172.21.15.153:0/1103327300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadb80c34d0 0x7fadb806e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.640+0000 7fadbd36c700 1 -- 172.21.15.153:0/1103327300 >> 172.21.15.153:0/1103327300 conn(0x7fadb8099500 msgr2=0x7fadb80aef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:11.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.640+0000 7fadbd36c700 1 -- 172.21.15.153:0/1103327300 shutdown_connections 2024-08-17T02:27:11.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.640+0000 7fadbd36c700 1 -- 172.21.15.153:0/1103327300 wait complete. 2024-08-17T02:27:11.658 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000118573 --yes-i-really-mean-it 2024-08-17T02:27:11.760 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.756+0000 7fc1fdcc9700 1 Processor -- start 2024-08-17T02:27:11.760 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.756+0000 7fc1fdcc9700 1 -- start start 2024-08-17T02:27:11.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.756+0000 7fc1fdcc9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc1f8140e00 0x7fc1f80c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.756+0000 7fc1fdcc9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f80c3b90 con 0x7fc1f80b0e30 2024-08-17T02:27:11.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.756+0000 7fc1fdcc9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f80cca60 con 0x7fc1f8140a30 2024-08-17T02:27:11.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.756+0000 7fc1fdcc9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f80ca510 con 0x7fc1f8140e00 2024-08-17T02:27:11.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.756+0000 7fc1f7fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc1f80b0e30 0x7fc1f80cc350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:51820/0 (socket says 172.21.15.153:51820) 2024-08-17T02:27:11.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.756+0000 7fc1f7fff700 1 -- 172.21.15.153:0/3652950031 learned_addr learned my addr 172.21.15.153:0/3652950031 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:27:11.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.760+0000 7fc1f6ffd700 1 --2- 172.21.15.153:0/3652950031 >> v2:172.21.15.174:3300/0 conn(0x7fc1f8140e00 0x7fc1f80c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.760+0000 7fc1f67fc700 1 -- 172.21.15.153:0/3652950031 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2241565661 0 0) 0x7fc1f80c3b90 con 0x7fc1f80b0e30 2024-08-17T02:27:11.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.760+0000 7fc1f67fc700 1 -- 172.21.15.153:0/3652950031 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1e4003570 con 0x7fc1f80b0e30 2024-08-17T02:27:11.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.760+0000 7fc1f67fc700 1 -- 172.21.15.153:0/3652950031 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2761934582 0 0) 0x7fc1e4003570 con 0x7fc1f80b0e30 2024-08-17T02:27:11.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.760+0000 7fc1f6ffd700 1 -- 172.21.15.153:0/3652950031 >> v1:172.21.15.174:6789/0 conn(0x7fc1f8140a30 legacy=0x7fc1f80cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.760+0000 7fc1f6ffd700 1 -- 172.21.15.153:0/3652950031 >> v1:172.21.15.153:6789/0 conn(0x7fc1f80b0e30 legacy=0x7fc1f80cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.760+0000 7fc1f6ffd700 1 -- 172.21.15.153:0/3652950031 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f80ca7f0 con 0x7fc1f8140e00 2024-08-17T02:27:11.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.760+0000 7fc1f6ffd700 1 --2- 172.21.15.153:0/3652950031 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1f8140e00 0x7fc1f80c86b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc1e00098e0 tx=0x7fc1e00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=489025573cc7a12d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:11.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.760+0000 7fc1f67fc700 1 -- 172.21.15.153:0/3652950031 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f00017f0 con 0x7fc1f8140e00 2024-08-17T02:27:11.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.760+0000 7fc1f67fc700 1 -- 172.21.15.153:0/3652950031 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e0011420 con 0x7fc1f8140e00 2024-08-17T02:27:11.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.760+0000 7fc1f67fc700 1 -- 172.21.15.153:0/3652950031 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e00117a0 con 0x7fc1f8140e00 2024-08-17T02:27:11.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.760+0000 7fc1fdcc9700 1 -- 172.21.15.153:0/3652950031 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1f8140e00 msgr2=0x7fc1f80c86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.760+0000 7fc1fdcc9700 1 --2- 172.21.15.153:0/3652950031 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1f8140e00 0x7fc1f80c86b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc1e00098e0 tx=0x7fc1e00091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.760+0000 7fc1fdcc9700 1 -- 172.21.15.153:0/3652950031 shutdown_connections 2024-08-17T02:27:11.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.760+0000 7fc1fdcc9700 1 --2- 172.21.15.153:0/3652950031 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1f8140e00 0x7fc1f80c86b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.760+0000 7fc1fdcc9700 1 -- 172.21.15.153:0/3652950031 >> 172.21.15.153:0/3652950031 conn(0x7fc1f80caae0 msgr2=0x7fc1f80caee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:11.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.760+0000 7fc1fdcc9700 1 -- 172.21.15.153:0/3652950031 shutdown_connections 2024-08-17T02:27:11.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.760+0000 7fc1fdcc9700 1 -- 172.21.15.153:0/3652950031 wait complete. 2024-08-17T02:27:11.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.764+0000 7fc1fdcc9700 1 Processor -- start 2024-08-17T02:27:11.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.764+0000 7fc1fdcc9700 1 -- start start 2024-08-17T02:27:11.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.764+0000 7fc1fdcc9700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1f80b0e30 0x7fc1f8159390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.764+0000 7fc1fdcc9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1f8140a30 0x7fc1f815b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.764+0000 7fc1fdcc9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1f8140e00 0x7fc1f815aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.764+0000 7fc1fdcc9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f815bae0 con 0x7fc1f8140e00 2024-08-17T02:27:11.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.764+0000 7fc1fdcc9700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f8159a40 con 0x7fc1f80b0e30 2024-08-17T02:27:11.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.764+0000 7fc1fdcc9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f8159d20 con 0x7fc1f8140a30 2024-08-17T02:27:11.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.764+0000 7fc1f7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1f8140e00 0x7fc1f815aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.764+0000 7fc1f7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1f8140e00 0x7fc1f815aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35930/0 (socket says 172.21.15.153:35930) 2024-08-17T02:27:11.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.764+0000 7fc1f7fff700 1 -- 172.21.15.153:0/1866798197 learned_addr learned my addr 172.21.15.153:0/1866798197 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:27:11.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.764+0000 7fc1f6ffd700 1 --2- 172.21.15.153:0/1866798197 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1f8140a30 0x7fc1f815b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.764+0000 7fc1f77fe700 1 --2- 172.21.15.153:0/1866798197 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1f80b0e30 0x7fc1f8159390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.764+0000 7fc1f7fff700 1 -- 172.21.15.153:0/1866798197 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1f8140a30 msgr2=0x7fc1f815b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.764+0000 7fc1f7fff700 1 --2- 172.21.15.153:0/1866798197 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1f8140a30 0x7fc1f815b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.764+0000 7fc1f7fff700 1 -- 172.21.15.153:0/1866798197 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1f80b0e30 msgr2=0x7fc1f8159390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.764+0000 7fc1f7fff700 1 --2- 172.21.15.153:0/1866798197 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1f80b0e30 0x7fc1f8159390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.764+0000 7fc1f7fff700 1 -- 172.21.15.153:0/1866798197 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e0009420 con 0x7fc1f8140e00 2024-08-17T02:27:11.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.764+0000 7fc1f7fff700 1 --2- 172.21.15.153:0/1866798197 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1f8140e00 0x7fc1f815aae0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc1f000cc20 tx=0x7fc1f00015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:11.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.764+0000 7fc1ef7fe700 1 -- 172.21.15.153:0/1866798197 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f0004dc0 con 0x7fc1f8140e00 2024-08-17T02:27:11.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.764+0000 7fc1ef7fe700 1 -- 172.21.15.153:0/1866798197 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f000a6a0 con 0x7fc1f8140e00 2024-08-17T02:27:11.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.764+0000 7fc1fdcc9700 1 -- 172.21.15.153:0/1866798197 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f815a000 con 0x7fc1f8140e00 2024-08-17T02:27:11.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.764+0000 7fc1ef7fe700 1 -- 172.21.15.153:0/1866798197 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f000aa60 con 0x7fc1f8140e00 2024-08-17T02:27:11.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.768+0000 7fc1fdcc9700 1 -- 172.21.15.153:0/1866798197 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f815a5c0 con 0x7fc1f8140e00 2024-08-17T02:27:11.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.768+0000 7fc1fdcc9700 1 -- 172.21.15.153:0/1866798197 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f815a7b0 con 0x7fc1f8140e00 2024-08-17T02:27:11.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.768+0000 7fc1ef7fe700 1 -- 172.21.15.153:0/1866798197 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc1f0007150 con 0x7fc1f8140e00 2024-08-17T02:27:11.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.768+0000 7fc1ef7fe700 1 --2- 172.21.15.153:0/1866798197 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fc1d8060890 0x7fc1d8062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.768+0000 7fc1ef7fe700 1 -- 172.21.15.153:0/1866798197 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fc1f007c660 con 0x7fc1f8140e00 2024-08-17T02:27:11.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.768+0000 7fc1f77fe700 1 --2- 172.21.15.153:0/1866798197 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fc1d8060890 0x7fc1d8062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.768+0000 7fc1f77fe700 1 --2- 172.21.15.153:0/1866798197 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fc1d8060890 0x7fc1d8062d40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8003a80 tx=0x7fc1e8007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:11.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.772+0000 7fc1ef7fe700 1 -- 172.21.15.153:0/1866798197 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc1f004c690 con 0x7fc1f8140e00 2024-08-17T02:27:11.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:27:11.960+0000 7fc1fdcc9700 1 -- 172.21.15.153:0/1866798197 --> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "volume_0000000000118573", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7fc1f80645c0 con 0x7fc1d8060890 2024-08-17T02:27:16.464 INFO:tasks.ceph.mds.a.smithi153.stderr:2024-08-17T02:27:16.460+0000 7fe8be428700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:27:29.418 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:29.421 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:59.467 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:59.471 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:29.523 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:29.526 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:59.587 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:59.590 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:11.673 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-08-17T02:29:11.674 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:29:11.674 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:29:11.696 DEBUG:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:29:11.718 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:29:11.718 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi153.front.sepia.ceph.com... 2024-08-17T02:29:11.718 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:29:11.718 DEBUG:teuthology.orchestra.run.smithi153:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-08-17T02:29:11.731 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi153.stderr:ceph-fuse[32833]: fuse finished with error 0 and tester_r 0 2024-08-17T02:29:11.733 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2024-08-17T02:29:11.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:11.734 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:29:11.853 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi174.front.sepia.ceph.com... 2024-08-17T02:29:11.853 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:29:11.853 DEBUG:teuthology.orchestra.run.smithi174:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-08-17T02:29:11.869 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi174.stderr:ceph-fuse[30396]: fuse finished with error 0 and tester_r 0 2024-08-17T02:29:11.870 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi174.front.sepia.ceph.com 2024-08-17T02:29:11.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:11.871 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:29:11.954 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2024-08-17T02:29:11.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:11.955 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-08-17T02:29:11.962 INFO:teuthology.orchestra.run.smithi153.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-08-17T02:29:11.962 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:29:11.963 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi174.front.sepia.ceph.com 2024-08-17T02:29:11.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:11.963 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-08-17T02:29:11.970 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:29:11.971 INFO:teuthology.orchestra.run.smithi174.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-08-17T02:29:11.971 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:12.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.086+0000 7f6ab3fff700 1 Processor -- start 2024-08-17T02:29:12.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.086+0000 7f6ab3fff700 1 -- start start 2024-08-17T02:29:12.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.086+0000 7f6ab3fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6ab406e620 0x7f6ab40b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.086+0000 7f6ab3fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6ab40b1630 0x7f6ab4141e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.086+0000 7f6ab3fff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab4141a00 con 0x7f6ab40b0d20 2024-08-17T02:29:12.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.086+0000 7f6ab3fff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ab4140b10 con 0x7f6ab40b1630 2024-08-17T02:29:12.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.086+0000 7f6ab3fff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ab4140df0 con 0x7f6ab406e620 2024-08-17T02:29:12.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.086+0000 7f6ab37fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6ab40b1630 0x7f6ab4141e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.086+0000 7f6ab2ffd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f6ab40b0d20 0x7f6ab406df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:57428/0 (socket says 172.21.15.153:57428) 2024-08-17T02:29:12.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.086+0000 7f6ab37fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6ab40b1630 0x7f6ab4141e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39546/0 (socket says 172.21.15.153:39546) 2024-08-17T02:29:12.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.086+0000 7f6ab2ffd700 1 -- 172.21.15.153:0/1198044921 learned_addr learned my addr 172.21.15.153:0/1198044921 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:29:12.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.086+0000 7f6ab27fc700 1 --2- 172.21.15.153:0/1198044921 >> v2:172.21.15.174:3300/0 conn(0x7f6ab406e620 0x7f6ab40b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.086+0000 7f6ab1ffb700 1 -- 172.21.15.153:0/1198044921 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 520522422 0 0) 0x7f6ab4141a00 con 0x7f6ab40b0d20 2024-08-17T02:29:12.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.086+0000 7f6ab1ffb700 1 -- 172.21.15.153:0/1198044921 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a9c003570 con 0x7f6ab40b0d20 2024-08-17T02:29:12.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.086+0000 7f6ab37fe700 1 -- 172.21.15.153:0/1198044921 >> v2:172.21.15.174:3300/0 conn(0x7f6ab406e620 msgr2=0x7f6ab40b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:12.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.086+0000 7f6ab37fe700 1 --2- 172.21.15.153:0/1198044921 >> v2:172.21.15.174:3300/0 conn(0x7f6ab406e620 0x7f6ab40b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.086+0000 7f6ab37fe700 1 -- 172.21.15.153:0/1198044921 >> v1:172.21.15.153:6789/0 conn(0x7f6ab40b0d20 legacy=0x7f6ab406df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.086+0000 7f6ab37fe700 1 -- 172.21.15.153:0/1198044921 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab41410d0 con 0x7f6ab40b1630 2024-08-17T02:29:12.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.086+0000 7f6ab37fe700 1 --2- 172.21.15.153:0/1198044921 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ab40b1630 0x7f6ab4141e90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6ab406c630 tx=0x7f6aac009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3425b1f5dcf70be6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:12.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.086+0000 7f6ab1ffb700 1 -- 172.21.15.153:0/1198044921 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac00e070 con 0x7f6ab40b1630 2024-08-17T02:29:12.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.086+0000 7f6ab1ffb700 1 -- 172.21.15.153:0/1198044921 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aac00bab0 con 0x7f6ab40b1630 2024-08-17T02:29:12.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.086+0000 7f6ab1ffb700 1 -- 172.21.15.153:0/1198044921 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac00be70 con 0x7f6ab40b1630 2024-08-17T02:29:12.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.086+0000 7f6ab3fff700 1 -- 172.21.15.153:0/1198044921 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ab40b1630 msgr2=0x7f6ab4141e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.086+0000 7f6ab3fff700 1 --2- 172.21.15.153:0/1198044921 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ab40b1630 0x7f6ab4141e90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6ab406c630 tx=0x7f6aac009780 comp rx=0 tx=0).stop 2024-08-17T02:29:12.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.086+0000 7f6ab3fff700 1 -- 172.21.15.153:0/1198044921 shutdown_connections 2024-08-17T02:29:12.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.086+0000 7f6ab3fff700 1 --2- 172.21.15.153:0/1198044921 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ab40b1630 0x7f6ab4141e90 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.086+0000 7f6ab3fff700 1 --2- 172.21.15.153:0/1198044921 >> v2:172.21.15.174:3300/0 conn(0x7f6ab406e620 0x7f6ab40b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.086+0000 7f6ab3fff700 1 -- 172.21.15.153:0/1198044921 >> 172.21.15.153:0/1198044921 conn(0x7f6ab40678d0 msgr2=0x7f6ab4067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:12.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.086+0000 7f6ab3fff700 1 -- 172.21.15.153:0/1198044921 shutdown_connections 2024-08-17T02:29:12.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.086+0000 7f6ab3fff700 1 -- 172.21.15.153:0/1198044921 wait complete. 2024-08-17T02:29:12.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.090+0000 7f6ab3fff700 1 Processor -- start 2024-08-17T02:29:12.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.090+0000 7f6ab3fff700 1 -- start start 2024-08-17T02:29:12.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.090+0000 7f6ab3fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ab406e620 0x7f6ab40a6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.090+0000 7f6ab3fff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ab40b0d20 0x7f6ab40a5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.090+0000 7f6ab3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ab40b1630 0x7f6ab40a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.090+0000 7f6ab3fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab40a65f0 con 0x7f6ab40b1630 2024-08-17T02:29:12.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.090+0000 7f6ab3fff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab4147650 con 0x7f6ab40b0d20 2024-08-17T02:29:12.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.090+0000 7f6ab3fff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab415cf20 con 0x7f6ab406e620 2024-08-17T02:29:12.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.090+0000 7f6ab37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ab40b1630 0x7f6ab40a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.090+0000 7f6ab37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ab40b1630 0x7f6ab40a5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39560/0 (socket says 172.21.15.153:39560) 2024-08-17T02:29:12.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.090+0000 7f6ab37fe700 1 -- 172.21.15.153:0/53939398 learned_addr learned my addr 172.21.15.153:0/53939398 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:12.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.090+0000 7f6ab27fc700 1 --2- 172.21.15.153:0/53939398 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ab40b0d20 0x7f6ab40a5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.090+0000 7f6ab2ffd700 1 --2- 172.21.15.153:0/53939398 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ab406e620 0x7f6ab40a6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.090+0000 7f6ab37fe700 1 -- 172.21.15.153:0/53939398 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ab406e620 msgr2=0x7f6ab40a6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.090+0000 7f6ab37fe700 1 --2- 172.21.15.153:0/53939398 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ab406e620 0x7f6ab40a6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.090+0000 7f6ab37fe700 1 -- 172.21.15.153:0/53939398 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ab40b0d20 msgr2=0x7f6ab40a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.090+0000 7f6ab37fe700 1 --2- 172.21.15.153:0/53939398 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ab40b0d20 0x7f6ab40a5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.090+0000 7f6ab37fe700 1 -- 172.21.15.153:0/53939398 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aac009a20 con 0x7f6ab40b1630 2024-08-17T02:29:12.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.090+0000 7f6ab37fe700 1 --2- 172.21.15.153:0/53939398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ab40b1630 0x7f6ab40a5990 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6ab406c2d0 tx=0x7f6aac019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:12.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.090+0000 7f6a9affd700 1 -- 172.21.15.153:0/53939398 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac012dd0 con 0x7f6ab40b1630 2024-08-17T02:29:12.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.094+0000 7f6a9affd700 1 -- 172.21.15.153:0/53939398 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aac027470 con 0x7f6ab40b1630 2024-08-17T02:29:12.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.094+0000 7f6ab3fff700 1 -- 172.21.15.153:0/53939398 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ab40a6030 con 0x7f6ab40b1630 2024-08-17T02:29:12.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.094+0000 7f6a9affd700 1 -- 172.21.15.153:0/53939398 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac027830 con 0x7f6ab40b1630 2024-08-17T02:29:12.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.094+0000 7f6ab3fff700 1 -- 172.21.15.153:0/53939398 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab41472e0 con 0x7f6ab40b1630 2024-08-17T02:29:12.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.094+0000 7f6a9affd700 1 -- 172.21.15.153:0/53939398 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6aac024070 con 0x7f6ab40b1630 2024-08-17T02:29:12.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.094+0000 7f6ab3fff700 1 -- 172.21.15.153:0/53939398 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab4147800 con 0x7f6ab40b1630 2024-08-17T02:29:12.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.094+0000 7f6a9affd700 1 --2- 172.21.15.153:0/53939398 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6aa0060860 0x7f6aa0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.094+0000 7f6a9affd700 1 -- 172.21.15.153:0/53939398 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f6aac07f930 con 0x7f6ab40b1630 2024-08-17T02:29:12.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.094+0000 7f6ab2ffd700 1 --2- 172.21.15.153:0/53939398 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6aa0060860 0x7f6aa0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.094+0000 7f6ab2ffd700 1 --2- 172.21.15.153:0/53939398 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6aa0060860 0x7f6aa0062d10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8007fd0 tx=0x7f6aa8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:12.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.102+0000 7f6a9affd700 1 -- 172.21.15.153:0/53939398 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f6ab4147800 con 0x7f6ab40b1630 2024-08-17T02:29:12.309 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.306+0000 7f6ab3fff700 1 -- 172.21.15.153:0/53939398 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ab4147800 con 0x7f6ab40b1630 2024-08-17T02:29:12.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.306+0000 7f6a9affd700 1 -- 172.21.15.153:0/53939398 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+5692 (secure 0 0 0) 0x7f6ab4147800 con 0x7f6ab40b1630 2024-08-17T02:29:12.310 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:29:12.310 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4885,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/747297575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":747297575},{"type":"v1","addr":"172.21.15.174:6833","nonce":747297575}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4891,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1080524090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1080524090},{"type":"v1","addr":"172.21.15.174:6835","nonce":1080524090}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:55.849257+0000","modified":"2024-08-17T02:26:59.510699+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5031},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5031":{"gid":5031,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6837/2567193475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":2567193475},{"type":"v1","addr":"172.21.15.153:6837","nonce":2567193475}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:09.642872+0000","modified":"2024-08-17T02:27:11.644228+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5013},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5013":{"gid":5013,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":7,"addr":"172.21.15.153:6835/2569513399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2569513399},{"type":"v1","addr":"172.21.15.153:6835","nonce":2569513399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000118573","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:29:12.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.310+0000 7f6ab3fff700 1 -- 172.21.15.153:0/53939398 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6aa0060860 msgr2=0x7f6aa0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.310+0000 7f6ab3fff700 1 --2- 172.21.15.153:0/53939398 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6aa0060860 0x7f6aa0062d10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8007fd0 tx=0x7f6aa8009040 comp rx=0 tx=0).stop 2024-08-17T02:29:12.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.310+0000 7f6ab3fff700 1 -- 172.21.15.153:0/53939398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ab40b1630 msgr2=0x7f6ab40a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.310+0000 7f6ab3fff700 1 --2- 172.21.15.153:0/53939398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ab40b1630 0x7f6ab40a5990 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6ab406c2d0 tx=0x7f6aac019000 comp rx=0 tx=0).stop 2024-08-17T02:29:12.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.310+0000 7f6ab3fff700 1 -- 172.21.15.153:0/53939398 shutdown_connections 2024-08-17T02:29:12.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.310+0000 7f6ab3fff700 1 --2- 172.21.15.153:0/53939398 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6aa0060860 0x7f6aa0062d10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.310+0000 7f6ab3fff700 1 --2- 172.21.15.153:0/53939398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ab40b1630 0x7f6ab40a5990 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.310+0000 7f6ab3fff700 1 --2- 172.21.15.153:0/53939398 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ab40b0d20 0x7f6ab40a5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.310+0000 7f6ab3fff700 1 --2- 172.21.15.153:0/53939398 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ab406e620 0x7f6ab40a6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.310+0000 7f6ab3fff700 1 -- 172.21.15.153:0/53939398 >> 172.21.15.153:0/53939398 conn(0x7f6ab40678d0 msgr2=0x7f6ab406a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:12.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.310+0000 7f6ab3fff700 1 -- 172.21.15.153:0/53939398 shutdown_connections 2024-08-17T02:29:12.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.310+0000 7f6ab3fff700 1 -- 172.21.15.153:0/53939398 wait complete. 2024-08-17T02:29:12.314 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 18 2024-08-17T02:29:12.325 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:12.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.430+0000 7f7827fff700 1 Processor -- start 2024-08-17T02:29:12.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.430+0000 7f7827fff700 1 -- start start 2024-08-17T02:29:12.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.430+0000 7f7827fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78280b0d20 0x7f782806df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.430+0000 7f7827fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f782806e450 0x7f78280b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.430+0000 7f7827fff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7828141a00 con 0x7f78280b1630 2024-08-17T02:29:12.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.430+0000 7f7827fff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f782806e8a0 con 0x7f782806e450 2024-08-17T02:29:12.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.430+0000 7f7827fff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7828140b10 con 0x7f78280b0d20 2024-08-17T02:29:12.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.430+0000 7f78277fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f78280b1630 0x7f78281610f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35412/0 (socket says 172.21.15.153:35412) 2024-08-17T02:29:12.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.430+0000 7f78277fe700 1 -- 172.21.15.153:0/4205715087 learned_addr learned my addr 172.21.15.153:0/4205715087 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:29:12.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.430+0000 7f78267fc700 1 --2- 172.21.15.153:0/4205715087 >> v2:172.21.15.174:3300/0 conn(0x7f782806e450 0x7f78280b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.430+0000 7f7826ffd700 1 --2- 172.21.15.153:0/4205715087 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78280b0d20 0x7f782806df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.434+0000 7f7825ffb700 1 -- 172.21.15.153:0/4205715087 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1999999386 0 0) 0x7f7828141a00 con 0x7f78280b1630 2024-08-17T02:29:12.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.434+0000 7f7825ffb700 1 -- 172.21.15.153:0/4205715087 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7808003570 con 0x7f78280b1630 2024-08-17T02:29:12.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.434+0000 7f78267fc700 1 -- 172.21.15.153:0/4205715087 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78280b0d20 msgr2=0x7f782806df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:12.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.434+0000 7f78267fc700 1 --2- 172.21.15.153:0/4205715087 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78280b0d20 0x7f782806df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.434+0000 7f78267fc700 1 -- 172.21.15.153:0/4205715087 >> v1:172.21.15.153:6789/0 conn(0x7f78280b1630 legacy=0x7f78281610f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.434+0000 7f78267fc700 1 -- 172.21.15.153:0/4205715087 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7828140df0 con 0x7f782806e450 2024-08-17T02:29:12.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.434+0000 7f78267fc700 1 --2- 172.21.15.153:0/4205715087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f782806e450 0x7f78280b10f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f78100098e0 tx=0x7f78100091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b21739a25d379457 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:12.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.434+0000 7f7825ffb700 1 -- 172.21.15.153:0/4205715087 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7810011630 con 0x7f782806e450 2024-08-17T02:29:12.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.434+0000 7f7825ffb700 1 -- 172.21.15.153:0/4205715087 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7810011790 con 0x7f782806e450 2024-08-17T02:29:12.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.434+0000 7f7825ffb700 1 -- 172.21.15.153:0/4205715087 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7810011b30 con 0x7f782806e450 2024-08-17T02:29:12.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.434+0000 7f7827fff700 1 -- 172.21.15.153:0/4205715087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f782806e450 msgr2=0x7f78280b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.434+0000 7f7827fff700 1 --2- 172.21.15.153:0/4205715087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f782806e450 0x7f78280b10f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f78100098e0 tx=0x7f78100091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.434+0000 7f7827fff700 1 -- 172.21.15.153:0/4205715087 shutdown_connections 2024-08-17T02:29:12.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.434+0000 7f7827fff700 1 --2- 172.21.15.153:0/4205715087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f782806e450 0x7f78280b10f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.434+0000 7f7827fff700 1 --2- 172.21.15.153:0/4205715087 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78280b0d20 0x7f782806df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.434+0000 7f7827fff700 1 -- 172.21.15.153:0/4205715087 >> 172.21.15.153:0/4205715087 conn(0x7f78280678d0 msgr2=0x7f7828067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:12.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.434+0000 7f7827fff700 1 -- 172.21.15.153:0/4205715087 shutdown_connections 2024-08-17T02:29:12.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.434+0000 7f7827fff700 1 -- 172.21.15.153:0/4205715087 wait complete. 2024-08-17T02:29:12.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.434+0000 7f7827fff700 1 Processor -- start 2024-08-17T02:29:12.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.434+0000 7f7827fff700 1 -- start start 2024-08-17T02:29:12.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.438+0000 7f7827fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f782806e450 0x7f782815b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.438+0000 7f7827fff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78280b0d20 0x7f78280a6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.438+0000 7f7827fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78280b1630 0x7f782815eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.438+0000 7f7827fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78280a9d80 con 0x7f782806e450 2024-08-17T02:29:12.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.438+0000 7f7827fff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782815b7f0 con 0x7f78280b0d20 2024-08-17T02:29:12.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.438+0000 7f7827fff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78280a55f0 con 0x7f78280b1630 2024-08-17T02:29:12.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.438+0000 7f7826ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f782806e450 0x7f782815b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.438+0000 7f7826ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f782806e450 0x7f782815b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52348/0 (socket says 172.21.15.153:52348) 2024-08-17T02:29:12.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.438+0000 7f7826ffd700 1 -- 172.21.15.153:0/1385919840 learned_addr learned my addr 172.21.15.153:0/1385919840 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:12.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.438+0000 7f78267fc700 1 --2- 172.21.15.153:0/1385919840 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78280b0d20 0x7f78280a6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.438+0000 7f78277fe700 1 --2- 172.21.15.153:0/1385919840 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78280b1630 0x7f782815eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.438+0000 7f7826ffd700 1 -- 172.21.15.153:0/1385919840 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78280b1630 msgr2=0x7f782815eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.438+0000 7f7826ffd700 1 --2- 172.21.15.153:0/1385919840 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78280b1630 0x7f782815eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.438+0000 7f7826ffd700 1 -- 172.21.15.153:0/1385919840 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78280b0d20 msgr2=0x7f78280a6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.438+0000 7f7826ffd700 1 --2- 172.21.15.153:0/1385919840 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78280b0d20 0x7f78280a6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.438+0000 7f7826ffd700 1 -- 172.21.15.153:0/1385919840 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7810009420 con 0x7f782806e450 2024-08-17T02:29:12.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.438+0000 7f78277fe700 1 --2- 172.21.15.153:0/1385919840 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78280b1630 0x7f782815eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:12.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.438+0000 7f7826ffd700 1 --2- 172.21.15.153:0/1385919840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f782806e450 0x7f782815b2b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f781800ecb0 tx=0x7f78180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:12.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.438+0000 7f781effd700 1 -- 172.21.15.153:0/1385919840 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781800c920 con 0x7f782806e450 2024-08-17T02:29:12.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.438+0000 7f781effd700 1 -- 172.21.15.153:0/1385919840 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781800ca80 con 0x7f782806e450 2024-08-17T02:29:12.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.438+0000 7f781effd700 1 -- 172.21.15.153:0/1385919840 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781800ce20 con 0x7f782806e450 2024-08-17T02:29:12.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.438+0000 7f7827fff700 1 -- 172.21.15.153:0/1385919840 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78280a5890 con 0x7f782806e450 2024-08-17T02:29:12.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.438+0000 7f7827fff700 1 -- 172.21.15.153:0/1385919840 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78280a5e50 con 0x7f782806e450 2024-08-17T02:29:12.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.442+0000 7f7827fff700 1 -- 172.21.15.153:0/1385919840 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78280643a0 con 0x7f782806e450 2024-08-17T02:29:12.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.442+0000 7f781effd700 1 -- 172.21.15.153:0/1385919840 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7818013680 con 0x7f782806e450 2024-08-17T02:29:12.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.442+0000 7f781effd700 1 --2- 172.21.15.153:0/1385919840 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f780c060860 0x7f780c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.442+0000 7f781effd700 1 -- 172.21.15.153:0/1385919840 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f781807d1d0 con 0x7f782806e450 2024-08-17T02:29:12.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.442+0000 7f78267fc700 1 --2- 172.21.15.153:0/1385919840 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f780c060860 0x7f780c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.442+0000 7f78267fc700 1 --2- 172.21.15.153:0/1385919840 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f780c060860 0x7f780c062d10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f78100091e0 tx=0x7f7810017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:12.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.450+0000 7f781effd700 1 -- 172.21.15.153:0/1385919840 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f781804d2a0 con 0x7f782806e450 2024-08-17T02:29:12.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.614+0000 7f7827fff700 1 -- 172.21.15.153:0/1385919840 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f782806f5f0 con 0x7f782806e450 2024-08-17T02:29:12.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.614+0000 7f781effd700 1 -- 172.21.15.153:0/1385919840 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18647 (secure 0 0 0) 0x7f78180508c0 con 0x7f782806e450 2024-08-17T02:29:12.618 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:29:12.618 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":37,"fsid":"56d41c33-b929-456d-96be-2aac4ecd299d","created":"2024-08-17T02:25:47.756085+0000","modified":"2024-08-17T02:27:12.631951+0000","last_up_change":"2024-08-17T02:25:58.643690+0000","last_in_change":"2024-08-17T02:25:49.809186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:58.093273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:54.363196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:54.837150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000118573.meta","create_time":"2024-08-17T02:27:08.568651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000118573"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000118573.data","create_time":"2024-08-17T02:27:08.668955+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000118573"}}}],"osds":[{"osd":0,"uuid":"0736f8e6-818e-42e6-a0dc-8aaf813315d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":24234},{"type":"v1","addr":"172.21.15.153:6817","nonce":24234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":24234},{"type":"v1","addr":"172.21.15.153:6819","nonce":24234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":24234},{"type":"v1","addr":"172.21.15.153:6823","nonce":24234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":24234},{"type":"v1","addr":"172.21.15.153:6821","nonce":24234}]},"public_addr":"172.21.15.153:6817/24234","cluster_addr":"172.21.15.153:6819/24234","heartbeat_back_addr":"172.21.15.153:6823/24234","heartbeat_front_addr":"172.21.15.153:6821/24234","state":["exists","up"]},{"osd":1,"uuid":"011762e9-6c2d-441a-aa56-68474639d72f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":24232},{"type":"v1","addr":"172.21.15.153:6801","nonce":24232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":24232},{"type":"v1","addr":"172.21.15.153:6803","nonce":24232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":24232},{"type":"v1","addr":"172.21.15.153:6809","nonce":24232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":24232},{"type":"v1","addr":"172.21.15.153:6806","nonce":24232}]},"public_addr":"172.21.15.153:6801/24232","cluster_addr":"172.21.15.153:6803/24232","heartbeat_back_addr":"172.21.15.153:6809/24232","heartbeat_front_addr":"172.21.15.153:6806/24232","state":["exists","up"]},{"osd":2,"uuid":"b562cd97-aa12-455e-b46a-e720a2ec9d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":24235},{"type":"v1","addr":"172.21.15.153:6808","nonce":24235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":24235},{"type":"v1","addr":"172.21.15.153:6811","nonce":24235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":24235},{"type":"v1","addr":"172.21.15.153:6815","nonce":24235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":24235},{"type":"v1","addr":"172.21.15.153:6813","nonce":24235}]},"public_addr":"172.21.15.153:6808/24235","cluster_addr":"172.21.15.153:6811/24235","heartbeat_back_addr":"172.21.15.153:6815/24235","heartbeat_front_addr":"172.21.15.153:6813/24235","state":["exists","up"]},{"osd":3,"uuid":"222da52f-90c2-4132-a5d2-6f6cf83d4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":24236},{"type":"v1","addr":"172.21.15.153:6825","nonce":24236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":24236},{"type":"v1","addr":"172.21.15.153:6827","nonce":24236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":24236},{"type":"v1","addr":"172.21.15.153:6831","nonce":24236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":24236},{"type":"v1","addr":"172.21.15.153:6829","nonce":24236}]},"public_addr":"172.21.15.153:6825/24236","cluster_addr":"172.21.15.153:6827/24236","heartbeat_back_addr":"172.21.15.153:6831/24236","heartbeat_front_addr":"172.21.15.153:6829/24236","state":["exists","up"]},{"osd":4,"uuid":"a38a04cd-032b-4977-a260-1ef3567d0c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24456},{"type":"v1","addr":"172.21.15.174:6809","nonce":24456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24456},{"type":"v1","addr":"172.21.15.174:6811","nonce":24456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24456},{"type":"v1","addr":"172.21.15.174:6815","nonce":24456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24456},{"type":"v1","addr":"172.21.15.174:6813","nonce":24456}]},"public_addr":"172.21.15.174:6809/24456","cluster_addr":"172.21.15.174:6811/24456","heartbeat_back_addr":"172.21.15.174:6815/24456","heartbeat_front_addr":"172.21.15.174:6813/24456","state":["exists","up"]},{"osd":5,"uuid":"c7778084-e751-48da-87a1-ab8bbe85aa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24457},{"type":"v1","addr":"172.21.15.174:6825","nonce":24457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24457},{"type":"v1","addr":"172.21.15.174:6827","nonce":24457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24457},{"type":"v1","addr":"172.21.15.174:6831","nonce":24457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24457},{"type":"v1","addr":"172.21.15.174:6829","nonce":24457}]},"public_addr":"172.21.15.174:6825/24457","cluster_addr":"172.21.15.174:6827/24457","heartbeat_back_addr":"172.21.15.174:6831/24457","heartbeat_front_addr":"172.21.15.174:6829/24457","state":["exists","up"]},{"osd":6,"uuid":"2d8e0715-254f-442c-9625-50721d0bc858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24477},{"type":"v1","addr":"172.21.15.174:6801","nonce":24477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24477},{"type":"v1","addr":"172.21.15.174:6803","nonce":24477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24477},{"type":"v1","addr":"172.21.15.174:6807","nonce":24477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24477},{"type":"v1","addr":"172.21.15.174:6805","nonce":24477}]},"public_addr":"172.21.15.174:6801/24477","cluster_addr":"172.21.15.174:6803/24477","heartbeat_back_addr":"172.21.15.174:6807/24477","heartbeat_front_addr":"172.21.15.174:6805/24477","state":["exists","up"]},{"osd":7,"uuid":"dffda25a-4601-4ddb-9a27-b0be1cadde27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24455},{"type":"v1","addr":"172.21.15.174:6817","nonce":24455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24455},{"type":"v1","addr":"172.21.15.174:6819","nonce":24455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24455},{"type":"v1","addr":"172.21.15.174:6823","nonce":24455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24455},{"type":"v1","addr":"172.21.15.174:6821","nonce":24455}]},"public_addr":"172.21.15.174:6817/24455","cluster_addr":"172.21.15.174:6819/24455","heartbeat_back_addr":"172.21.15.174:6823/24455","heartbeat_front_addr":"172.21.15.174:6821/24455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.990117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.033862+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.748087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.112877+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.070448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.360961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.110940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.226377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:12.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.618+0000 7f7827fff700 1 -- 172.21.15.153:0/1385919840 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f780c060860 msgr2=0x7f780c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.618+0000 7f7827fff700 1 --2- 172.21.15.153:0/1385919840 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f780c060860 0x7f780c062d10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f78100091e0 tx=0x7f7810017000 comp rx=0 tx=0).stop 2024-08-17T02:29:12.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.618+0000 7f7827fff700 1 -- 172.21.15.153:0/1385919840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f782806e450 msgr2=0x7f782815b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.618+0000 7f7827fff700 1 --2- 172.21.15.153:0/1385919840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f782806e450 0x7f782815b2b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f781800ecb0 tx=0x7f78180091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.618+0000 7f7827fff700 1 -- 172.21.15.153:0/1385919840 shutdown_connections 2024-08-17T02:29:12.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.618+0000 7f7827fff700 1 --2- 172.21.15.153:0/1385919840 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f780c060860 0x7f780c062d10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.618+0000 7f7827fff700 1 --2- 172.21.15.153:0/1385919840 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78280b1630 0x7f782815eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.618+0000 7f7827fff700 1 --2- 172.21.15.153:0/1385919840 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78280b0d20 0x7f78280a6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.618+0000 7f7827fff700 1 --2- 172.21.15.153:0/1385919840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f782806e450 0x7f782815b2b0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.618+0000 7f7827fff700 1 -- 172.21.15.153:0/1385919840 >> 172.21.15.153:0/1385919840 conn(0x7f78280678d0 msgr2=0x7f7828063060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:12.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.618+0000 7f7827fff700 1 -- 172.21.15.153:0/1385919840 shutdown_connections 2024-08-17T02:29:12.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.618+0000 7f7827fff700 1 -- 172.21.15.153:0/1385919840 wait complete. 2024-08-17T02:29:12.632 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:58.093273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:26:54.363196+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:26:54.837150+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000000118573.meta', 'create_time': '2024-08-17T02:27:08.568651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000118573'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000000118573.data', 'create_time': '2024-08-17T02:27:08.668955+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000118573'}}}] 2024-08-17T02:29:12.632 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:29:12.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.742+0000 7f9c1cc53700 1 Processor -- start 2024-08-17T02:29:12.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.742+0000 7f9c1cc53700 1 -- start start 2024-08-17T02:29:12.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.742+0000 7f9c1cc53700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9c180aede0 0x7f9c180b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.742+0000 7f9c1cc53700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c180af1b0 0x7f9c18066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.742+0000 7f9c1cc53700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c18067cd0 con 0x7f9c18067340 2024-08-17T02:29:12.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.742+0000 7f9c1cc53700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c180b0050 con 0x7f9c180aede0 2024-08-17T02:29:12.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.742+0000 7f9c1cc53700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c18067750 con 0x7f9c180af1b0 2024-08-17T02:29:12.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.742+0000 7f9c17fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f9c18067340 0x7f9c18159780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35428/0 (socket says 172.21.15.153:35428) 2024-08-17T02:29:12.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.742+0000 7f9c17fff700 1 -- 172.21.15.153:0/2981120576 learned_addr learned my addr 172.21.15.153:0/2981120576 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:29:12.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.742+0000 7f9c16ffd700 1 --2- 172.21.15.153:0/2981120576 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c180af1b0 0x7f9c18066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.742+0000 7f9c177fe700 1 --2- 172.21.15.153:0/2981120576 >> v2:172.21.15.174:3300/0 conn(0x7f9c180aede0 0x7f9c180b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.742+0000 7f9c167fc700 1 -- 172.21.15.153:0/2981120576 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1229741090 0 0) 0x7f9c18067cd0 con 0x7f9c18067340 2024-08-17T02:29:12.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.742+0000 7f9c167fc700 1 -- 172.21.15.153:0/2981120576 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c00003570 con 0x7f9c18067340 2024-08-17T02:29:12.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.742+0000 7f9c167fc700 1 -- 172.21.15.153:0/2981120576 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2423114616 0 0) 0x7f9c00003570 con 0x7f9c18067340 2024-08-17T02:29:12.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.742+0000 7f9c16ffd700 1 -- 172.21.15.153:0/2981120576 >> v2:172.21.15.174:3300/0 conn(0x7f9c180aede0 msgr2=0x7f9c180b04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:12.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.742+0000 7f9c16ffd700 1 --2- 172.21.15.153:0/2981120576 >> v2:172.21.15.174:3300/0 conn(0x7f9c180aede0 0x7f9c180b04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.742+0000 7f9c16ffd700 1 -- 172.21.15.153:0/2981120576 >> v1:172.21.15.153:6789/0 conn(0x7f9c18067340 legacy=0x7f9c18159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.742+0000 7f9c16ffd700 1 -- 172.21.15.153:0/2981120576 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c1815a3a0 con 0x7f9c180af1b0 2024-08-17T02:29:12.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.742+0000 7f9c177fe700 1 --2- 172.21.15.153:0/2981120576 >> v2:172.21.15.174:3300/0 conn(0x7f9c180aede0 0x7f9c180b04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:12.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.742+0000 7f9c16ffd700 1 --2- 172.21.15.153:0/2981120576 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c180af1b0 0x7f9c18066e00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9c080098e0 tx=0x7f9c080091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7dfa1abb662db95 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:12.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.742+0000 7f9c167fc700 1 -- 172.21.15.153:0/2981120576 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c100017f0 con 0x7f9c180af1b0 2024-08-17T02:29:12.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.742+0000 7f9c167fc700 1 -- 172.21.15.153:0/2981120576 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c08011420 con 0x7f9c180af1b0 2024-08-17T02:29:12.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.742+0000 7f9c167fc700 1 -- 172.21.15.153:0/2981120576 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c080117a0 con 0x7f9c180af1b0 2024-08-17T02:29:12.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.742+0000 7f9c1cc53700 1 -- 172.21.15.153:0/2981120576 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c180af1b0 msgr2=0x7f9c18066e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.742+0000 7f9c1cc53700 1 --2- 172.21.15.153:0/2981120576 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c180af1b0 0x7f9c18066e00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9c080098e0 tx=0x7f9c080091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.742+0000 7f9c1cc53700 1 -- 172.21.15.153:0/2981120576 shutdown_connections 2024-08-17T02:29:12.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.742+0000 7f9c1cc53700 1 --2- 172.21.15.153:0/2981120576 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c180af1b0 0x7f9c18066e00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.742+0000 7f9c1cc53700 1 --2- 172.21.15.153:0/2981120576 >> v2:172.21.15.174:3300/0 conn(0x7f9c180aede0 0x7f9c180b04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.742+0000 7f9c1cc53700 1 -- 172.21.15.153:0/2981120576 >> 172.21.15.153:0/2981120576 conn(0x7f9c180682c0 msgr2=0x7f9c180686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:12.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.742+0000 7f9c1cc53700 1 -- 172.21.15.153:0/2981120576 shutdown_connections 2024-08-17T02:29:12.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.742+0000 7f9c1cc53700 1 -- 172.21.15.153:0/2981120576 wait complete. 2024-08-17T02:29:12.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.746+0000 7f9c1cc53700 1 Processor -- start 2024-08-17T02:29:12.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.746+0000 7f9c1cc53700 1 -- start start 2024-08-17T02:29:12.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.746+0000 7f9c1cc53700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c18067340 0x7f9c180c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.746+0000 7f9c1cc53700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c180aede0 0x7f9c180b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.746+0000 7f9c1cc53700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c180af1b0 0x7f9c18152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.746+0000 7f9c1cc53700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c180b34d0 con 0x7f9c180af1b0 2024-08-17T02:29:12.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.746+0000 7f9c1cc53700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c180b4a50 con 0x7f9c18067340 2024-08-17T02:29:12.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.746+0000 7f9c1cc53700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c180b4cf0 con 0x7f9c180aede0 2024-08-17T02:29:12.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.746+0000 7f9c17fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c180af1b0 0x7f9c18152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.746+0000 7f9c16ffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c180aede0 0x7f9c180b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.746+0000 7f9c177fe700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c18067340 0x7f9c180c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.746+0000 7f9c16ffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c180aede0 0x7f9c180b4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.153:33494/0 (socket says 172.21.15.153:33494) 2024-08-17T02:29:12.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.746+0000 7f9c17fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c180af1b0 0x7f9c18152930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52360/0 (socket says 172.21.15.153:52360) 2024-08-17T02:29:12.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.746+0000 7f9c16ffd700 1 -- 172.21.15.153:0/2284723045 learned_addr learned my addr 172.21.15.153:0/2284723045 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:12.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.746+0000 7f9c16ffd700 1 -- 172.21.15.153:0/2284723045 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c18067340 msgr2=0x7f9c180c6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.746+0000 7f9c16ffd700 1 --2- 172.21.15.153:0/2284723045 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c18067340 0x7f9c180c6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.746+0000 7f9c16ffd700 1 -- 172.21.15.153:0/2284723045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c180af1b0 msgr2=0x7f9c18152930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.746+0000 7f9c16ffd700 1 --2- 172.21.15.153:0/2284723045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c180af1b0 0x7f9c18152930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.746+0000 7f9c16ffd700 1 -- 172.21.15.153:0/2284723045 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0c009420 con 0x7f9c180aede0 2024-08-17T02:29:12.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.750+0000 7f9c16ffd700 1 --2- 172.21.15.153:0/2284723045 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c180aede0 0x7f9c180b4510 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9c18067890 tx=0x7f9c08016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:12.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.750+0000 7f9bff7fe700 1 -- 172.21.15.153:0/2284723045 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0801caf0 con 0x7f9c180aede0 2024-08-17T02:29:12.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.750+0000 7f9bff7fe700 1 -- 172.21.15.153:0/2284723045 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0801cc70 con 0x7f9c180aede0 2024-08-17T02:29:12.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.750+0000 7f9c1cc53700 1 -- 172.21.15.153:0/2284723045 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c08009420 con 0x7f9c180aede0 2024-08-17T02:29:12.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.750+0000 7f9bff7fe700 1 -- 172.21.15.153:0/2284723045 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0801a450 con 0x7f9c180aede0 2024-08-17T02:29:12.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.750+0000 7f9c1cc53700 1 -- 172.21.15.153:0/2284723045 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c180b2e80 con 0x7f9c180aede0 2024-08-17T02:29:12.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.750+0000 7f9c1cc53700 1 -- 172.21.15.153:0/2284723045 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c180b3680 con 0x7f9c180aede0 2024-08-17T02:29:12.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.750+0000 7f9bff7fe700 1 -- 172.21.15.153:0/2284723045 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9c0801a7e0 con 0x7f9c180aede0 2024-08-17T02:29:12.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.750+0000 7f9bff7fe700 1 --2- 172.21.15.153:0/2284723045 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9c04060860 0x7f9c04062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.754 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.750+0000 7f9bff7fe700 1 -- 172.21.15.153:0/2284723045 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f9c0807e650 con 0x7f9c180aede0 2024-08-17T02:29:12.754 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.750+0000 7f9c177fe700 1 --2- 172.21.15.153:0/2284723045 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9c04060860 0x7f9c04062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.754 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.754+0000 7f9c177fe700 1 --2- 172.21.15.153:0/2284723045 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9c04060860 0x7f9c04062d10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c009f40 tx=0x7f9c0c0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:12.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.762+0000 7f9bff7fe700 1 -- 172.21.15.153:0/2284723045 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f9c180b3680 con 0x7f9c180aede0 2024-08-17T02:29:12.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.926+0000 7f9c1cc53700 1 -- 172.21.15.153:0/2284723045 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9c180b3640 con 0x7f9c180aede0 2024-08-17T02:29:12.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.926+0000 7f9bff7fe700 1 -- 172.21.15.153:0/2284723045 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9c0804e7d0 con 0x7f9c180aede0 2024-08-17T02:29:12.929 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2024-08-17T02:29:12.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.930+0000 7f9c1cc53700 1 -- 172.21.15.153:0/2284723045 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9c04060860 msgr2=0x7f9c04062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.930+0000 7f9c1cc53700 1 --2- 172.21.15.153:0/2284723045 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9c04060860 0x7f9c04062d10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c009f40 tx=0x7f9c0c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.930+0000 7f9c1cc53700 1 -- 172.21.15.153:0/2284723045 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c180aede0 msgr2=0x7f9c180b4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.930+0000 7f9c1cc53700 1 --2- 172.21.15.153:0/2284723045 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c180aede0 0x7f9c180b4510 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9c18067890 tx=0x7f9c08016000 comp rx=0 tx=0).stop 2024-08-17T02:29:12.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.930+0000 7f9c1cc53700 1 -- 172.21.15.153:0/2284723045 shutdown_connections 2024-08-17T02:29:12.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.930+0000 7f9c1cc53700 1 --2- 172.21.15.153:0/2284723045 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9c04060860 0x7f9c04062d10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.930+0000 7f9c1cc53700 1 --2- 172.21.15.153:0/2284723045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c180af1b0 0x7f9c18152930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.930+0000 7f9c1cc53700 1 --2- 172.21.15.153:0/2284723045 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c180aede0 0x7f9c180b4510 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.930+0000 7f9c1cc53700 1 --2- 172.21.15.153:0/2284723045 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c18067340 0x7f9c180c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.930+0000 7f9c1cc53700 1 -- 172.21.15.153:0/2284723045 >> 172.21.15.153:0/2284723045 conn(0x7f9c180682c0 msgr2=0x7f9c180cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:12.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.930+0000 7f9c1cc53700 1 -- 172.21.15.153:0/2284723045 shutdown_connections 2024-08-17T02:29:12.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:12.930+0000 7f9c1cc53700 1 -- 172.21.15.153:0/2284723045 wait complete. 2024-08-17T02:29:12.948 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:29:13.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.054+0000 7fecf00fc700 1 Processor -- start 2024-08-17T02:29:13.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.054+0000 7fecf00fc700 1 -- start start 2024-08-17T02:29:13.058 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.054+0000 7fecf00fc700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fece8159380 0x7fece80c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.054+0000 7fecf00fc700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fece806a3b0 con 0x7fece8068db0 2024-08-17T02:29:13.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.054+0000 7fecf00fc700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fece80a9fe0 con 0x7fece8158fb0 2024-08-17T02:29:13.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.054+0000 7fecf00fc700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fece806a0d0 con 0x7fece8159380 2024-08-17T02:29:13.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.058+0000 7feced697700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fece8068db0 0x7fece80aa470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35436/0 (socket says 172.21.15.153:35436) 2024-08-17T02:29:13.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.058+0000 7feced697700 1 -- 172.21.15.153:0/1797699941 learned_addr learned my addr 172.21.15.153:0/1797699941 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:29:13.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.058+0000 7fecee699700 1 --2- 172.21.15.153:0/1797699941 >> v2:172.21.15.174:3300/0 conn(0x7fece8159380 0x7fece80c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.058+0000 7fecece96700 1 -- 172.21.15.153:0/1797699941 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1650743558 0 0) 0x7fece806a3b0 con 0x7fece8068db0 2024-08-17T02:29:13.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.058+0000 7fecece96700 1 -- 172.21.15.153:0/1797699941 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecd4003570 con 0x7fece8068db0 2024-08-17T02:29:13.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.058+0000 7fecee699700 1 -- 172.21.15.153:0/1797699941 >> v1:172.21.15.174:6789/0 conn(0x7fece8158fb0 legacy=0x7fece80686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.058+0000 7fecee699700 1 -- 172.21.15.153:0/1797699941 >> v1:172.21.15.153:6789/0 conn(0x7fece8068db0 legacy=0x7fece80aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.058+0000 7fecee699700 1 -- 172.21.15.153:0/1797699941 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece80a9990 con 0x7fece8159380 2024-08-17T02:29:13.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.058+0000 7fecee699700 1 --2- 172.21.15.153:0/1797699941 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fece8159380 0x7fece80c8b70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fece0009e60 tx=0x7fece0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=429ca4f569b258be server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:13.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.058+0000 7fecece96700 1 -- 172.21.15.153:0/1797699941 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece000e070 con 0x7fece8159380 2024-08-17T02:29:13.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.058+0000 7fecece96700 1 -- 172.21.15.153:0/1797699941 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece000bb60 con 0x7fece8159380 2024-08-17T02:29:13.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.058+0000 7fecece96700 1 -- 172.21.15.153:0/1797699941 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece0012430 con 0x7fece8159380 2024-08-17T02:29:13.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.058+0000 7fecf00fc700 1 -- 172.21.15.153:0/1797699941 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fece8159380 msgr2=0x7fece80c8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.058+0000 7fecf00fc700 1 --2- 172.21.15.153:0/1797699941 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fece8159380 0x7fece80c8b70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fece0009e60 tx=0x7fece0009780 comp rx=0 tx=0).stop 2024-08-17T02:29:13.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.058+0000 7fecf00fc700 1 -- 172.21.15.153:0/1797699941 shutdown_connections 2024-08-17T02:29:13.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.058+0000 7fecf00fc700 1 --2- 172.21.15.153:0/1797699941 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fece8159380 0x7fece80c8b70 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.058+0000 7fecf00fc700 1 -- 172.21.15.153:0/1797699941 >> 172.21.15.153:0/1797699941 conn(0x7fece80c9bf0 msgr2=0x7fece806d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:13.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.058+0000 7fecf00fc700 1 -- 172.21.15.153:0/1797699941 shutdown_connections 2024-08-17T02:29:13.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.058+0000 7fecf00fc700 1 -- 172.21.15.153:0/1797699941 wait complete. 2024-08-17T02:29:13.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.062+0000 7fecf00fc700 1 Processor -- start 2024-08-17T02:29:13.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.062+0000 7fecf00fc700 1 -- start start 2024-08-17T02:29:13.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.062+0000 7fecf00fc700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fece8068db0 0x7fece80ae840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.066+0000 7fecf00fc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fece8158fb0 0x7fece80aa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.066+0000 7fecf00fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fece8159380 0x7fece815a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.066+0000 7fecf00fc700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece815c1d0 con 0x7fece8159380 2024-08-17T02:29:13.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.066+0000 7fecf00fc700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece815af00 con 0x7fece8068db0 2024-08-17T02:29:13.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.066+0000 7fecf00fc700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece815bd40 con 0x7fece8158fb0 2024-08-17T02:29:13.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.066+0000 7fecee699700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fece8159380 0x7fece815a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.066+0000 7fecede98700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fece8068db0 0x7fece80ae840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.066+0000 7feced697700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fece8158fb0 0x7fece80aa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.066+0000 7fecee699700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fece8159380 0x7fece815a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52376/0 (socket says 172.21.15.153:52376) 2024-08-17T02:29:13.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.066+0000 7fecee699700 1 -- 172.21.15.153:0/2949980895 learned_addr learned my addr 172.21.15.153:0/2949980895 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:13.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.066+0000 7fecede98700 1 -- 172.21.15.153:0/2949980895 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fece8158fb0 msgr2=0x7fece80aa4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.066+0000 7fecede98700 1 --2- 172.21.15.153:0/2949980895 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fece8158fb0 0x7fece80aa4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.066+0000 7fecede98700 1 -- 172.21.15.153:0/2949980895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fece8159380 msgr2=0x7fece815a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.066+0000 7fecede98700 1 --2- 172.21.15.153:0/2949980895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fece8159380 0x7fece815a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.069 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.066+0000 7fecede98700 1 -- 172.21.15.153:0/2949980895 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece0009a20 con 0x7fece8068db0 2024-08-17T02:29:13.069 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.066+0000 7fecede98700 1 --2- 172.21.15.153:0/2949980895 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fece8068db0 0x7fece80ae840 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fece400c5c0 tx=0x7fece4007ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:13.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.066+0000 7fecddffb700 1 -- 172.21.15.153:0/2949980895 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece4011590 con 0x7fece8068db0 2024-08-17T02:29:13.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.066+0000 7fecddffb700 1 -- 172.21.15.153:0/2949980895 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece4011710 con 0x7fece8068db0 2024-08-17T02:29:13.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.066+0000 7fecf00fc700 1 -- 172.21.15.153:0/2949980895 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece815b130 con 0x7fece8068db0 2024-08-17T02:29:13.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.066+0000 7fecddffb700 1 -- 172.21.15.153:0/2949980895 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece4011ad0 con 0x7fece8068db0 2024-08-17T02:29:13.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.066+0000 7fecf00fc700 1 -- 172.21.15.153:0/2949980895 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece815b9d0 con 0x7fece8068db0 2024-08-17T02:29:13.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.066+0000 7fecf00fc700 1 -- 172.21.15.153:0/2949980895 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fece815b520 con 0x7fece8068db0 2024-08-17T02:29:13.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.070+0000 7fecddffb700 1 -- 172.21.15.153:0/2949980895 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fece401b3b0 con 0x7fece8068db0 2024-08-17T02:29:13.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.070+0000 7fecddffb700 1 --2- 172.21.15.153:0/2949980895 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7feccc060860 0x7feccc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.070+0000 7fecddffb700 1 -- 172.21.15.153:0/2949980895 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fece407c2e0 con 0x7fece8068db0 2024-08-17T02:29:13.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.070+0000 7feced697700 1 --2- 172.21.15.153:0/2949980895 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7feccc060860 0x7feccc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.070+0000 7feced697700 1 --2- 172.21.15.153:0/2949980895 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7feccc060860 0x7feccc062d10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fece80637d0 tx=0x7fecd8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:13.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.082+0000 7fecddffb700 1 -- 172.21.15.153:0/2949980895 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fece404c3b0 con 0x7fece8068db0 2024-08-17T02:29:13.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.246+0000 7fecf00fc700 1 -- 172.21.15.153:0/2949980895 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fece80645c0 con 0x7fece8068db0 2024-08-17T02:29:13.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.246+0000 7fecddffb700 1 -- 172.21.15.153:0/2949980895 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7fece4017020 con 0x7fece8068db0 2024-08-17T02:29:13.250 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2024-08-17T02:29:13.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.250+0000 7fecf00fc700 1 -- 172.21.15.153:0/2949980895 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7feccc060860 msgr2=0x7feccc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.250+0000 7fecf00fc700 1 --2- 172.21.15.153:0/2949980895 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7feccc060860 0x7feccc062d10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fece80637d0 tx=0x7fecd8009040 comp rx=0 tx=0).stop 2024-08-17T02:29:13.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.250+0000 7fecf00fc700 1 -- 172.21.15.153:0/2949980895 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fece8068db0 msgr2=0x7fece80ae840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.250+0000 7fecf00fc700 1 --2- 172.21.15.153:0/2949980895 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fece8068db0 0x7fece80ae840 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fece400c5c0 tx=0x7fece4007ec0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.250+0000 7fecf00fc700 1 -- 172.21.15.153:0/2949980895 shutdown_connections 2024-08-17T02:29:13.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.250+0000 7fecf00fc700 1 --2- 172.21.15.153:0/2949980895 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7feccc060860 0x7feccc062d10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.250+0000 7fecf00fc700 1 --2- 172.21.15.153:0/2949980895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fece8159380 0x7fece815a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.250+0000 7fecf00fc700 1 --2- 172.21.15.153:0/2949980895 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fece8158fb0 0x7fece80aa4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.250+0000 7fecf00fc700 1 --2- 172.21.15.153:0/2949980895 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fece8068db0 0x7fece80ae840 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.250+0000 7fecf00fc700 1 -- 172.21.15.153:0/2949980895 >> 172.21.15.153:0/2949980895 conn(0x7fece80c9bf0 msgr2=0x7fece80af640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:13.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.250+0000 7fecf00fc700 1 -- 172.21.15.153:0/2949980895 shutdown_connections 2024-08-17T02:29:13.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.250+0000 7fecf00fc700 1 -- 172.21.15.153:0/2949980895 wait complete. 2024-08-17T02:29:13.270 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:29:13.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.382+0000 7f8c988b3700 1 Processor -- start 2024-08-17T02:29:13.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.382+0000 7f8c988b3700 1 -- start start 2024-08-17T02:29:13.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.382+0000 7f8c988b3700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8c941590b0 0x7f8c94066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.382+0000 7f8c988b3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8c94159480 0x7f8c94067340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.382+0000 7f8c988b3700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c940ce210 con 0x7f8c940cd2b0 2024-08-17T02:29:13.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.382+0000 7f8c988b3700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c940cba00 con 0x7f8c941590b0 2024-08-17T02:29:13.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.382+0000 7f8c988b3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c940cdc90 con 0x7f8c94159480 2024-08-17T02:29:13.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.382+0000 7f8c92d9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8c941590b0 0x7f8c94066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.382+0000 7f8c9359e700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f8c940cd2b0 0x7f8c9415ce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35444/0 (socket says 172.21.15.153:35444) 2024-08-17T02:29:13.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.382+0000 7f8c9359e700 1 -- 172.21.15.153:0/2929946409 learned_addr learned my addr 172.21.15.153:0/2929946409 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:29:13.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.382+0000 7f8c8bfff700 1 --2- 172.21.15.153:0/2929946409 >> v2:172.21.15.174:3300/0 conn(0x7f8c94159480 0x7f8c94067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.382+0000 7f8c9259c700 1 -- 172.21.15.153:0/2929946409 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2114509669 0 0) 0x7f8c940ce210 con 0x7f8c940cd2b0 2024-08-17T02:29:13.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.382+0000 7f8c9259c700 1 -- 172.21.15.153:0/2929946409 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c80003570 con 0x7f8c940cd2b0 2024-08-17T02:29:13.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.382+0000 7f8c92d9d700 1 -- 172.21.15.153:0/2929946409 >> v2:172.21.15.174:3300/0 conn(0x7f8c94159480 msgr2=0x7f8c94067340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:13.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.382+0000 7f8c92d9d700 1 --2- 172.21.15.153:0/2929946409 >> v2:172.21.15.174:3300/0 conn(0x7f8c94159480 0x7f8c94067340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.382+0000 7f8c92d9d700 1 -- 172.21.15.153:0/2929946409 >> v1:172.21.15.153:6789/0 conn(0x7f8c940cd2b0 legacy=0x7f8c9415ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.382+0000 7f8c92d9d700 1 -- 172.21.15.153:0/2929946409 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c940cb440 con 0x7f8c941590b0 2024-08-17T02:29:13.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.382+0000 7f8c92d9d700 1 --2- 172.21.15.153:0/2929946409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c941590b0 0x7f8c94066e00 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8c94067c20 tx=0x7f8c7c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b791ae981c77096c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:13.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.382+0000 7f8c9259c700 1 -- 172.21.15.153:0/2929946409 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c011630 con 0x7f8c941590b0 2024-08-17T02:29:13.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.382+0000 7f8c9259c700 1 -- 172.21.15.153:0/2929946409 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c7c0117b0 con 0x7f8c941590b0 2024-08-17T02:29:13.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.382+0000 7f8c9259c700 1 -- 172.21.15.153:0/2929946409 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c011b70 con 0x7f8c941590b0 2024-08-17T02:29:13.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.386+0000 7f8c988b3700 1 -- 172.21.15.153:0/2929946409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c941590b0 msgr2=0x7f8c94066e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.386+0000 7f8c988b3700 1 --2- 172.21.15.153:0/2929946409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c941590b0 0x7f8c94066e00 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8c94067c20 tx=0x7f8c7c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.386+0000 7f8c988b3700 1 -- 172.21.15.153:0/2929946409 shutdown_connections 2024-08-17T02:29:13.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.386+0000 7f8c988b3700 1 --2- 172.21.15.153:0/2929946409 >> v2:172.21.15.174:3300/0 conn(0x7f8c94159480 0x7f8c94067340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.386+0000 7f8c988b3700 1 --2- 172.21.15.153:0/2929946409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c941590b0 0x7f8c94066e00 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.386+0000 7f8c988b3700 1 -- 172.21.15.153:0/2929946409 >> 172.21.15.153:0/2929946409 conn(0x7f8c940d0b90 msgr2=0x7f8c940ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:13.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.386+0000 7f8c988b3700 1 -- 172.21.15.153:0/2929946409 shutdown_connections 2024-08-17T02:29:13.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.386+0000 7f8c988b3700 1 -- 172.21.15.153:0/2929946409 wait complete. 2024-08-17T02:29:13.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.386+0000 7f8c988b3700 1 Processor -- start 2024-08-17T02:29:13.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.386+0000 7f8c988b3700 1 -- start start 2024-08-17T02:29:13.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.390+0000 7f8c988b3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c940cd2b0 0x7f8c9416a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.390+0000 7f8c988b3700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c941590b0 0x7f8c94155f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.390+0000 7f8c988b3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c94159480 0x7f8c94156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.390+0000 7f8c988b3700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c940c8060 con 0x7f8c940cd2b0 2024-08-17T02:29:13.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.390+0000 7f8c988b3700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9416ac70 con 0x7f8c941590b0 2024-08-17T02:29:13.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.390+0000 7f8c988b3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9416a320 con 0x7f8c94159480 2024-08-17T02:29:13.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.390+0000 7f8c92d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c940cd2b0 0x7f8c9416a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.390+0000 7f8c92d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c940cd2b0 0x7f8c9416a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52406/0 (socket says 172.21.15.153:52406) 2024-08-17T02:29:13.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.390+0000 7f8c92d9d700 1 -- 172.21.15.153:0/3882974915 learned_addr learned my addr 172.21.15.153:0/3882974915 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:13.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.390+0000 7f8c8bfff700 1 --2- 172.21.15.153:0/3882974915 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c941590b0 0x7f8c94155f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.390+0000 7f8c9359e700 1 --2- 172.21.15.153:0/3882974915 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c94159480 0x7f8c94156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.390+0000 7f8c92d9d700 1 -- 172.21.15.153:0/3882974915 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c94159480 msgr2=0x7f8c94156cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.390+0000 7f8c92d9d700 1 --2- 172.21.15.153:0/3882974915 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c94159480 0x7f8c94156cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.390+0000 7f8c92d9d700 1 -- 172.21.15.153:0/3882974915 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c941590b0 msgr2=0x7f8c94155f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.390+0000 7f8c92d9d700 1 --2- 172.21.15.153:0/3882974915 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c941590b0 0x7f8c94155f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.390+0000 7f8c92d9d700 1 -- 172.21.15.153:0/3882974915 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c7c009420 con 0x7f8c940cd2b0 2024-08-17T02:29:13.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.390+0000 7f8c8bfff700 1 --2- 172.21.15.153:0/3882974915 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c941590b0 0x7f8c94155f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:13.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.390+0000 7f8c92d9d700 1 --2- 172.21.15.153:0/3882974915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c940cd2b0 0x7f8c9416a730 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8c94069480 tx=0x7f8c7c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:13.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.390+0000 7f8c8affd700 1 -- 172.21.15.153:0/3882974915 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c011b30 con 0x7f8c940cd2b0 2024-08-17T02:29:13.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.390+0000 7f8c8affd700 1 -- 172.21.15.153:0/3882974915 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c7c01a430 con 0x7f8c940cd2b0 2024-08-17T02:29:13.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.390+0000 7f8c988b3700 1 -- 172.21.15.153:0/3882974915 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c940c7a10 con 0x7f8c940cd2b0 2024-08-17T02:29:13.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.390+0000 7f8c8affd700 1 -- 172.21.15.153:0/3882974915 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c01a7d0 con 0x7f8c940cd2b0 2024-08-17T02:29:13.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.390+0000 7f8c988b3700 1 -- 172.21.15.153:0/3882974915 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c94156490 con 0x7f8c940cd2b0 2024-08-17T02:29:13.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.390+0000 7f8c988b3700 1 -- 172.21.15.153:0/3882974915 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c940c7e90 con 0x7f8c940cd2b0 2024-08-17T02:29:13.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.394+0000 7f8c8affd700 1 -- 172.21.15.153:0/3882974915 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8c7c01ab40 con 0x7f8c940cd2b0 2024-08-17T02:29:13.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.394+0000 7f8c8affd700 1 --2- 172.21.15.153:0/3882974915 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8c74060860 0x7f8c74062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.394+0000 7f8c8affd700 1 -- 172.21.15.153:0/3882974915 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f8c7c07ea90 con 0x7f8c940cd2b0 2024-08-17T02:29:13.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.394+0000 7f8c8bfff700 1 --2- 172.21.15.153:0/3882974915 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8c74060860 0x7f8c74062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.394+0000 7f8c8bfff700 1 --2- 172.21.15.153:0/3882974915 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8c74060860 0x7f8c74062d10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8c94067fd0 tx=0x7f8c84008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:13.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.402+0000 7f8c8affd700 1 -- 172.21.15.153:0/3882974915 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f8c7c04eb60 con 0x7f8c940cd2b0 2024-08-17T02:29:13.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.562+0000 7f8c988b3700 1 -- 172.21.15.153:0/3882974915 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8c94064330 con 0x7f8c940cd2b0 2024-08-17T02:29:13.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.562+0000 7f8c8affd700 1 -- 172.21.15.153:0/3882974915 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8c7c0150a0 con 0x7f8c940cd2b0 2024-08-17T02:29:13.566 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2024-08-17T02:29:13.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.566+0000 7f8c988b3700 1 -- 172.21.15.153:0/3882974915 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8c74060860 msgr2=0x7f8c74062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.566+0000 7f8c988b3700 1 --2- 172.21.15.153:0/3882974915 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8c74060860 0x7f8c74062d10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8c94067fd0 tx=0x7f8c84008040 comp rx=0 tx=0).stop 2024-08-17T02:29:13.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.566+0000 7f8c988b3700 1 -- 172.21.15.153:0/3882974915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c940cd2b0 msgr2=0x7f8c9416a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.566+0000 7f8c988b3700 1 --2- 172.21.15.153:0/3882974915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c940cd2b0 0x7f8c9416a730 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8c94069480 tx=0x7f8c7c017000 comp rx=0 tx=0).stop 2024-08-17T02:29:13.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.566+0000 7f8c988b3700 1 -- 172.21.15.153:0/3882974915 shutdown_connections 2024-08-17T02:29:13.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.566+0000 7f8c988b3700 1 --2- 172.21.15.153:0/3882974915 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8c74060860 0x7f8c74062d10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.566+0000 7f8c988b3700 1 --2- 172.21.15.153:0/3882974915 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c94159480 0x7f8c94156cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.566+0000 7f8c988b3700 1 --2- 172.21.15.153:0/3882974915 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c941590b0 0x7f8c94155f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.566+0000 7f8c988b3700 1 --2- 172.21.15.153:0/3882974915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c940cd2b0 0x7f8c9416a730 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.566+0000 7f8c988b3700 1 -- 172.21.15.153:0/3882974915 >> 172.21.15.153:0/3882974915 conn(0x7f8c940d0b90 msgr2=0x7f8c940c6810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:13.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.566+0000 7f8c988b3700 1 -- 172.21.15.153:0/3882974915 shutdown_connections 2024-08-17T02:29:13.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.566+0000 7f8c988b3700 1 -- 172.21.15.153:0/3882974915 wait complete. 2024-08-17T02:29:13.585 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000118573.meta pg_num 2024-08-17T02:29:13.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.694+0000 7ff3c6ce7700 1 Processor -- start 2024-08-17T02:29:13.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.694+0000 7ff3c6ce7700 1 -- start start 2024-08-17T02:29:13.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.694+0000 7ff3c6ce7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff3c00b0390 0x7ff3c00cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.694+0000 7ff3c6ce7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff3c015d950 0x7ff3c00c2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.694+0000 7ff3c6ce7700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3c00cc350 con 0x7ff3c015cda0 2024-08-17T02:29:13.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.694+0000 7ff3c6ce7700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3c00ca760 con 0x7ff3c00b0390 2024-08-17T02:29:13.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.694+0000 7ff3c6ce7700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3c00cd3f0 con 0x7ff3c015d950 2024-08-17T02:29:13.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.694+0000 7ff3c5ce5700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff3c00b0390 0x7ff3c00cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.694+0000 7ff3c5ce5700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff3c00b0390 0x7ff3c00cbcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52422/0 (socket says 172.21.15.153:52422) 2024-08-17T02:29:13.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.694+0000 7ff3c5ce5700 1 -- 172.21.15.153:0/2499333809 learned_addr learned my addr 172.21.15.153:0/2499333809 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:13.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.694+0000 7ff3c54e4700 1 --1- 172.21.15.153:0/2499333809 >> v1:172.21.15.153:6789/0 conn(0x7ff3c015cda0 0x7ff3c015d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35456/0 (socket says 172.21.15.153:35456) 2024-08-17T02:29:13.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.694+0000 7ff3c64e6700 1 --2- 172.21.15.153:0/2499333809 >> v2:172.21.15.174:3300/0 conn(0x7ff3c015d950 0x7ff3c00c2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.694+0000 7ff3c5ce5700 1 -- 172.21.15.153:0/2499333809 >> v2:172.21.15.174:3300/0 conn(0x7ff3c015d950 msgr2=0x7ff3c00c2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:13.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.694+0000 7ff3c5ce5700 1 --2- 172.21.15.153:0/2499333809 >> v2:172.21.15.174:3300/0 conn(0x7ff3c015d950 0x7ff3c00c2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.694+0000 7ff3c5ce5700 1 -- 172.21.15.153:0/2499333809 >> v1:172.21.15.153:6789/0 conn(0x7ff3c015cda0 legacy=0x7ff3c015d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.694+0000 7ff3c5ce5700 1 -- 172.21.15.153:0/2499333809 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c00cc630 con 0x7ff3c00b0390 2024-08-17T02:29:13.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.698+0000 7ff3c5ce5700 1 --2- 172.21.15.153:0/2499333809 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3c00b0390 0x7ff3c00cbcc0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff3c00ceff0 tx=0x7ff3bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba32bc1cc8f00391 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:13.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.698+0000 7ff3c4ce3700 1 -- 172.21.15.153:0/2499333809 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc00b860 con 0x7ff3c00b0390 2024-08-17T02:29:13.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.698+0000 7ff3c4ce3700 1 -- 172.21.15.153:0/2499333809 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3bc00b9c0 con 0x7ff3c00b0390 2024-08-17T02:29:13.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.698+0000 7ff3c4ce3700 1 -- 172.21.15.153:0/2499333809 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc00bd60 con 0x7ff3c00b0390 2024-08-17T02:29:13.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.698+0000 7ff3c6ce7700 1 -- 172.21.15.153:0/2499333809 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3c00b0390 msgr2=0x7ff3c00cbcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.698+0000 7ff3c6ce7700 1 --2- 172.21.15.153:0/2499333809 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3c00b0390 0x7ff3c00cbcc0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff3c00ceff0 tx=0x7ff3bc009250 comp rx=0 tx=0).stop 2024-08-17T02:29:13.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.698+0000 7ff3c6ce7700 1 -- 172.21.15.153:0/2499333809 shutdown_connections 2024-08-17T02:29:13.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.698+0000 7ff3c6ce7700 1 --2- 172.21.15.153:0/2499333809 >> v2:172.21.15.174:3300/0 conn(0x7ff3c015d950 0x7ff3c00c2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.698+0000 7ff3c6ce7700 1 --2- 172.21.15.153:0/2499333809 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3c00b0390 0x7ff3c00cbcc0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.698+0000 7ff3c6ce7700 1 -- 172.21.15.153:0/2499333809 >> 172.21.15.153:0/2499333809 conn(0x7ff3c00cdee0 msgr2=0x7ff3c00ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:13.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.698+0000 7ff3c6ce7700 1 -- 172.21.15.153:0/2499333809 shutdown_connections 2024-08-17T02:29:13.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.698+0000 7ff3c6ce7700 1 -- 172.21.15.153:0/2499333809 wait complete. 2024-08-17T02:29:13.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.698+0000 7ff3c6ce7700 1 Processor -- start 2024-08-17T02:29:13.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.698+0000 7ff3c6ce7700 1 -- start start 2024-08-17T02:29:13.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.698+0000 7ff3c6ce7700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3c00b0390 0x7ff3c0154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.698+0000 7ff3c6ce7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3c015cda0 0x7ff3c0153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.698+0000 7ff3c6ce7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff3c015d950 0x7ff3c00c6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.698+0000 7ff3c6ce7700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c00b1d10 con 0x7ff3c015cda0 2024-08-17T02:29:13.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.698+0000 7ff3c6ce7700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c01699d0 con 0x7ff3c00b0390 2024-08-17T02:29:13.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.698+0000 7ff3c6ce7700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c0169cb0 con 0x7ff3c015d950 2024-08-17T02:29:13.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.698+0000 7ff3c54e4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3c015cda0 0x7ff3c0153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.702+0000 7ff3c54e4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3c015cda0 0x7ff3c0153fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52430/0 (socket says 172.21.15.153:52430) 2024-08-17T02:29:13.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.702+0000 7ff3c54e4700 1 -- 172.21.15.153:0/3673756323 learned_addr learned my addr 172.21.15.153:0/3673756323 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:13.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.702+0000 7ff3c5ce5700 1 --2- 172.21.15.153:0/3673756323 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3c00b0390 0x7ff3c0154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.702+0000 7ff3c64e6700 1 --2- 172.21.15.153:0/3673756323 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff3c015d950 0x7ff3c00c6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.702+0000 7ff3c54e4700 1 -- 172.21.15.153:0/3673756323 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff3c015d950 msgr2=0x7ff3c00c6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.702+0000 7ff3c54e4700 1 --2- 172.21.15.153:0/3673756323 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff3c015d950 0x7ff3c00c6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.702+0000 7ff3c54e4700 1 -- 172.21.15.153:0/3673756323 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3c00b0390 msgr2=0x7ff3c0154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.702+0000 7ff3c54e4700 1 --2- 172.21.15.153:0/3673756323 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3c00b0390 0x7ff3c0154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.702+0000 7ff3c54e4700 1 -- 172.21.15.153:0/3673756323 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3bc0094f0 con 0x7ff3c015cda0 2024-08-17T02:29:13.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.702+0000 7ff3c54e4700 1 --2- 172.21.15.153:0/3673756323 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3c015cda0 0x7ff3c0153fa0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff3b000c7c0 tx=0x7ff3b0007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:13.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.702+0000 7ff3b5ffb700 1 -- 172.21.15.153:0/3673756323 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b0005a70 con 0x7ff3c015cda0 2024-08-17T02:29:13.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.702+0000 7ff3b5ffb700 1 -- 172.21.15.153:0/3673756323 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b0005bd0 con 0x7ff3c015cda0 2024-08-17T02:29:13.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.702+0000 7ff3b5ffb700 1 -- 172.21.15.153:0/3673756323 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b00070d0 con 0x7ff3c015cda0 2024-08-17T02:29:13.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.702+0000 7ff3c6ce7700 1 -- 172.21.15.153:0/3673756323 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3c0169f90 con 0x7ff3c015cda0 2024-08-17T02:29:13.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.702+0000 7ff3c6ce7700 1 -- 172.21.15.153:0/3673756323 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3c016a270 con 0x7ff3c015cda0 2024-08-17T02:29:13.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.702+0000 7ff3c6ce7700 1 -- 172.21.15.153:0/3673756323 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3c00b1e80 con 0x7ff3c015cda0 2024-08-17T02:29:13.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.706+0000 7ff3b5ffb700 1 -- 172.21.15.153:0/3673756323 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff3b0007440 con 0x7ff3c015cda0 2024-08-17T02:29:13.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.706+0000 7ff3b5ffb700 1 --2- 172.21.15.153:0/3673756323 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff3a4060860 0x7ff3a4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.706+0000 7ff3c5ce5700 1 --2- 172.21.15.153:0/3673756323 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff3a4060860 0x7ff3a4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.706+0000 7ff3b5ffb700 1 -- 172.21.15.153:0/3673756323 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7ff3b007c3d0 con 0x7ff3c015cda0 2024-08-17T02:29:13.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.706+0000 7ff3c5ce5700 1 --2- 172.21.15.153:0/3673756323 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff3a4060860 0x7ff3a4062d10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff3c00ceff0 tx=0x7ff3bc017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:13.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.710+0000 7ff3b5ffb700 1 -- 172.21.15.153:0/3673756323 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff3b004c400 con 0x7ff3c015cda0 2024-08-17T02:29:13.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.874+0000 7ff3c6ce7700 1 -- 172.21.15.153:0/3673756323 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000118573.meta", "var": "pg_num"} v 0) v1 -- 0x7ff3c00638f0 con 0x7ff3c015cda0 2024-08-17T02:29:13.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.874+0000 7ff3b5ffb700 1 -- 172.21.15.153:0/3673756323 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000118573.meta", "var": "pg_num"}]=0 v37) v1 ==== 124+0+11 (secure 0 0 0) 0x7ff3b004fa20 con 0x7ff3c015cda0 2024-08-17T02:29:13.878 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2024-08-17T02:29:13.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.878+0000 7ff3c6ce7700 1 -- 172.21.15.153:0/3673756323 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff3a4060860 msgr2=0x7ff3a4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.878+0000 7ff3c6ce7700 1 --2- 172.21.15.153:0/3673756323 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff3a4060860 0x7ff3a4062d10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff3c00ceff0 tx=0x7ff3bc017000 comp rx=0 tx=0).stop 2024-08-17T02:29:13.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.878+0000 7ff3c6ce7700 1 -- 172.21.15.153:0/3673756323 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3c015cda0 msgr2=0x7ff3c0153fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.878+0000 7ff3c6ce7700 1 --2- 172.21.15.153:0/3673756323 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3c015cda0 0x7ff3c0153fa0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff3b000c7c0 tx=0x7ff3b0007f30 comp rx=0 tx=0).stop 2024-08-17T02:29:13.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.878+0000 7ff3c6ce7700 1 -- 172.21.15.153:0/3673756323 shutdown_connections 2024-08-17T02:29:13.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.878+0000 7ff3c6ce7700 1 --2- 172.21.15.153:0/3673756323 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff3a4060860 0x7ff3a4062d10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.878+0000 7ff3c6ce7700 1 --2- 172.21.15.153:0/3673756323 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff3c015d950 0x7ff3c00c6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.878+0000 7ff3c6ce7700 1 --2- 172.21.15.153:0/3673756323 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3c015cda0 0x7ff3c0153fa0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.878+0000 7ff3c6ce7700 1 --2- 172.21.15.153:0/3673756323 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3c00b0390 0x7ff3c0154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.878+0000 7ff3c6ce7700 1 -- 172.21.15.153:0/3673756323 >> 172.21.15.153:0/3673756323 conn(0x7ff3c00cdee0 msgr2=0x7ff3c00c85c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:13.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.878+0000 7ff3c6ce7700 1 -- 172.21.15.153:0/3673756323 shutdown_connections 2024-08-17T02:29:13.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:13.878+0000 7ff3c6ce7700 1 -- 172.21.15.153:0/3673756323 wait complete. 2024-08-17T02:29:13.892 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000118573.data pg_num 2024-08-17T02:29:14.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.006+0000 7f3efd49d700 1 Processor -- start 2024-08-17T02:29:14.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.006+0000 7f3efd49d700 1 -- start start 2024-08-17T02:29:14.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.006+0000 7f3efd49d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3ef8067510 0x7f3ef80ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.006+0000 7f3efd49d700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef80ce210 con 0x7f3ef8159480 2024-08-17T02:29:14.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.006+0000 7f3efd49d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef80cb440 con 0x7f3ef81590b0 2024-08-17T02:29:14.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.006+0000 7f3efd49d700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef80cba00 con 0x7f3ef8067510 2024-08-17T02:29:14.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.010+0000 7f3ef77fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3ef8067510 0x7f3ef80ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.010+0000 7f3efcc9c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f3ef8159480 0x7f3ef80cebe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35464/0 (socket says 172.21.15.153:35464) 2024-08-17T02:29:14.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.010+0000 7f3efcc9c700 1 -- 172.21.15.153:0/341500297 learned_addr learned my addr 172.21.15.153:0/341500297 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:29:14.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.010+0000 7f3ef77fe700 1 -- 172.21.15.153:0/341500297 >> v1:172.21.15.174:6789/0 conn(0x7f3ef81590b0 legacy=0x7f3ef8066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.010+0000 7f3ef77fe700 1 -- 172.21.15.153:0/341500297 >> v1:172.21.15.153:6789/0 conn(0x7f3ef8159480 legacy=0x7f3ef80cebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.010+0000 7f3ef77fe700 1 -- 172.21.15.153:0/341500297 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef80cb720 con 0x7f3ef8067510 2024-08-17T02:29:14.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.010+0000 7f3ef77fe700 1 --2- 172.21.15.153:0/341500297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ef8067510 0x7f3ef80ce6a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3eec0098e0 tx=0x7f3eec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=830e959858c657e9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:14.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.010+0000 7f3ef6ffd700 1 -- 172.21.15.153:0/341500297 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec009e80 con 0x7f3ef8067510 2024-08-17T02:29:14.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.010+0000 7f3ef6ffd700 1 -- 172.21.15.153:0/341500297 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eec00b860 con 0x7f3ef8067510 2024-08-17T02:29:14.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.010+0000 7f3ef6ffd700 1 -- 172.21.15.153:0/341500297 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec00bbe0 con 0x7f3ef8067510 2024-08-17T02:29:14.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.010+0000 7f3efd49d700 1 -- 172.21.15.153:0/341500297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ef8067510 msgr2=0x7f3ef80ce6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.010+0000 7f3efd49d700 1 --2- 172.21.15.153:0/341500297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ef8067510 0x7f3ef80ce6a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3eec0098e0 tx=0x7f3eec0091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.010+0000 7f3efd49d700 1 -- 172.21.15.153:0/341500297 shutdown_connections 2024-08-17T02:29:14.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.010+0000 7f3efd49d700 1 --2- 172.21.15.153:0/341500297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ef8067510 0x7f3ef80ce6a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.010+0000 7f3efd49d700 1 -- 172.21.15.153:0/341500297 >> 172.21.15.153:0/341500297 conn(0x7f3ef80d0b90 msgr2=0x7f3ef80ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:14.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.010+0000 7f3efd49d700 1 -- 172.21.15.153:0/341500297 shutdown_connections 2024-08-17T02:29:14.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.010+0000 7f3efd49d700 1 -- 172.21.15.153:0/341500297 wait complete. 2024-08-17T02:29:14.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.014+0000 7f3efd49d700 1 Processor -- start 2024-08-17T02:29:14.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.014+0000 7f3efd49d700 1 -- start start 2024-08-17T02:29:14.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.014+0000 7f3efd49d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ef8067510 0x7f3ef80b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.014+0000 7f3efd49d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ef81590b0 0x7f3ef80c6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.014+0000 7f3efd49d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ef8159480 0x7f3ef80c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.014+0000 7f3efd49d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef80b3af0 con 0x7f3ef8159480 2024-08-17T02:29:14.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.014+0000 7f3efd49d700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef80b3dd0 con 0x7f3ef81590b0 2024-08-17T02:29:14.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.014+0000 7f3efd49d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef80b40b0 con 0x7f3ef8067510 2024-08-17T02:29:14.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.014+0000 7f3efcc9c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ef8159480 0x7f3ef80c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.014+0000 7f3efcc9c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ef8159480 0x7f3ef80c7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52444/0 (socket says 172.21.15.153:52444) 2024-08-17T02:29:14.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.014+0000 7f3efcc9c700 1 -- 172.21.15.153:0/882084510 learned_addr learned my addr 172.21.15.153:0/882084510 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:14.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.014+0000 7f3ef77fe700 1 --2- 172.21.15.153:0/882084510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ef81590b0 0x7f3ef80c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.014+0000 7f3ef7fff700 1 --2- 172.21.15.153:0/882084510 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ef8067510 0x7f3ef80b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.018+0000 7f3efcc9c700 1 -- 172.21.15.153:0/882084510 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ef8067510 msgr2=0x7f3ef80b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.018+0000 7f3efcc9c700 1 --2- 172.21.15.153:0/882084510 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ef8067510 0x7f3ef80b4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.018+0000 7f3efcc9c700 1 -- 172.21.15.153:0/882084510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ef81590b0 msgr2=0x7f3ef80c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.018+0000 7f3efcc9c700 1 --2- 172.21.15.153:0/882084510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ef81590b0 0x7f3ef80c6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.018+0000 7f3efcc9c700 1 -- 172.21.15.153:0/882084510 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eec009420 con 0x7f3ef8159480 2024-08-17T02:29:14.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.018+0000 7f3ef7fff700 1 --2- 172.21.15.153:0/882084510 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ef8067510 0x7f3ef80b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:14.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.018+0000 7f3efcc9c700 1 --2- 172.21.15.153:0/882084510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ef8159480 0x7f3ef80c7b30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3ef000cbc0 tx=0x7f3ef00019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:14.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.018+0000 7f3edffff700 1 -- 172.21.15.153:0/882084510 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef000a890 con 0x7f3ef8159480 2024-08-17T02:29:14.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.018+0000 7f3edffff700 1 -- 172.21.15.153:0/882084510 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef000a9f0 con 0x7f3ef8159480 2024-08-17T02:29:14.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.018+0000 7f3efd49d700 1 -- 172.21.15.153:0/882084510 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef80b4390 con 0x7f3ef8159480 2024-08-17T02:29:14.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.018+0000 7f3edffff700 1 -- 172.21.15.153:0/882084510 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef000ad70 con 0x7f3ef8159480 2024-08-17T02:29:14.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.018+0000 7f3efd49d700 1 -- 172.21.15.153:0/882084510 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef80b50d0 con 0x7f3ef8159480 2024-08-17T02:29:14.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.018+0000 7f3efd49d700 1 -- 172.21.15.153:0/882084510 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ef8064330 con 0x7f3ef8159480 2024-08-17T02:29:14.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.018+0000 7f3edffff700 1 -- 172.21.15.153:0/882084510 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f3ef0007300 con 0x7f3ef8159480 2024-08-17T02:29:14.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.018+0000 7f3edffff700 1 --2- 172.21.15.153:0/882084510 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3ee4060860 0x7f3ee4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.022+0000 7f3edffff700 1 -- 172.21.15.153:0/882084510 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f3ef007d2f0 con 0x7f3ef8159480 2024-08-17T02:29:14.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.022+0000 7f3ef7fff700 1 --2- 172.21.15.153:0/882084510 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3ee4060860 0x7f3ee4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.022+0000 7f3ef7fff700 1 --2- 172.21.15.153:0/882084510 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3ee4060860 0x7f3ee4062d10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8007fd0 tx=0x7f3ee8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:14.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.030+0000 7f3edffff700 1 -- 172.21.15.153:0/882084510 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f3ef004d3c0 con 0x7f3ef8159480 2024-08-17T02:29:14.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.194+0000 7f3efd49d700 1 -- 172.21.15.153:0/882084510 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000118573.data", "var": "pg_num"} v 0) v1 -- 0x7f3ef8070cf0 con 0x7f3ef8159480 2024-08-17T02:29:14.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.194+0000 7f3edffff700 1 -- 172.21.15.153:0/882084510 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000118573.data", "var": "pg_num"}]=0 v37) v1 ==== 124+0+11 (secure 0 0 0) 0x7f3ef00509e0 con 0x7f3ef8159480 2024-08-17T02:29:14.197 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2024-08-17T02:29:14.200 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.198+0000 7f3efd49d700 1 -- 172.21.15.153:0/882084510 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3ee4060860 msgr2=0x7f3ee4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.200 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.198+0000 7f3efd49d700 1 --2- 172.21.15.153:0/882084510 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3ee4060860 0x7f3ee4062d10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8007fd0 tx=0x7f3ee8009040 comp rx=0 tx=0).stop 2024-08-17T02:29:14.200 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.198+0000 7f3efd49d700 1 -- 172.21.15.153:0/882084510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ef8159480 msgr2=0x7f3ef80c7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.200 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.198+0000 7f3efd49d700 1 --2- 172.21.15.153:0/882084510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ef8159480 0x7f3ef80c7b30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3ef000cbc0 tx=0x7f3ef00019c0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.200 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.198+0000 7f3efd49d700 1 -- 172.21.15.153:0/882084510 shutdown_connections 2024-08-17T02:29:14.200 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.198+0000 7f3efd49d700 1 --2- 172.21.15.153:0/882084510 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f3ee4060860 0x7f3ee4062d10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.198+0000 7f3efd49d700 1 --2- 172.21.15.153:0/882084510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ef8159480 0x7f3ef80c7b30 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.198+0000 7f3efd49d700 1 --2- 172.21.15.153:0/882084510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ef81590b0 0x7f3ef80c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.198+0000 7f3efd49d700 1 --2- 172.21.15.153:0/882084510 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ef8067510 0x7f3ef80b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.198+0000 7f3efd49d700 1 -- 172.21.15.153:0/882084510 >> 172.21.15.153:0/882084510 conn(0x7f3ef80d0b90 msgr2=0x7f3ef815bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:14.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.198+0000 7f3efd49d700 1 -- 172.21.15.153:0/882084510 shutdown_connections 2024-08-17T02:29:14.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.198+0000 7f3efd49d700 1 -- 172.21.15.153:0/882084510 wait complete. 2024-08-17T02:29:14.211 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:14.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.314+0000 7f9df2b24700 1 Processor -- start 2024-08-17T02:29:14.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.314+0000 7f9df2b24700 1 -- start start 2024-08-17T02:29:14.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.314+0000 7f9df2b24700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9dec15d540 0x7f9dec0af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.314+0000 7f9df2b24700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dec0b0270 con 0x7f9dec0a9430 2024-08-17T02:29:14.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.314+0000 7f9df2b24700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dec0af660 con 0x7f9dec06e830 2024-08-17T02:29:14.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.314+0000 7f9df2b24700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec0af940 con 0x7f9dec15d540 2024-08-17T02:29:14.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.314+0000 7f9df10c1700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f9dec0a9430 0x7f9dec0b0700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35466/0 (socket says 172.21.15.153:35466) 2024-08-17T02:29:14.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.314+0000 7f9df10c1700 1 -- 172.21.15.153:0/2681372725 learned_addr learned my addr 172.21.15.153:0/2681372725 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:29:14.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.314+0000 7f9df08c0700 1 --2- 172.21.15.153:0/2681372725 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9dec15d540 0x7f9dec0af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.314+0000 7f9deb7fe700 1 -- 172.21.15.153:0/2681372725 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 898546969 0 0) 0x7f9dec0b0270 con 0x7f9dec0a9430 2024-08-17T02:29:14.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.314+0000 7f9deb7fe700 1 -- 172.21.15.153:0/2681372725 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dd8003570 con 0x7f9dec0a9430 2024-08-17T02:29:14.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.314+0000 7f9deb7fe700 1 -- 172.21.15.153:0/2681372725 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 997953057 0 0) 0x7f9dec0af660 con 0x7f9dec06e830 2024-08-17T02:29:14.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.314+0000 7f9deb7fe700 1 -- 172.21.15.153:0/2681372725 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dec0b0270 con 0x7f9dec06e830 2024-08-17T02:29:14.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.314+0000 7f9df08c0700 1 -- 172.21.15.153:0/2681372725 >> v1:172.21.15.174:6789/0 conn(0x7f9dec06e830 legacy=0x7f9dec0a8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.314+0000 7f9deb7fe700 1 -- 172.21.15.153:0/2681372725 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 566084797 0 0) 0x7f9dd8003570 con 0x7f9dec0a9430 2024-08-17T02:29:14.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.314+0000 7f9df08c0700 1 -- 172.21.15.153:0/2681372725 >> v1:172.21.15.153:6789/0 conn(0x7f9dec0a9430 legacy=0x7f9dec0b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.314+0000 7f9df08c0700 1 -- 172.21.15.153:0/2681372725 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dec0afc20 con 0x7f9dec15d540 2024-08-17T02:29:14.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.314+0000 7f9df08c0700 1 --2- 172.21.15.153:0/2681372725 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9dec15d540 0x7f9dec0af030 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc009910 tx=0x7f9ddc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db9c007ccf5b8ce3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:14.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.314+0000 7f9deb7fe700 1 -- 172.21.15.153:0/2681372725 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd4001470 con 0x7f9dec15d540 2024-08-17T02:29:14.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.314+0000 7f9deb7fe700 1 -- 172.21.15.153:0/2681372725 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ddc011420 con 0x7f9dec15d540 2024-08-17T02:29:14.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.314+0000 7f9deb7fe700 1 -- 172.21.15.153:0/2681372725 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc0117a0 con 0x7f9dec15d540 2024-08-17T02:29:14.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.314+0000 7f9df2b24700 1 -- 172.21.15.153:0/2681372725 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9dec15d540 msgr2=0x7f9dec0af030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.318+0000 7f9df2b24700 1 --2- 172.21.15.153:0/2681372725 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9dec15d540 0x7f9dec0af030 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc009910 tx=0x7f9ddc0091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.318+0000 7f9df2b24700 1 -- 172.21.15.153:0/2681372725 shutdown_connections 2024-08-17T02:29:14.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.318+0000 7f9df2b24700 1 --2- 172.21.15.153:0/2681372725 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9dec15d540 0x7f9dec0af030 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.318+0000 7f9df2b24700 1 -- 172.21.15.153:0/2681372725 >> 172.21.15.153:0/2681372725 conn(0x7f9dec066e00 msgr2=0x7f9dec067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:14.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.318+0000 7f9df2b24700 1 -- 172.21.15.153:0/2681372725 shutdown_connections 2024-08-17T02:29:14.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.318+0000 7f9df2b24700 1 -- 172.21.15.153:0/2681372725 wait complete. 2024-08-17T02:29:14.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.318+0000 7f9df2b24700 1 Processor -- start 2024-08-17T02:29:14.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.318+0000 7f9df2b24700 1 -- start start 2024-08-17T02:29:14.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.318+0000 7f9df2b24700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9dec06e830 0x7f9dec147800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.318+0000 7f9df2b24700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9dec0a9430 0x7f9dec15bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.318+0000 7f9df2b24700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9dec15d540 0x7f9dec15c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.318+0000 7f9df2b24700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec14b170 con 0x7f9dec15d540 2024-08-17T02:29:14.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.318+0000 7f9df2b24700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec14a0d0 con 0x7f9dec0a9430 2024-08-17T02:29:14.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.318+0000 7f9df2b24700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec14a3b0 con 0x7f9dec06e830 2024-08-17T02:29:14.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.318+0000 7f9df10c1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9dec15d540 0x7f9dec15c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.318+0000 7f9df10c1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9dec15d540 0x7f9dec15c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52460/0 (socket says 172.21.15.153:52460) 2024-08-17T02:29:14.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.318+0000 7f9df10c1700 1 -- 172.21.15.153:0/3676167326 learned_addr learned my addr 172.21.15.153:0/3676167326 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:14.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.318+0000 7f9df08c0700 1 --2- 172.21.15.153:0/3676167326 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9dec06e830 0x7f9dec147800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.318+0000 7f9debfff700 1 --2- 172.21.15.153:0/3676167326 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9dec0a9430 0x7f9dec15bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.318+0000 7f9df10c1700 1 -- 172.21.15.153:0/3676167326 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9dec06e830 msgr2=0x7f9dec147800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.318+0000 7f9df10c1700 1 --2- 172.21.15.153:0/3676167326 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9dec06e830 0x7f9dec147800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.318+0000 7f9df10c1700 1 -- 172.21.15.153:0/3676167326 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9dec0a9430 msgr2=0x7f9dec15bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.318+0000 7f9df10c1700 1 --2- 172.21.15.153:0/3676167326 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9dec0a9430 0x7f9dec15bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.318+0000 7f9df10c1700 1 -- 172.21.15.153:0/3676167326 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ddc009420 con 0x7f9dec15d540 2024-08-17T02:29:14.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.318+0000 7f9debfff700 1 --2- 172.21.15.153:0/3676167326 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9dec0a9430 0x7f9dec15bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:14.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.318+0000 7f9df10c1700 1 --2- 172.21.15.153:0/3676167326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9dec15d540 0x7f9dec15c320 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9dd400cb90 tx=0x7f9dd4001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:14.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.318+0000 7f9de8ff9700 1 -- 172.21.15.153:0/3676167326 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd4007150 con 0x7f9dec15d540 2024-08-17T02:29:14.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.322+0000 7f9de8ff9700 1 -- 172.21.15.153:0/3676167326 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd40072d0 con 0x7f9dec15d540 2024-08-17T02:29:14.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.322+0000 7f9df2b24700 1 -- 172.21.15.153:0/3676167326 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dec14a690 con 0x7f9dec15d540 2024-08-17T02:29:14.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.322+0000 7f9de8ff9700 1 -- 172.21.15.153:0/3676167326 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd4007690 con 0x7f9dec15d540 2024-08-17T02:29:14.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.322+0000 7f9df2b24700 1 -- 172.21.15.153:0/3676167326 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dec14ac50 con 0x7f9dec15d540 2024-08-17T02:29:14.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.322+0000 7f9df2b24700 1 -- 172.21.15.153:0/3676167326 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dec06b130 con 0x7f9dec15d540 2024-08-17T02:29:14.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.322+0000 7f9de8ff9700 1 -- 172.21.15.153:0/3676167326 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9dd4004a40 con 0x7f9dec15d540 2024-08-17T02:29:14.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.322+0000 7f9de8ff9700 1 --2- 172.21.15.153:0/3676167326 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9dcc060860 0x7f9dcc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.322+0000 7f9de8ff9700 1 -- 172.21.15.153:0/3676167326 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f9dd407c610 con 0x7f9dec15d540 2024-08-17T02:29:14.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.322+0000 7f9df08c0700 1 --2- 172.21.15.153:0/3676167326 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9dcc060860 0x7f9dcc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.326+0000 7f9df08c0700 1 --2- 172.21.15.153:0/3676167326 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9dcc060860 0x7f9dcc062d10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc009860 tx=0x7f9ddc016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:14.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.330+0000 7f9de8ff9700 1 -- 172.21.15.153:0/3676167326 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f9dec06b130 con 0x7f9dec15d540 2024-08-17T02:29:14.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.530+0000 7f9df2b24700 1 -- 172.21.15.153:0/3676167326 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9dec06b130 con 0x7f9dec15d540 2024-08-17T02:29:14.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.530+0000 7f9de8ff9700 1 -- 172.21.15.153:0/3676167326 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+5692 (secure 0 0 0) 0x7f9dec06b130 con 0x7f9dec15d540 2024-08-17T02:29:14.534 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:29:14.534 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4885,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/747297575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":747297575},{"type":"v1","addr":"172.21.15.174:6833","nonce":747297575}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4891,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1080524090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1080524090},{"type":"v1","addr":"172.21.15.174:6835","nonce":1080524090}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:55.849257+0000","modified":"2024-08-17T02:26:59.510699+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5031},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5031":{"gid":5031,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6837/2567193475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":2567193475},{"type":"v1","addr":"172.21.15.153:6837","nonce":2567193475}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:09.642872+0000","modified":"2024-08-17T02:27:11.644228+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5013},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5013":{"gid":5013,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":7,"addr":"172.21.15.153:6835/2569513399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2569513399},{"type":"v1","addr":"172.21.15.153:6835","nonce":2569513399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000118573","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:29:14.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.534+0000 7f9df2b24700 1 -- 172.21.15.153:0/3676167326 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9dcc060860 msgr2=0x7f9dcc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.534+0000 7f9df2b24700 1 --2- 172.21.15.153:0/3676167326 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9dcc060860 0x7f9dcc062d10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc009860 tx=0x7f9ddc016000 comp rx=0 tx=0).stop 2024-08-17T02:29:14.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.534+0000 7f9df2b24700 1 -- 172.21.15.153:0/3676167326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9dec15d540 msgr2=0x7f9dec15c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.534+0000 7f9df2b24700 1 --2- 172.21.15.153:0/3676167326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9dec15d540 0x7f9dec15c320 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9dd400cb90 tx=0x7f9dd4001a20 comp rx=0 tx=0).stop 2024-08-17T02:29:14.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.534+0000 7f9df2b24700 1 -- 172.21.15.153:0/3676167326 shutdown_connections 2024-08-17T02:29:14.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.534+0000 7f9df2b24700 1 --2- 172.21.15.153:0/3676167326 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9dcc060860 0x7f9dcc062d10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.534+0000 7f9df2b24700 1 --2- 172.21.15.153:0/3676167326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9dec15d540 0x7f9dec15c320 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.534+0000 7f9df2b24700 1 --2- 172.21.15.153:0/3676167326 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9dec0a9430 0x7f9dec15bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.534+0000 7f9df2b24700 1 --2- 172.21.15.153:0/3676167326 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9dec06e830 0x7f9dec147800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.534+0000 7f9df2b24700 1 -- 172.21.15.153:0/3676167326 >> 172.21.15.153:0/3676167326 conn(0x7f9dec066e00 msgr2=0x7f9dec06a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:14.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.534+0000 7f9df2b24700 1 -- 172.21.15.153:0/3676167326 shutdown_connections 2024-08-17T02:29:14.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.534+0000 7f9df2b24700 1 -- 172.21.15.153:0/3676167326 wait complete. 2024-08-17T02:29:14.539 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 18 2024-08-17T02:29:14.551 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:14.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.654+0000 7f6b9f81f700 1 Processor -- start 2024-08-17T02:29:14.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.654+0000 7f6b9f81f700 1 -- start start 2024-08-17T02:29:14.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.654+0000 7f6b9f81f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6b98156220 0x7f6b98160f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.654+0000 7f6b9f81f700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b980afc10 con 0x7f6b98155e50 2024-08-17T02:29:14.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.654+0000 7f6b9f81f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b980b10b0 con 0x7f6b980aa5f0 2024-08-17T02:29:14.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.654+0000 7f6b9f81f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b980aed20 con 0x7f6b98156220 2024-08-17T02:29:14.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.654+0000 7f6b9d5bb700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f6b98155e50 0x7f6b980a9ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35480/0 (socket says 172.21.15.153:35480) 2024-08-17T02:29:14.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.654+0000 7f6b9ddbc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6b98156220 0x7f6b98160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.654+0000 7f6b9d5bb700 1 -- 172.21.15.153:0/4218369646 learned_addr learned my addr 172.21.15.153:0/4218369646 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:29:14.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.654+0000 7f6b9ddbc700 1 -- 172.21.15.153:0/4218369646 >> v1:172.21.15.174:6789/0 conn(0x7f6b980aa5f0 legacy=0x7f6b9806ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.654+0000 7f6b9ddbc700 1 -- 172.21.15.153:0/4218369646 >> v1:172.21.15.153:6789/0 conn(0x7f6b98155e50 legacy=0x7f6b980a9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.654+0000 7f6b8ffff700 1 -- 172.21.15.153:0/4218369646 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2998153215 0 0) 0x7f6b980afc10 con 0x7f6b98155e50 2024-08-17T02:29:14.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.654+0000 7f6b9ddbc700 1 -- 172.21.15.153:0/4218369646 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b980af000 con 0x7f6b98156220 2024-08-17T02:29:14.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.654+0000 7f6b9ddbc700 1 --2- 172.21.15.153:0/4218369646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b98156220 0x7f6b98160f50 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6b90009e60 tx=0x7f6b90009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=184770351311e8e0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:14.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.654+0000 7f6b8ffff700 1 -- 172.21.15.153:0/4218369646 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9000e070 con 0x7f6b98156220 2024-08-17T02:29:14.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.654+0000 7f6b8ffff700 1 -- 172.21.15.153:0/4218369646 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9000bc30 con 0x7f6b98156220 2024-08-17T02:29:14.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.654+0000 7f6b8ffff700 1 -- 172.21.15.153:0/4218369646 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b90012430 con 0x7f6b98156220 2024-08-17T02:29:14.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.654+0000 7f6b9f81f700 1 -- 172.21.15.153:0/4218369646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b98156220 msgr2=0x7f6b98160f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.654+0000 7f6b9f81f700 1 --2- 172.21.15.153:0/4218369646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b98156220 0x7f6b98160f50 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6b90009e60 tx=0x7f6b90009780 comp rx=0 tx=0).stop 2024-08-17T02:29:14.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.654+0000 7f6b9f81f700 1 -- 172.21.15.153:0/4218369646 shutdown_connections 2024-08-17T02:29:14.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.654+0000 7f6b9f81f700 1 --2- 172.21.15.153:0/4218369646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b98156220 0x7f6b98160f50 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.654+0000 7f6b9f81f700 1 -- 172.21.15.153:0/4218369646 >> 172.21.15.153:0/4218369646 conn(0x7f6b98066e00 msgr2=0x7f6b98067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:14.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.654+0000 7f6b9f81f700 1 -- 172.21.15.153:0/4218369646 shutdown_connections 2024-08-17T02:29:14.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.654+0000 7f6b9f81f700 1 -- 172.21.15.153:0/4218369646 wait complete. 2024-08-17T02:29:14.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.658+0000 7f6b9f81f700 1 Processor -- start 2024-08-17T02:29:14.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.658+0000 7f6b9f81f700 1 -- start start 2024-08-17T02:29:14.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.658+0000 7f6b9f81f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b980aa5f0 0x7f6b9813d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.658+0000 7f6b9f81f700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b98155e50 0x7f6b98069f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.658+0000 7f6b9f81f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6b98156220 0x7f6b9806a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.658+0000 7f6b9f81f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b980974b0 con 0x7f6b980aa5f0 2024-08-17T02:29:14.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.658+0000 7f6b9f81f700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b981684e0 con 0x7f6b98155e50 2024-08-17T02:29:14.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.658+0000 7f6b9f81f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b98167bb0 con 0x7f6b98156220 2024-08-17T02:29:14.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.658+0000 7f6b9d5bb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b980aa5f0 0x7f6b9813d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.658+0000 7f6b9cdba700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b98155e50 0x7f6b98069f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.658+0000 7f6b9d5bb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b980aa5f0 0x7f6b9813d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52476/0 (socket says 172.21.15.153:52476) 2024-08-17T02:29:14.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.658+0000 7f6b9d5bb700 1 -- 172.21.15.153:0/1033276737 learned_addr learned my addr 172.21.15.153:0/1033276737 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:14.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.658+0000 7f6b9ddbc700 1 --2- 172.21.15.153:0/1033276737 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6b98156220 0x7f6b9806a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.658+0000 7f6b9d5bb700 1 -- 172.21.15.153:0/1033276737 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6b98156220 msgr2=0x7f6b9806a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.658+0000 7f6b9d5bb700 1 --2- 172.21.15.153:0/1033276737 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6b98156220 0x7f6b9806a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.658+0000 7f6b9d5bb700 1 -- 172.21.15.153:0/1033276737 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b98155e50 msgr2=0x7f6b98069f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.658+0000 7f6b9d5bb700 1 --2- 172.21.15.153:0/1033276737 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b98155e50 0x7f6b98069f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.658+0000 7f6b9d5bb700 1 -- 172.21.15.153:0/1033276737 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b90009a20 con 0x7f6b980aa5f0 2024-08-17T02:29:14.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.658+0000 7f6b9cdba700 1 --2- 172.21.15.153:0/1033276737 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b98155e50 0x7f6b98069f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:14.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.658+0000 7f6b9d5bb700 1 --2- 172.21.15.153:0/1033276737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b980aa5f0 0x7f6b9813d200 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6b9400c810 tx=0x7f6b94007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:14.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.658+0000 7f6b8d7fa700 1 -- 172.21.15.153:0/1033276737 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b94005c00 con 0x7f6b980aa5f0 2024-08-17T02:29:14.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.662+0000 7f6b9f81f700 1 -- 172.21.15.153:0/1033276737 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b98167e90 con 0x7f6b980aa5f0 2024-08-17T02:29:14.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.662+0000 7f6b8d7fa700 1 -- 172.21.15.153:0/1033276737 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b940070d0 con 0x7f6b980aa5f0 2024-08-17T02:29:14.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.662+0000 7f6b9f81f700 1 -- 172.21.15.153:0/1033276737 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b98167830 con 0x7f6b980aa5f0 2024-08-17T02:29:14.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.662+0000 7f6b8d7fa700 1 -- 172.21.15.153:0/1033276737 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b94007280 con 0x7f6b980aa5f0 2024-08-17T02:29:14.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.662+0000 7f6b9f81f700 1 -- 172.21.15.153:0/1033276737 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b980645c0 con 0x7f6b980aa5f0 2024-08-17T02:29:14.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.662+0000 7f6b8d7fa700 1 -- 172.21.15.153:0/1033276737 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6b94007670 con 0x7f6b980aa5f0 2024-08-17T02:29:14.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.662+0000 7f6b8d7fa700 1 --2- 172.21.15.153:0/1033276737 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6b7c060890 0x7f6b7c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.662+0000 7f6b8d7fa700 1 -- 172.21.15.153:0/1033276737 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f6b9407c290 con 0x7f6b980aa5f0 2024-08-17T02:29:14.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.662+0000 7f6b9cdba700 1 --2- 172.21.15.153:0/1033276737 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6b7c060890 0x7f6b7c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.662+0000 7f6b9cdba700 1 --2- 172.21.15.153:0/1033276737 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6b7c060890 0x7f6b7c062d40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6b98151de0 tx=0x7f6b88009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:14.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.670+0000 7f6b8d7fa700 1 -- 172.21.15.153:0/1033276737 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f6b9404c410 con 0x7f6b980aa5f0 2024-08-17T02:29:14.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.830+0000 7f6b9f81f700 1 -- 172.21.15.153:0/1033276737 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b980ae670 con 0x7f6b980aa5f0 2024-08-17T02:29:14.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.834+0000 7f6b8d7fa700 1 -- 172.21.15.153:0/1033276737 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18647 (secure 0 0 0) 0x7f6b94001d60 con 0x7f6b980aa5f0 2024-08-17T02:29:14.838 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:29:14.839 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":37,"fsid":"56d41c33-b929-456d-96be-2aac4ecd299d","created":"2024-08-17T02:25:47.756085+0000","modified":"2024-08-17T02:27:12.631951+0000","last_up_change":"2024-08-17T02:25:58.643690+0000","last_in_change":"2024-08-17T02:25:49.809186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:58.093273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:54.363196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:54.837150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000118573.meta","create_time":"2024-08-17T02:27:08.568651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000118573"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000118573.data","create_time":"2024-08-17T02:27:08.668955+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000118573"}}}],"osds":[{"osd":0,"uuid":"0736f8e6-818e-42e6-a0dc-8aaf813315d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":24234},{"type":"v1","addr":"172.21.15.153:6817","nonce":24234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":24234},{"type":"v1","addr":"172.21.15.153:6819","nonce":24234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":24234},{"type":"v1","addr":"172.21.15.153:6823","nonce":24234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":24234},{"type":"v1","addr":"172.21.15.153:6821","nonce":24234}]},"public_addr":"172.21.15.153:6817/24234","cluster_addr":"172.21.15.153:6819/24234","heartbeat_back_addr":"172.21.15.153:6823/24234","heartbeat_front_addr":"172.21.15.153:6821/24234","state":["exists","up"]},{"osd":1,"uuid":"011762e9-6c2d-441a-aa56-68474639d72f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":24232},{"type":"v1","addr":"172.21.15.153:6801","nonce":24232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":24232},{"type":"v1","addr":"172.21.15.153:6803","nonce":24232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":24232},{"type":"v1","addr":"172.21.15.153:6809","nonce":24232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":24232},{"type":"v1","addr":"172.21.15.153:6806","nonce":24232}]},"public_addr":"172.21.15.153:6801/24232","cluster_addr":"172.21.15.153:6803/24232","heartbeat_back_addr":"172.21.15.153:6809/24232","heartbeat_front_addr":"172.21.15.153:6806/24232","state":["exists","up"]},{"osd":2,"uuid":"b562cd97-aa12-455e-b46a-e720a2ec9d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":24235},{"type":"v1","addr":"172.21.15.153:6808","nonce":24235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":24235},{"type":"v1","addr":"172.21.15.153:6811","nonce":24235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":24235},{"type":"v1","addr":"172.21.15.153:6815","nonce":24235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":24235},{"type":"v1","addr":"172.21.15.153:6813","nonce":24235}]},"public_addr":"172.21.15.153:6808/24235","cluster_addr":"172.21.15.153:6811/24235","heartbeat_back_addr":"172.21.15.153:6815/24235","heartbeat_front_addr":"172.21.15.153:6813/24235","state":["exists","up"]},{"osd":3,"uuid":"222da52f-90c2-4132-a5d2-6f6cf83d4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":24236},{"type":"v1","addr":"172.21.15.153:6825","nonce":24236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":24236},{"type":"v1","addr":"172.21.15.153:6827","nonce":24236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":24236},{"type":"v1","addr":"172.21.15.153:6831","nonce":24236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":24236},{"type":"v1","addr":"172.21.15.153:6829","nonce":24236}]},"public_addr":"172.21.15.153:6825/24236","cluster_addr":"172.21.15.153:6827/24236","heartbeat_back_addr":"172.21.15.153:6831/24236","heartbeat_front_addr":"172.21.15.153:6829/24236","state":["exists","up"]},{"osd":4,"uuid":"a38a04cd-032b-4977-a260-1ef3567d0c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24456},{"type":"v1","addr":"172.21.15.174:6809","nonce":24456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24456},{"type":"v1","addr":"172.21.15.174:6811","nonce":24456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24456},{"type":"v1","addr":"172.21.15.174:6815","nonce":24456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24456},{"type":"v1","addr":"172.21.15.174:6813","nonce":24456}]},"public_addr":"172.21.15.174:6809/24456","cluster_addr":"172.21.15.174:6811/24456","heartbeat_back_addr":"172.21.15.174:6815/24456","heartbeat_front_addr":"172.21.15.174:6813/24456","state":["exists","up"]},{"osd":5,"uuid":"c7778084-e751-48da-87a1-ab8bbe85aa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24457},{"type":"v1","addr":"172.21.15.174:6825","nonce":24457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24457},{"type":"v1","addr":"172.21.15.174:6827","nonce":24457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24457},{"type":"v1","addr":"172.21.15.174:6831","nonce":24457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24457},{"type":"v1","addr":"172.21.15.174:6829","nonce":24457}]},"public_addr":"172.21.15.174:6825/24457","cluster_addr":"172.21.15.174:6827/24457","heartbeat_back_addr":"172.21.15.174:6831/24457","heartbeat_front_addr":"172.21.15.174:6829/24457","state":["exists","up"]},{"osd":6,"uuid":"2d8e0715-254f-442c-9625-50721d0bc858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24477},{"type":"v1","addr":"172.21.15.174:6801","nonce":24477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24477},{"type":"v1","addr":"172.21.15.174:6803","nonce":24477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24477},{"type":"v1","addr":"172.21.15.174:6807","nonce":24477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24477},{"type":"v1","addr":"172.21.15.174:6805","nonce":24477}]},"public_addr":"172.21.15.174:6801/24477","cluster_addr":"172.21.15.174:6803/24477","heartbeat_back_addr":"172.21.15.174:6807/24477","heartbeat_front_addr":"172.21.15.174:6805/24477","state":["exists","up"]},{"osd":7,"uuid":"dffda25a-4601-4ddb-9a27-b0be1cadde27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24455},{"type":"v1","addr":"172.21.15.174:6817","nonce":24455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24455},{"type":"v1","addr":"172.21.15.174:6819","nonce":24455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24455},{"type":"v1","addr":"172.21.15.174:6823","nonce":24455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24455},{"type":"v1","addr":"172.21.15.174:6821","nonce":24455}]},"public_addr":"172.21.15.174:6817/24455","cluster_addr":"172.21.15.174:6819/24455","heartbeat_back_addr":"172.21.15.174:6823/24455","heartbeat_front_addr":"172.21.15.174:6821/24455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.990117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.033862+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.748087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.112877+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.070448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.360961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.110940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.226377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:14.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.834+0000 7f6b9f81f700 1 -- 172.21.15.153:0/1033276737 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6b7c060890 msgr2=0x7f6b7c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.834+0000 7f6b9f81f700 1 --2- 172.21.15.153:0/1033276737 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6b7c060890 0x7f6b7c062d40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6b98151de0 tx=0x7f6b88009040 comp rx=0 tx=0).stop 2024-08-17T02:29:14.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.834+0000 7f6b9f81f700 1 -- 172.21.15.153:0/1033276737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b980aa5f0 msgr2=0x7f6b9813d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.834+0000 7f6b9f81f700 1 --2- 172.21.15.153:0/1033276737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b980aa5f0 0x7f6b9813d200 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6b9400c810 tx=0x7f6b94007d90 comp rx=0 tx=0).stop 2024-08-17T02:29:14.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.834+0000 7f6b9f81f700 1 -- 172.21.15.153:0/1033276737 shutdown_connections 2024-08-17T02:29:14.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.834+0000 7f6b9f81f700 1 --2- 172.21.15.153:0/1033276737 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6b7c060890 0x7f6b7c062d40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.834+0000 7f6b9f81f700 1 --2- 172.21.15.153:0/1033276737 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6b98156220 0x7f6b9806a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.834+0000 7f6b9f81f700 1 --2- 172.21.15.153:0/1033276737 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b98155e50 0x7f6b98069f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.834+0000 7f6b9f81f700 1 --2- 172.21.15.153:0/1033276737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b980aa5f0 0x7f6b9813d200 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.834+0000 7f6b9f81f700 1 -- 172.21.15.153:0/1033276737 >> 172.21.15.153:0/1033276737 conn(0x7f6b98066e00 msgr2=0x7f6b980671d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:14.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.834+0000 7f6b9f81f700 1 -- 172.21.15.153:0/1033276737 shutdown_connections 2024-08-17T02:29:14.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.834+0000 7f6b9f81f700 1 -- 172.21.15.153:0/1033276737 wait complete. 2024-08-17T02:29:14.851 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:29:14.851 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:14.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.954+0000 7fb940cdb700 1 Processor -- start 2024-08-17T02:29:14.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.954+0000 7fb940cdb700 1 -- start start 2024-08-17T02:29:14.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.954+0000 7fb940cdb700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb93c0b0d20 0x7fb93c06df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.954+0000 7fb940cdb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb93c0b1800 0x7fb93c141e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.954+0000 7fb940cdb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb93c141a00 con 0x7fb93c06e450 2024-08-17T02:29:14.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.954+0000 7fb940cdb700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb93c06e8a0 con 0x7fb93c0b0d20 2024-08-17T02:29:14.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.954+0000 7fb940cdb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c140b10 con 0x7fb93c0b1800 2024-08-17T02:29:14.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.954+0000 7fb93b7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb93c0b0d20 0x7fb93c06df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.954+0000 7fb93b7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb93c0b0d20 0x7fb93c06df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52490/0 (socket says 172.21.15.153:52490) 2024-08-17T02:29:14.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.954+0000 7fb93b7fe700 1 -- 172.21.15.153:0/2796176604 learned_addr learned my addr 172.21.15.153:0/2796176604 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:14.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.954+0000 7fb93bfff700 1 --2- 172.21.15.153:0/2796176604 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb93c0b1800 0x7fb93c141e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.954+0000 7fb93b7fe700 1 -- 172.21.15.153:0/2796176604 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb93c0b1800 msgr2=0x7fb93c141e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:14.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.954+0000 7fb93b7fe700 1 --2- 172.21.15.153:0/2796176604 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb93c0b1800 0x7fb93c141e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.954+0000 7fb93b7fe700 1 -- 172.21.15.153:0/2796176604 >> v1:172.21.15.174:6789/0 conn(0x7fb93c06e450 legacy=0x7fb93c0b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.954+0000 7fb93a7fc700 1 -- 172.21.15.153:0/2796176604 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 702572551 0 0) 0x7fb93c141a00 con 0x7fb93c06e450 2024-08-17T02:29:14.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.954+0000 7fb93b7fe700 1 -- 172.21.15.153:0/2796176604 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb93c140df0 con 0x7fb93c0b0d20 2024-08-17T02:29:14.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.958+0000 7fb93b7fe700 1 --2- 172.21.15.153:0/2796176604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb93c0b0d20 0x7fb93c06df10 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb9240099b0 tx=0x7fb924009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4233ba9f9b74db1c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:14.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.958+0000 7fb93a7fc700 1 -- 172.21.15.153:0/2796176604 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb924009ea0 con 0x7fb93c0b0d20 2024-08-17T02:29:14.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.958+0000 7fb93a7fc700 1 -- 172.21.15.153:0/2796176604 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92400b860 con 0x7fb93c0b0d20 2024-08-17T02:29:14.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.958+0000 7fb93a7fc700 1 -- 172.21.15.153:0/2796176604 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92400bc00 con 0x7fb93c0b0d20 2024-08-17T02:29:14.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.958+0000 7fb940cdb700 1 -- 172.21.15.153:0/2796176604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb93c0b0d20 msgr2=0x7fb93c06df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.958+0000 7fb940cdb700 1 --2- 172.21.15.153:0/2796176604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb93c0b0d20 0x7fb93c06df10 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb9240099b0 tx=0x7fb924009250 comp rx=0 tx=0).stop 2024-08-17T02:29:14.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.958+0000 7fb940cdb700 1 -- 172.21.15.153:0/2796176604 shutdown_connections 2024-08-17T02:29:14.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.958+0000 7fb940cdb700 1 --2- 172.21.15.153:0/2796176604 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb93c0b1800 0x7fb93c141e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.958+0000 7fb940cdb700 1 --2- 172.21.15.153:0/2796176604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb93c0b0d20 0x7fb93c06df10 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.958+0000 7fb940cdb700 1 -- 172.21.15.153:0/2796176604 >> 172.21.15.153:0/2796176604 conn(0x7fb93c0678d0 msgr2=0x7fb93c067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:14.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.958+0000 7fb940cdb700 1 -- 172.21.15.153:0/2796176604 shutdown_connections 2024-08-17T02:29:14.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.958+0000 7fb940cdb700 1 -- 172.21.15.153:0/2796176604 wait complete. 2024-08-17T02:29:14.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.958+0000 7fb940cdb700 1 Processor -- start 2024-08-17T02:29:14.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.958+0000 7fb940cdb700 1 -- start start 2024-08-17T02:29:14.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.962+0000 7fb940cdb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb93c06e450 0x7fb93c143100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.962+0000 7fb940cdb700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb93c0b0d20 0x7fb93c143640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.962+0000 7fb940cdb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb93c0b1800 0x7fb93c16dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.962+0000 7fb940cdb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c143e90 con 0x7fb93c06e450 2024-08-17T02:29:14.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.962+0000 7fb940cdb700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c144170 con 0x7fb93c0b0d20 2024-08-17T02:29:14.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.962+0000 7fb940cdb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c144450 con 0x7fb93c0b1800 2024-08-17T02:29:14.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.962+0000 7fb93b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb93c06e450 0x7fb93c143100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.962+0000 7fb93b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb93c06e450 0x7fb93c143100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52492/0 (socket says 172.21.15.153:52492) 2024-08-17T02:29:14.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.962+0000 7fb93b7fe700 1 -- 172.21.15.153:0/576434426 learned_addr learned my addr 172.21.15.153:0/576434426 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:14.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.962+0000 7fb93bfff700 1 --2- 172.21.15.153:0/576434426 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb93c0b1800 0x7fb93c16dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.962+0000 7fb93affd700 1 --2- 172.21.15.153:0/576434426 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb93c0b0d20 0x7fb93c143640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.962+0000 7fb93b7fe700 1 -- 172.21.15.153:0/576434426 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb93c0b1800 msgr2=0x7fb93c16dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.962+0000 7fb93b7fe700 1 --2- 172.21.15.153:0/576434426 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb93c0b1800 0x7fb93c16dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.962+0000 7fb93b7fe700 1 -- 172.21.15.153:0/576434426 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb93c0b0d20 msgr2=0x7fb93c143640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.962+0000 7fb93b7fe700 1 --2- 172.21.15.153:0/576434426 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb93c0b0d20 0x7fb93c143640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.962+0000 7fb93b7fe700 1 -- 172.21.15.153:0/576434426 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9240094f0 con 0x7fb93c06e450 2024-08-17T02:29:14.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.962+0000 7fb93b7fe700 1 --2- 172.21.15.153:0/576434426 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb93c06e450 0x7fb93c143100 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb93c06c2d0 tx=0x7fb924017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:14.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.962+0000 7fb9337fe700 1 -- 172.21.15.153:0/576434426 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb924000d10 con 0x7fb93c06e450 2024-08-17T02:29:14.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.962+0000 7fb9337fe700 1 -- 172.21.15.153:0/576434426 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92400bbe0 con 0x7fb93c06e450 2024-08-17T02:29:14.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.962+0000 7fb940cdb700 1 -- 172.21.15.153:0/576434426 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb93c143b80 con 0x7fb93c06e450 2024-08-17T02:29:14.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.962+0000 7fb9337fe700 1 -- 172.21.15.153:0/576434426 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb924011690 con 0x7fb93c06e450 2024-08-17T02:29:14.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.962+0000 7fb940cdb700 1 -- 172.21.15.153:0/576434426 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb93c146260 con 0x7fb93c06e450 2024-08-17T02:29:14.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.966+0000 7fb940cdb700 1 -- 172.21.15.153:0/576434426 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb93c0643a0 con 0x7fb93c06e450 2024-08-17T02:29:14.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.966+0000 7fb9337fe700 1 -- 172.21.15.153:0/576434426 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb924011ac0 con 0x7fb93c06e450 2024-08-17T02:29:14.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.966+0000 7fb9337fe700 1 --2- 172.21.15.153:0/576434426 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb91c060890 0x7fb91c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.966+0000 7fb93affd700 1 --2- 172.21.15.153:0/576434426 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb91c060890 0x7fb91c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.966+0000 7fb9337fe700 1 -- 172.21.15.153:0/576434426 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fb92407e770 con 0x7fb93c06e450 2024-08-17T02:29:14.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.966+0000 7fb93affd700 1 --2- 172.21.15.153:0/576434426 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb91c060890 0x7fb91c062d40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb93c1457a0 tx=0x7fb92c007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:14.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:14.970+0000 7fb9337fe700 1 -- 172.21.15.153:0/576434426 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb92404e840 con 0x7fb93c06e450 2024-08-17T02:29:15.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.166+0000 7fb940cdb700 1 -- 172.21.15.153:0/576434426 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb93c06f5f0 con 0x7fb93c06e450 2024-08-17T02:29:15.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.170+0000 7fb9337fe700 1 -- 172.21.15.153:0/576434426 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+5692 (secure 0 0 0) 0x7fb92402ded0 con 0x7fb93c06e450 2024-08-17T02:29:15.172 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:29:15.172 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4885,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/747297575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":747297575},{"type":"v1","addr":"172.21.15.174:6833","nonce":747297575}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4891,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1080524090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1080524090},{"type":"v1","addr":"172.21.15.174:6835","nonce":1080524090}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:55.849257+0000","modified":"2024-08-17T02:26:59.510699+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5031},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5031":{"gid":5031,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6837/2567193475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":2567193475},{"type":"v1","addr":"172.21.15.153:6837","nonce":2567193475}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:09.642872+0000","modified":"2024-08-17T02:27:11.644228+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5013},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5013":{"gid":5013,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":7,"addr":"172.21.15.153:6835/2569513399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2569513399},{"type":"v1","addr":"172.21.15.153:6835","nonce":2569513399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000118573","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:29:15.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.170+0000 7fb940cdb700 1 -- 172.21.15.153:0/576434426 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb91c060890 msgr2=0x7fb91c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.170+0000 7fb940cdb700 1 --2- 172.21.15.153:0/576434426 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb91c060890 0x7fb91c062d40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb93c1457a0 tx=0x7fb92c007ec0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.170+0000 7fb940cdb700 1 -- 172.21.15.153:0/576434426 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb93c06e450 msgr2=0x7fb93c143100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.170+0000 7fb940cdb700 1 --2- 172.21.15.153:0/576434426 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb93c06e450 0x7fb93c143100 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb93c06c2d0 tx=0x7fb924017000 comp rx=0 tx=0).stop 2024-08-17T02:29:15.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.170+0000 7fb940cdb700 1 -- 172.21.15.153:0/576434426 shutdown_connections 2024-08-17T02:29:15.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.170+0000 7fb940cdb700 1 --2- 172.21.15.153:0/576434426 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb91c060890 0x7fb91c062d40 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.170+0000 7fb940cdb700 1 --2- 172.21.15.153:0/576434426 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb93c0b1800 0x7fb93c16dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.170+0000 7fb940cdb700 1 --2- 172.21.15.153:0/576434426 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb93c0b0d20 0x7fb93c143640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.176 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.170+0000 7fb940cdb700 1 --2- 172.21.15.153:0/576434426 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb93c06e450 0x7fb93c143100 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.176 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.170+0000 7fb940cdb700 1 -- 172.21.15.153:0/576434426 >> 172.21.15.153:0/576434426 conn(0x7fb93c0678d0 msgr2=0x7fb93c15e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.176 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.170+0000 7fb940cdb700 1 -- 172.21.15.153:0/576434426 shutdown_connections 2024-08-17T02:29:15.176 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.170+0000 7fb940cdb700 1 -- 172.21.15.153:0/576434426 wait complete. 2024-08-17T02:29:15.176 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 18 2024-08-17T02:29:15.186 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:15.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.290+0000 7fd1bb59e700 1 Processor -- start 2024-08-17T02:29:15.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.290+0000 7fd1bb59e700 1 -- start start 2024-08-17T02:29:15.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.290+0000 7fd1bb59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1bc15c620 0x7fd1bc0b0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.290+0000 7fd1bb59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1bc0c86e0 con 0x7fd1bc15cd90 2024-08-17T02:29:15.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.290+0000 7fd1bb59e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1bc0cb850 con 0x7fd1bc0ad1b0 2024-08-17T02:29:15.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.290+0000 7fd1bb59e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc15d1e0 con 0x7fd1bc15c620 2024-08-17T02:29:15.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.290+0000 7fd1b9d9b700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fd1bc15cd90 0x7fd1bc0acaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35486/0 (socket says 172.21.15.153:35486) 2024-08-17T02:29:15.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.290+0000 7fd1b9d9b700 1 -- 172.21.15.153:0/3711981824 learned_addr learned my addr 172.21.15.153:0/3711981824 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:29:15.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.290+0000 7fd1ba59c700 1 --2- 172.21.15.153:0/3711981824 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1bc15c620 0x7fd1bc0b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.290+0000 7fd1b959a700 1 -- 172.21.15.153:0/3711981824 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2008871574 0 0) 0x7fd1bc0c86e0 con 0x7fd1bc15cd90 2024-08-17T02:29:15.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.290+0000 7fd1b959a700 1 -- 172.21.15.153:0/3711981824 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1a8003570 con 0x7fd1bc15cd90 2024-08-17T02:29:15.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.294+0000 7fd1b959a700 1 -- 172.21.15.153:0/3711981824 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3942229070 0 0) 0x7fd1bc0cb850 con 0x7fd1bc0ad1b0 2024-08-17T02:29:15.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.294+0000 7fd1b959a700 1 -- 172.21.15.153:0/3711981824 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1bc0c86e0 con 0x7fd1bc0ad1b0 2024-08-17T02:29:15.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.294+0000 7fd1ba59c700 1 -- 172.21.15.153:0/3711981824 >> v1:172.21.15.174:6789/0 conn(0x7fd1bc0ad1b0 legacy=0x7fd1bc0c8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.294+0000 7fd1ba59c700 1 -- 172.21.15.153:0/3711981824 >> v1:172.21.15.153:6789/0 conn(0x7fd1bc15cd90 legacy=0x7fd1bc0acaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.294+0000 7fd1ba59c700 1 -- 172.21.15.153:0/3711981824 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1bc15d490 con 0x7fd1bc15c620 2024-08-17T02:29:15.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.294+0000 7fd1ba59c700 1 --2- 172.21.15.153:0/3711981824 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1bc15c620 0x7fd1bc0b0320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4009e90 tx=0x7fd1b4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98c4b187cfb6518f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.294+0000 7fd1b959a700 1 -- 172.21.15.153:0/3711981824 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b400e070 con 0x7fd1bc15c620 2024-08-17T02:29:15.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.294+0000 7fd1b959a700 1 -- 172.21.15.153:0/3711981824 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b400bb80 con 0x7fd1bc15c620 2024-08-17T02:29:15.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.294+0000 7fd1b959a700 1 -- 172.21.15.153:0/3711981824 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b4012430 con 0x7fd1bc15c620 2024-08-17T02:29:15.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.294+0000 7fd1bb59e700 1 -- 172.21.15.153:0/3711981824 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1bc15c620 msgr2=0x7fd1bc0b0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.294+0000 7fd1bb59e700 1 --2- 172.21.15.153:0/3711981824 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1bc15c620 0x7fd1bc0b0320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4009e90 tx=0x7fd1b4009780 comp rx=0 tx=0).stop 2024-08-17T02:29:15.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.294+0000 7fd1bb59e700 1 -- 172.21.15.153:0/3711981824 shutdown_connections 2024-08-17T02:29:15.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.294+0000 7fd1bb59e700 1 --2- 172.21.15.153:0/3711981824 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1bc15c620 0x7fd1bc0b0320 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.294+0000 7fd1bb59e700 1 -- 172.21.15.153:0/3711981824 >> 172.21.15.153:0/3711981824 conn(0x7fd1bc0ca900 msgr2=0x7fd1bc0cad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.294+0000 7fd1bb59e700 1 -- 172.21.15.153:0/3711981824 shutdown_connections 2024-08-17T02:29:15.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.294+0000 7fd1bb59e700 1 -- 172.21.15.153:0/3711981824 wait complete. 2024-08-17T02:29:15.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.294+0000 7fd1bb59e700 1 Processor -- start 2024-08-17T02:29:15.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.294+0000 7fd1bb59e700 1 -- start start 2024-08-17T02:29:15.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.298+0000 7fd1bb59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1bc0ad1b0 0x7fd1bc1693d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.298+0000 7fd1bb59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1bc15c620 0x7fd1bc0c3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.298+0000 7fd1bb59e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1bc15cd90 0x7fd1bc0c3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.298+0000 7fd1bb59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc0c6930 con 0x7fd1bc15c620 2024-08-17T02:29:15.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.298+0000 7fd1bb59e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc0c5d20 con 0x7fd1bc15cd90 2024-08-17T02:29:15.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.298+0000 7fd1bb59e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc0c6000 con 0x7fd1bc0ad1b0 2024-08-17T02:29:15.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.298+0000 7fd1b9d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1bc15c620 0x7fd1bc0c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.298+0000 7fd1b9d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1bc15c620 0x7fd1bc0c3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52504/0 (socket says 172.21.15.153:52504) 2024-08-17T02:29:15.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.298+0000 7fd1b9d9b700 1 -- 172.21.15.153:0/1705034540 learned_addr learned my addr 172.21.15.153:0/1705034540 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:15.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.298+0000 7fd1bad9d700 1 --2- 172.21.15.153:0/1705034540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1bc15cd90 0x7fd1bc0c3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.298+0000 7fd1ba59c700 1 --2- 172.21.15.153:0/1705034540 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1bc0ad1b0 0x7fd1bc1693d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.298+0000 7fd1bad9d700 1 -- 172.21.15.153:0/1705034540 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1bc0ad1b0 msgr2=0x7fd1bc1693d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.298+0000 7fd1bad9d700 1 --2- 172.21.15.153:0/1705034540 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1bc0ad1b0 0x7fd1bc1693d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.298+0000 7fd1bad9d700 1 -- 172.21.15.153:0/1705034540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1bc15c620 msgr2=0x7fd1bc0c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.298+0000 7fd1bad9d700 1 --2- 172.21.15.153:0/1705034540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1bc15c620 0x7fd1bc0c3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.298+0000 7fd1bad9d700 1 -- 172.21.15.153:0/1705034540 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b4009a20 con 0x7fd1bc15cd90 2024-08-17T02:29:15.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.298+0000 7fd1ba59c700 1 --2- 172.21.15.153:0/1705034540 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1bc0ad1b0 0x7fd1bc1693d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:15.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.298+0000 7fd1b9d9b700 1 --2- 172.21.15.153:0/1705034540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1bc15c620 0x7fd1bc0c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:15.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.298+0000 7fd1bad9d700 1 --2- 172.21.15.153:0/1705034540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1bc15cd90 0x7fd1bc0c3a40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00c560 tx=0x7fd1ac007cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.298+0000 7fd1b27fc700 1 -- 172.21.15.153:0/1705034540 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac011590 con 0x7fd1bc15cd90 2024-08-17T02:29:15.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.298+0000 7fd1b27fc700 1 -- 172.21.15.153:0/1705034540 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1ac011710 con 0x7fd1bc15cd90 2024-08-17T02:29:15.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.298+0000 7fd1bb59e700 1 -- 172.21.15.153:0/1705034540 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1bc0c62e0 con 0x7fd1bc15cd90 2024-08-17T02:29:15.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.298+0000 7fd1b27fc700 1 -- 172.21.15.153:0/1705034540 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac011ad0 con 0x7fd1bc15cd90 2024-08-17T02:29:15.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.298+0000 7fd1bb59e700 1 -- 172.21.15.153:0/1705034540 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1bc169910 con 0x7fd1bc15cd90 2024-08-17T02:29:15.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.302+0000 7fd1bb59e700 1 -- 172.21.15.153:0/1705034540 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1bc0c6aa0 con 0x7fd1bc15cd90 2024-08-17T02:29:15.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.302+0000 7fd1b27fc700 1 -- 172.21.15.153:0/1705034540 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd1ac012420 con 0x7fd1bc15cd90 2024-08-17T02:29:15.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.302+0000 7fd1b27fc700 1 --2- 172.21.15.153:0/1705034540 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd19c060860 0x7fd19c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.302+0000 7fd1b27fc700 1 -- 172.21.15.153:0/1705034540 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fd1ac07c920 con 0x7fd1bc15cd90 2024-08-17T02:29:15.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.302+0000 7fd1ba59c700 1 --2- 172.21.15.153:0/1705034540 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd19c060860 0x7fd19c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.302+0000 7fd1ba59c700 1 --2- 172.21.15.153:0/1705034540 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd19c060860 0x7fd19c062d10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4009de0 tx=0x7fd1b4019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.310+0000 7fd1b27fc700 1 -- 172.21.15.153:0/1705034540 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd1ac04c950 con 0x7fd1bc15cd90 2024-08-17T02:29:15.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.518+0000 7fd1bb59e700 1 -- 172.21.15.153:0/1705034540 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1bc0643a0 con 0x7fd1bc15cd90 2024-08-17T02:29:15.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.518+0000 7fd1b27fc700 1 -- 172.21.15.153:0/1705034540 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+5692 (secure 0 0 0) 0x7fd1ac04ff70 con 0x7fd1bc15cd90 2024-08-17T02:29:15.521 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:29:15.521 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4885,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/747297575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":747297575},{"type":"v1","addr":"172.21.15.174:6833","nonce":747297575}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4891,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1080524090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1080524090},{"type":"v1","addr":"172.21.15.174:6835","nonce":1080524090}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:55.849257+0000","modified":"2024-08-17T02:26:59.510699+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5031},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5031":{"gid":5031,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6837/2567193475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":2567193475},{"type":"v1","addr":"172.21.15.153:6837","nonce":2567193475}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:09.642872+0000","modified":"2024-08-17T02:27:11.644228+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5013},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5013":{"gid":5013,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":7,"addr":"172.21.15.153:6835/2569513399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2569513399},{"type":"v1","addr":"172.21.15.153:6835","nonce":2569513399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000118573","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:29:15.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.522+0000 7fd1bb59e700 1 -- 172.21.15.153:0/1705034540 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd19c060860 msgr2=0x7fd19c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.522+0000 7fd1bb59e700 1 --2- 172.21.15.153:0/1705034540 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd19c060860 0x7fd19c062d10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4009de0 tx=0x7fd1b4019000 comp rx=0 tx=0).stop 2024-08-17T02:29:15.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.522+0000 7fd1bb59e700 1 -- 172.21.15.153:0/1705034540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1bc15cd90 msgr2=0x7fd1bc0c3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.522+0000 7fd1bb59e700 1 --2- 172.21.15.153:0/1705034540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1bc15cd90 0x7fd1bc0c3a40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00c560 tx=0x7fd1ac007cf0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.522+0000 7fd1bb59e700 1 -- 172.21.15.153:0/1705034540 shutdown_connections 2024-08-17T02:29:15.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.522+0000 7fd1bb59e700 1 --2- 172.21.15.153:0/1705034540 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd19c060860 0x7fd19c062d10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.522+0000 7fd1bb59e700 1 --2- 172.21.15.153:0/1705034540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1bc15cd90 0x7fd1bc0c3a40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.522+0000 7fd1bb59e700 1 --2- 172.21.15.153:0/1705034540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1bc15c620 0x7fd1bc0c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.522+0000 7fd1bb59e700 1 --2- 172.21.15.153:0/1705034540 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1bc0ad1b0 0x7fd1bc1693d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.522+0000 7fd1bb59e700 1 -- 172.21.15.153:0/1705034540 >> 172.21.15.153:0/1705034540 conn(0x7fd1bc0ca900 msgr2=0x7fd1bc15ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.522+0000 7fd1bb59e700 1 -- 172.21.15.153:0/1705034540 shutdown_connections 2024-08-17T02:29:15.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.522+0000 7fd1bb59e700 1 -- 172.21.15.153:0/1705034540 wait complete. 2024-08-17T02:29:15.526 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 18 2024-08-17T02:29:15.535 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:15.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.634+0000 7f2b25c09700 1 Processor -- start 2024-08-17T02:29:15.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.634+0000 7f2b25c09700 1 -- start start 2024-08-17T02:29:15.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.634+0000 7f2b25c09700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2b20155d20 0x7f2b200b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.634+0000 7f2b25c09700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b200af2b0 con 0x7f2b2006df10 2024-08-17T02:29:15.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.634+0000 7f2b25c09700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b200af590 con 0x7f2b200ad7c0 2024-08-17T02:29:15.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.634+0000 7f2b25c09700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b200adc10 con 0x7f2b20155d20 2024-08-17T02:29:15.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.634+0000 7f2b25408700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f2b2006df10 0x7f2b2006e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35496/0 (socket says 172.21.15.153:35496) 2024-08-17T02:29:15.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.634+0000 7f2b25408700 1 -- 172.21.15.153:0/37468098 learned_addr learned my addr 172.21.15.153:0/37468098 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:29:15.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.634+0000 7f2b24c07700 1 --2- 172.21.15.153:0/37468098 >> v2:172.21.15.153:3300/0 conn(0x7f2b20155d20 0x7f2b200b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.634+0000 7f2b1f7fe700 1 -- 172.21.15.153:0/37468098 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271526194 0 0) 0x7f2b200af2b0 con 0x7f2b2006df10 2024-08-17T02:29:15.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.634+0000 7f2b1f7fe700 1 -- 172.21.15.153:0/37468098 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b0c003570 con 0x7f2b2006df10 2024-08-17T02:29:15.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.634+0000 7f2b1f7fe700 1 -- 172.21.15.153:0/37468098 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 371948850 0 0) 0x7f2b200af590 con 0x7f2b200ad7c0 2024-08-17T02:29:15.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.634+0000 7f2b1f7fe700 1 -- 172.21.15.153:0/37468098 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b200af2b0 con 0x7f2b200ad7c0 2024-08-17T02:29:15.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.634+0000 7f2b1f7fe700 1 -- 172.21.15.153:0/37468098 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1103931958 0 0) 0x7f2b0c003570 con 0x7f2b2006df10 2024-08-17T02:29:15.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.634+0000 7f2b24c07700 1 -- 172.21.15.153:0/37468098 >> v1:172.21.15.174:6789/0 conn(0x7f2b200ad7c0 legacy=0x7f2b200aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.634+0000 7f2b24c07700 1 -- 172.21.15.153:0/37468098 >> v1:172.21.15.153:6789/0 conn(0x7f2b2006df10 legacy=0x7f2b2006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.634+0000 7f2b24c07700 1 -- 172.21.15.153:0/37468098 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b200af870 con 0x7f2b20155d20 2024-08-17T02:29:15.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.638+0000 7f2b24c07700 1 --2- 172.21.15.153:0/37468098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b20155d20 0x7f2b200b0350 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2b100098e0 tx=0x7f2b100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d06d4ae22d08e6f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.638+0000 7f2b1f7fe700 1 -- 172.21.15.153:0/37468098 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b18001470 con 0x7f2b20155d20 2024-08-17T02:29:15.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.638+0000 7f2b1f7fe700 1 -- 172.21.15.153:0/37468098 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b10011420 con 0x7f2b20155d20 2024-08-17T02:29:15.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.638+0000 7f2b1f7fe700 1 -- 172.21.15.153:0/37468098 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b100117c0 con 0x7f2b20155d20 2024-08-17T02:29:15.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.638+0000 7f2b25c09700 1 -- 172.21.15.153:0/37468098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b20155d20 msgr2=0x7f2b200b0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.638+0000 7f2b25c09700 1 --2- 172.21.15.153:0/37468098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b20155d20 0x7f2b200b0350 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2b100098e0 tx=0x7f2b100091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.638+0000 7f2b25c09700 1 -- 172.21.15.153:0/37468098 shutdown_connections 2024-08-17T02:29:15.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.638+0000 7f2b25c09700 1 --2- 172.21.15.153:0/37468098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b20155d20 0x7f2b200b0350 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.638+0000 7f2b25c09700 1 -- 172.21.15.153:0/37468098 >> 172.21.15.153:0/37468098 conn(0x7f2b200678d0 msgr2=0x7f2b20067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.638+0000 7f2b25c09700 1 -- 172.21.15.153:0/37468098 shutdown_connections 2024-08-17T02:29:15.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.638+0000 7f2b25c09700 1 -- 172.21.15.153:0/37468098 wait complete. 2024-08-17T02:29:15.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.638+0000 7f2b25c09700 1 Processor -- start 2024-08-17T02:29:15.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.638+0000 7f2b25c09700 1 -- start start 2024-08-17T02:29:15.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.642+0000 7f2b25c09700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b2006df10 0x7f2b201694d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.642+0000 7f2b25c09700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b200ad7c0 0x7f2b20150c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.642+0000 7f2b25c09700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b20155d20 0x7f2b20151170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.642+0000 7f2b25c09700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b20158860 con 0x7f2b2006df10 2024-08-17T02:29:15.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.642+0000 7f2b25c09700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b201583d0 con 0x7f2b200ad7c0 2024-08-17T02:29:15.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.642+0000 7f2b25c09700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b201577c0 con 0x7f2b20155d20 2024-08-17T02:29:15.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.642+0000 7f2b24c07700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b2006df10 0x7f2b201694d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.642+0000 7f2b24c07700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b2006df10 0x7f2b201694d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52520/0 (socket says 172.21.15.153:52520) 2024-08-17T02:29:15.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.642+0000 7f2b24c07700 1 -- 172.21.15.153:0/1037875566 learned_addr learned my addr 172.21.15.153:0/1037875566 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:15.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.642+0000 7f2b1ffff700 1 --2- 172.21.15.153:0/1037875566 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b200ad7c0 0x7f2b20150c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.642+0000 7f2b25408700 1 --2- 172.21.15.153:0/1037875566 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b20155d20 0x7f2b20151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.642+0000 7f2b24c07700 1 -- 172.21.15.153:0/1037875566 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b20155d20 msgr2=0x7f2b20151170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.642+0000 7f2b24c07700 1 --2- 172.21.15.153:0/1037875566 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b20155d20 0x7f2b20151170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.642+0000 7f2b24c07700 1 -- 172.21.15.153:0/1037875566 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b200ad7c0 msgr2=0x7f2b20150c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.642+0000 7f2b24c07700 1 --2- 172.21.15.153:0/1037875566 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b200ad7c0 0x7f2b20150c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.642+0000 7f2b24c07700 1 -- 172.21.15.153:0/1037875566 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b10009420 con 0x7f2b2006df10 2024-08-17T02:29:15.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.642+0000 7f2b25408700 1 --2- 172.21.15.153:0/1037875566 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b20155d20 0x7f2b20151170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:15.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.642+0000 7f2b24c07700 1 --2- 172.21.15.153:0/1037875566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b2006df10 0x7f2b201694d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2b2006c2d0 tx=0x7f2b10016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.642+0000 7f2b1cff9700 1 -- 172.21.15.153:0/1037875566 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1001cc90 con 0x7f2b2006df10 2024-08-17T02:29:15.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.642+0000 7f2b1cff9700 1 -- 172.21.15.153:0/1037875566 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b1001cdf0 con 0x7f2b2006df10 2024-08-17T02:29:15.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.642+0000 7f2b25c09700 1 -- 172.21.15.153:0/1037875566 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b20157aa0 con 0x7f2b2006df10 2024-08-17T02:29:15.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.642+0000 7f2b1cff9700 1 -- 172.21.15.153:0/1037875566 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1001a6a0 con 0x7f2b2006df10 2024-08-17T02:29:15.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.642+0000 7f2b25c09700 1 -- 172.21.15.153:0/1037875566 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b20158060 con 0x7f2b2006df10 2024-08-17T02:29:15.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.642+0000 7f2b25c09700 1 -- 172.21.15.153:0/1037875566 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b200643a0 con 0x7f2b2006df10 2024-08-17T02:29:15.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.646+0000 7f2b1cff9700 1 -- 172.21.15.153:0/1037875566 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2b1001aa10 con 0x7f2b2006df10 2024-08-17T02:29:15.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.646+0000 7f2b1cff9700 1 --2- 172.21.15.153:0/1037875566 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2b00060860 0x7f2b00062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.646+0000 7f2b1cff9700 1 -- 172.21.15.153:0/1037875566 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f2b1007e830 con 0x7f2b2006df10 2024-08-17T02:29:15.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.646+0000 7f2b1ffff700 1 --2- 172.21.15.153:0/1037875566 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2b00060860 0x7f2b00062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.646+0000 7f2b1ffff700 1 --2- 172.21.15.153:0/1037875566 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2b00060860 0x7f2b00062d10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2b2016d1e0 tx=0x7f2b08009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.654+0000 7f2b1cff9700 1 -- 172.21.15.153:0/1037875566 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f2b1004e900 con 0x7f2b2006df10 2024-08-17T02:29:15.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.818+0000 7f2b25c09700 1 -- 172.21.15.153:0/1037875566 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b2006f5f0 con 0x7f2b2006df10 2024-08-17T02:29:15.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.818+0000 7f2b1cff9700 1 -- 172.21.15.153:0/1037875566 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18647 (secure 0 0 0) 0x7f2b10051f20 con 0x7f2b2006df10 2024-08-17T02:29:15.821 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:29:15.821 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":37,"fsid":"56d41c33-b929-456d-96be-2aac4ecd299d","created":"2024-08-17T02:25:47.756085+0000","modified":"2024-08-17T02:27:12.631951+0000","last_up_change":"2024-08-17T02:25:58.643690+0000","last_in_change":"2024-08-17T02:25:49.809186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:58.093273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:54.363196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:54.837150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000118573.meta","create_time":"2024-08-17T02:27:08.568651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000118573"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000118573.data","create_time":"2024-08-17T02:27:08.668955+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000118573"}}}],"osds":[{"osd":0,"uuid":"0736f8e6-818e-42e6-a0dc-8aaf813315d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":24234},{"type":"v1","addr":"172.21.15.153:6817","nonce":24234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":24234},{"type":"v1","addr":"172.21.15.153:6819","nonce":24234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":24234},{"type":"v1","addr":"172.21.15.153:6823","nonce":24234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":24234},{"type":"v1","addr":"172.21.15.153:6821","nonce":24234}]},"public_addr":"172.21.15.153:6817/24234","cluster_addr":"172.21.15.153:6819/24234","heartbeat_back_addr":"172.21.15.153:6823/24234","heartbeat_front_addr":"172.21.15.153:6821/24234","state":["exists","up"]},{"osd":1,"uuid":"011762e9-6c2d-441a-aa56-68474639d72f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":24232},{"type":"v1","addr":"172.21.15.153:6801","nonce":24232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":24232},{"type":"v1","addr":"172.21.15.153:6803","nonce":24232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":24232},{"type":"v1","addr":"172.21.15.153:6809","nonce":24232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":24232},{"type":"v1","addr":"172.21.15.153:6806","nonce":24232}]},"public_addr":"172.21.15.153:6801/24232","cluster_addr":"172.21.15.153:6803/24232","heartbeat_back_addr":"172.21.15.153:6809/24232","heartbeat_front_addr":"172.21.15.153:6806/24232","state":["exists","up"]},{"osd":2,"uuid":"b562cd97-aa12-455e-b46a-e720a2ec9d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":24235},{"type":"v1","addr":"172.21.15.153:6808","nonce":24235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":24235},{"type":"v1","addr":"172.21.15.153:6811","nonce":24235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":24235},{"type":"v1","addr":"172.21.15.153:6815","nonce":24235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":24235},{"type":"v1","addr":"172.21.15.153:6813","nonce":24235}]},"public_addr":"172.21.15.153:6808/24235","cluster_addr":"172.21.15.153:6811/24235","heartbeat_back_addr":"172.21.15.153:6815/24235","heartbeat_front_addr":"172.21.15.153:6813/24235","state":["exists","up"]},{"osd":3,"uuid":"222da52f-90c2-4132-a5d2-6f6cf83d4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":24236},{"type":"v1","addr":"172.21.15.153:6825","nonce":24236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":24236},{"type":"v1","addr":"172.21.15.153:6827","nonce":24236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":24236},{"type":"v1","addr":"172.21.15.153:6831","nonce":24236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":24236},{"type":"v1","addr":"172.21.15.153:6829","nonce":24236}]},"public_addr":"172.21.15.153:6825/24236","cluster_addr":"172.21.15.153:6827/24236","heartbeat_back_addr":"172.21.15.153:6831/24236","heartbeat_front_addr":"172.21.15.153:6829/24236","state":["exists","up"]},{"osd":4,"uuid":"a38a04cd-032b-4977-a260-1ef3567d0c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24456},{"type":"v1","addr":"172.21.15.174:6809","nonce":24456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24456},{"type":"v1","addr":"172.21.15.174:6811","nonce":24456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24456},{"type":"v1","addr":"172.21.15.174:6815","nonce":24456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24456},{"type":"v1","addr":"172.21.15.174:6813","nonce":24456}]},"public_addr":"172.21.15.174:6809/24456","cluster_addr":"172.21.15.174:6811/24456","heartbeat_back_addr":"172.21.15.174:6815/24456","heartbeat_front_addr":"172.21.15.174:6813/24456","state":["exists","up"]},{"osd":5,"uuid":"c7778084-e751-48da-87a1-ab8bbe85aa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24457},{"type":"v1","addr":"172.21.15.174:6825","nonce":24457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24457},{"type":"v1","addr":"172.21.15.174:6827","nonce":24457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24457},{"type":"v1","addr":"172.21.15.174:6831","nonce":24457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24457},{"type":"v1","addr":"172.21.15.174:6829","nonce":24457}]},"public_addr":"172.21.15.174:6825/24457","cluster_addr":"172.21.15.174:6827/24457","heartbeat_back_addr":"172.21.15.174:6831/24457","heartbeat_front_addr":"172.21.15.174:6829/24457","state":["exists","up"]},{"osd":6,"uuid":"2d8e0715-254f-442c-9625-50721d0bc858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24477},{"type":"v1","addr":"172.21.15.174:6801","nonce":24477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24477},{"type":"v1","addr":"172.21.15.174:6803","nonce":24477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24477},{"type":"v1","addr":"172.21.15.174:6807","nonce":24477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24477},{"type":"v1","addr":"172.21.15.174:6805","nonce":24477}]},"public_addr":"172.21.15.174:6801/24477","cluster_addr":"172.21.15.174:6803/24477","heartbeat_back_addr":"172.21.15.174:6807/24477","heartbeat_front_addr":"172.21.15.174:6805/24477","state":["exists","up"]},{"osd":7,"uuid":"dffda25a-4601-4ddb-9a27-b0be1cadde27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24455},{"type":"v1","addr":"172.21.15.174:6817","nonce":24455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24455},{"type":"v1","addr":"172.21.15.174:6819","nonce":24455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24455},{"type":"v1","addr":"172.21.15.174:6823","nonce":24455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24455},{"type":"v1","addr":"172.21.15.174:6821","nonce":24455}]},"public_addr":"172.21.15.174:6817/24455","cluster_addr":"172.21.15.174:6819/24455","heartbeat_back_addr":"172.21.15.174:6823/24455","heartbeat_front_addr":"172.21.15.174:6821/24455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.990117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.033862+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.748087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.112877+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.070448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.360961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.110940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.226377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:15.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.822+0000 7f2b25c09700 1 -- 172.21.15.153:0/1037875566 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2b00060860 msgr2=0x7f2b00062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.822+0000 7f2b25c09700 1 --2- 172.21.15.153:0/1037875566 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2b00060860 0x7f2b00062d10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2b2016d1e0 tx=0x7f2b08009040 comp rx=0 tx=0).stop 2024-08-17T02:29:15.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.822+0000 7f2b25c09700 1 -- 172.21.15.153:0/1037875566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b2006df10 msgr2=0x7f2b201694d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.822+0000 7f2b25c09700 1 --2- 172.21.15.153:0/1037875566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b2006df10 0x7f2b201694d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2b2006c2d0 tx=0x7f2b10016000 comp rx=0 tx=0).stop 2024-08-17T02:29:15.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.822+0000 7f2b25c09700 1 -- 172.21.15.153:0/1037875566 shutdown_connections 2024-08-17T02:29:15.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.822+0000 7f2b25c09700 1 --2- 172.21.15.153:0/1037875566 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2b00060860 0x7f2b00062d10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.822+0000 7f2b25c09700 1 --2- 172.21.15.153:0/1037875566 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b20155d20 0x7f2b20151170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.822+0000 7f2b25c09700 1 --2- 172.21.15.153:0/1037875566 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b200ad7c0 0x7f2b20150c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.822+0000 7f2b25c09700 1 --2- 172.21.15.153:0/1037875566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b2006df10 0x7f2b201694d0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.822+0000 7f2b25c09700 1 -- 172.21.15.153:0/1037875566 >> 172.21.15.153:0/1037875566 conn(0x7f2b200678d0 msgr2=0x7f2b2014aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.822+0000 7f2b25c09700 1 -- 172.21.15.153:0/1037875566 shutdown_connections 2024-08-17T02:29:15.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.822+0000 7f2b25c09700 1 -- 172.21.15.153:0/1037875566 wait complete. 2024-08-17T02:29:15.836 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:29:15.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.942+0000 7f7aee9bb700 1 Processor -- start 2024-08-17T02:29:15.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.942+0000 7f7aee9bb700 1 -- start start 2024-08-17T02:29:15.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.942+0000 7f7aee9bb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7ae8159040 0x7f7ae80cf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.942+0000 7f7aee9bb700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ae80cf190 con 0x7f7ae80d0010 2024-08-17T02:29:15.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.942+0000 7f7aee9bb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ae80ce5e0 con 0x7f7ae815d5b0 2024-08-17T02:29:15.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.942+0000 7f7aee9bb700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ae815d9f0 con 0x7f7ae8159040 2024-08-17T02:29:15.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.946+0000 7f7aed1b8700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f7ae80d0010 0x7f7ae815cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35504/0 (socket says 172.21.15.153:35504) 2024-08-17T02:29:15.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.946+0000 7f7aed1b8700 1 -- 172.21.15.153:0/643012897 learned_addr learned my addr 172.21.15.153:0/643012897 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:29:15.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.946+0000 7f7aed9b9700 1 --2- 172.21.15.153:0/643012897 >> v2:172.21.15.174:3300/0 conn(0x7f7ae8159040 0x7f7ae80cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.946+0000 7f7aec9b7700 1 -- 172.21.15.153:0/643012897 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1885931518 0 0) 0x7f7ae80cf190 con 0x7f7ae80d0010 2024-08-17T02:29:15.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.946+0000 7f7aec9b7700 1 -- 172.21.15.153:0/643012897 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ad4003570 con 0x7f7ae80d0010 2024-08-17T02:29:15.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.946+0000 7f7aed9b9700 1 -- 172.21.15.153:0/643012897 >> v1:172.21.15.174:6789/0 conn(0x7f7ae815d5b0 legacy=0x7f7ae815aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.946+0000 7f7aed9b9700 1 -- 172.21.15.153:0/643012897 >> v1:172.21.15.153:6789/0 conn(0x7f7ae80d0010 legacy=0x7f7ae815cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.946+0000 7f7aed9b9700 1 -- 172.21.15.153:0/643012897 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae80ce860 con 0x7f7ae8159040 2024-08-17T02:29:15.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.946+0000 7f7aed9b9700 1 --2- 172.21.15.153:0/643012897 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ae8159040 0x7f7ae80cf620 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7ae815db30 tx=0x7f7ae40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ce8ea524b3cb520 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.946+0000 7f7aec9b7700 1 -- 172.21.15.153:0/643012897 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae4011630 con 0x7f7ae8159040 2024-08-17T02:29:15.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.946+0000 7f7aec9b7700 1 -- 172.21.15.153:0/643012897 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae4011790 con 0x7f7ae8159040 2024-08-17T02:29:15.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.946+0000 7f7aec9b7700 1 -- 172.21.15.153:0/643012897 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae4011b10 con 0x7f7ae8159040 2024-08-17T02:29:15.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.946+0000 7f7aee9bb700 1 -- 172.21.15.153:0/643012897 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ae8159040 msgr2=0x7f7ae80cf620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.946+0000 7f7aee9bb700 1 --2- 172.21.15.153:0/643012897 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ae8159040 0x7f7ae80cf620 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7ae815db30 tx=0x7f7ae40091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.946+0000 7f7aee9bb700 1 -- 172.21.15.153:0/643012897 shutdown_connections 2024-08-17T02:29:15.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.946+0000 7f7aee9bb700 1 --2- 172.21.15.153:0/643012897 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ae8159040 0x7f7ae80cf620 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.946+0000 7f7aee9bb700 1 -- 172.21.15.153:0/643012897 >> 172.21.15.153:0/643012897 conn(0x7f7ae8068250 msgr2=0x7f7ae8068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.946+0000 7f7aee9bb700 1 -- 172.21.15.153:0/643012897 shutdown_connections 2024-08-17T02:29:15.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.946+0000 7f7aee9bb700 1 -- 172.21.15.153:0/643012897 wait complete. 2024-08-17T02:29:15.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.950+0000 7f7aee9bb700 1 Processor -- start 2024-08-17T02:29:15.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.950+0000 7f7aee9bb700 1 -- start start 2024-08-17T02:29:15.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.950+0000 7f7aee9bb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ae80d0010 0x7f7ae815c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.950+0000 7f7aee9bb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ae8159040 0x7f7ae816d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.950+0000 7f7aee9bb700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ae815d5b0 0x7f7ae816d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.950+0000 7f7aee9bb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae80b03c0 con 0x7f7ae8159040 2024-08-17T02:29:15.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.950+0000 7f7aee9bb700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae816dec0 con 0x7f7ae815d5b0 2024-08-17T02:29:15.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.950+0000 7f7aee9bb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae80b05d0 con 0x7f7ae80d0010 2024-08-17T02:29:15.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.954+0000 7f7aed1b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ae8159040 0x7f7ae816d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.954+0000 7f7aed1b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ae8159040 0x7f7ae816d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52534/0 (socket says 172.21.15.153:52534) 2024-08-17T02:29:15.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.954+0000 7f7aed1b8700 1 -- 172.21.15.153:0/3606945287 learned_addr learned my addr 172.21.15.153:0/3606945287 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:15.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.954+0000 7f7aed9b9700 1 --2- 172.21.15.153:0/3606945287 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ae80d0010 0x7f7ae815c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.954+0000 7f7aee1ba700 1 --2- 172.21.15.153:0/3606945287 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ae815d5b0 0x7f7ae816d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.954+0000 7f7aed1b8700 1 -- 172.21.15.153:0/3606945287 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ae80d0010 msgr2=0x7f7ae815c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.954+0000 7f7aed1b8700 1 --2- 172.21.15.153:0/3606945287 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ae80d0010 0x7f7ae815c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.954+0000 7f7aed1b8700 1 -- 172.21.15.153:0/3606945287 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ae815d5b0 msgr2=0x7f7ae816d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.954+0000 7f7aed1b8700 1 --2- 172.21.15.153:0/3606945287 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ae815d5b0 0x7f7ae816d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.954+0000 7f7aed1b8700 1 -- 172.21.15.153:0/3606945287 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae4009420 con 0x7f7ae8159040 2024-08-17T02:29:15.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.954+0000 7f7aee1ba700 1 --2- 172.21.15.153:0/3606945287 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ae815d5b0 0x7f7ae816d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:15.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.954+0000 7f7aed1b8700 1 --2- 172.21.15.153:0/3606945287 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ae8159040 0x7f7ae816d080 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7ad80011e0 tx=0x7f7ad8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.954+0000 7f7addffb700 1 -- 172.21.15.153:0/3606945287 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad8005b30 con 0x7f7ae8159040 2024-08-17T02:29:15.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.954+0000 7f7addffb700 1 -- 172.21.15.153:0/3606945287 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad8005c90 con 0x7f7ae8159040 2024-08-17T02:29:15.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.954+0000 7f7aee9bb700 1 -- 172.21.15.153:0/3606945287 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae80b08b0 con 0x7f7ae8159040 2024-08-17T02:29:15.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.954+0000 7f7addffb700 1 -- 172.21.15.153:0/3606945287 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad8007320 con 0x7f7ae8159040 2024-08-17T02:29:15.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.954+0000 7f7aee9bb700 1 -- 172.21.15.153:0/3606945287 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae80b0e70 con 0x7f7ae8159040 2024-08-17T02:29:15.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.954+0000 7f7aee9bb700 1 -- 172.21.15.153:0/3606945287 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae80643a0 con 0x7f7ae8159040 2024-08-17T02:29:15.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.954+0000 7f7addffb700 1 -- 172.21.15.153:0/3606945287 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7ad8007690 con 0x7f7ae8159040 2024-08-17T02:29:15.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.958+0000 7f7addffb700 1 --2- 172.21.15.153:0/3606945287 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7acc060860 0x7f7acc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.958+0000 7f7addffb700 1 -- 172.21.15.153:0/3606945287 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f7ad807c3f0 con 0x7f7ae8159040 2024-08-17T02:29:15.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.958+0000 7f7aed9b9700 1 --2- 172.21.15.153:0/3606945287 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7acc060860 0x7f7acc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.958+0000 7f7aed9b9700 1 --2- 172.21.15.153:0/3606945287 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7acc060860 0x7f7acc062d10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7ae40091e0 tx=0x7f7ae4016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:15.966+0000 7f7addffb700 1 -- 172.21.15.153:0/3606945287 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f7ad804c4c0 con 0x7f7ae8159040 2024-08-17T02:29:16.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.166+0000 7f7aee9bb700 1 -- 172.21.15.153:0/3606945287 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7ae80b3480 con 0x7f7ae8159040 2024-08-17T02:29:16.168 INFO:tasks.ceph.mon.a.smithi153.stderr:2024-08-17T02:29:16.166+0000 7ff8ba661700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:29:16.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.178+0000 7f7addffb700 1 -- 172.21.15.153:0/3606945287 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7ad804fae0 con 0x7f7ae8159040 2024-08-17T02:29:16.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.182+0000 7f7aee9bb700 1 -- 172.21.15.153:0/3606945287 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7acc060860 msgr2=0x7f7acc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.182+0000 7f7aee9bb700 1 --2- 172.21.15.153:0/3606945287 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7acc060860 0x7f7acc062d10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7ae40091e0 tx=0x7f7ae4016000 comp rx=0 tx=0).stop 2024-08-17T02:29:16.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.182+0000 7f7aee9bb700 1 -- 172.21.15.153:0/3606945287 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ae8159040 msgr2=0x7f7ae816d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.182+0000 7f7aee9bb700 1 --2- 172.21.15.153:0/3606945287 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ae8159040 0x7f7ae816d080 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7ad80011e0 tx=0x7f7ad8007df0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.182+0000 7f7aee9bb700 1 -- 172.21.15.153:0/3606945287 shutdown_connections 2024-08-17T02:29:16.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.182+0000 7f7aee9bb700 1 --2- 172.21.15.153:0/3606945287 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7acc060860 0x7f7acc062d10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.182+0000 7f7aee9bb700 1 --2- 172.21.15.153:0/3606945287 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ae815d5b0 0x7f7ae816d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.182+0000 7f7aee9bb700 1 --2- 172.21.15.153:0/3606945287 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ae8159040 0x7f7ae816d080 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.182+0000 7f7aee9bb700 1 --2- 172.21.15.153:0/3606945287 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ae80d0010 0x7f7ae815c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.182+0000 7f7aee9bb700 1 -- 172.21.15.153:0/3606945287 >> 172.21.15.153:0/3606945287 conn(0x7f7ae8068250 msgr2=0x7f7ae80b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:16.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.182+0000 7f7aee9bb700 1 -- 172.21.15.153:0/3606945287 shutdown_connections 2024-08-17T02:29:16.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.182+0000 7f7aee9bb700 1 -- 172.21.15.153:0/3606945287 wait complete. 2024-08-17T02:29:16.184 INFO:teuthology.orchestra.run.smithi153.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:29:16.196 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:29:16.207 INFO:tasks.ceph.mds.c.smithi153.stdout:starting mds.c at 2024-08-17T02:29:16.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.290+0000 7f6a2cf8e700 1 Processor -- start 2024-08-17T02:29:16.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.290+0000 7f6a2cf8e700 1 -- start start 2024-08-17T02:29:16.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.290+0000 7f6a2cf8e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6a281501e0 0x7f6a280ab7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:16.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.290+0000 7f6a2cf8e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a28157160 con 0x7f6a280abd30 2024-08-17T02:29:16.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.290+0000 7f6a2cf8e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a28156550 con 0x7f6a28068db0 2024-08-17T02:29:16.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.290+0000 7f6a2cf8e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a28156830 con 0x7f6a281501e0 2024-08-17T02:29:16.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.290+0000 7f6a277fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6a281501e0 0x7f6a280ab7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:16.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.290+0000 7f6a26ffd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f6a280abd30 0x7f6a280686a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35518/0 (socket says 172.21.15.153:35518) 2024-08-17T02:29:16.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.290+0000 7f6a277fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6a281501e0 0x7f6a280ab7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52558/0 (socket says 172.21.15.153:52558) 2024-08-17T02:29:16.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.290+0000 7f6a26ffd700 1 -- 172.21.15.153:0/2767521590 learned_addr learned my addr 172.21.15.153:0/2767521590 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:29:16.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.290+0000 7f6a277fe700 1 -- 172.21.15.153:0/2767521590 >> v1:172.21.15.174:6789/0 conn(0x7f6a28068db0 legacy=0x7f6a280af5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:16.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.290+0000 7f6a277fe700 1 -- 172.21.15.153:0/2767521590 >> v1:172.21.15.153:6789/0 conn(0x7f6a280abd30 legacy=0x7f6a280686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.290+0000 7f6a277fe700 1 -- 172.21.15.153:0/2767521590 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a28156b10 con 0x7f6a281501e0 2024-08-17T02:29:16.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.290+0000 7f6a277fe700 1 --2- 172.21.15.153:0/2767521590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a281501e0 0x7f6a280ab7f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000d0d0 tx=0x7f6a2000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ee8340fa1c7a80 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:16.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.294+0000 7f6a267fc700 1 -- 172.21.15.153:0/2767521590 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a20010070 con 0x7f6a281501e0 2024-08-17T02:29:16.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.294+0000 7f6a267fc700 1 -- 172.21.15.153:0/2767521590 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2000ddb0 con 0x7f6a281501e0 2024-08-17T02:29:16.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.294+0000 7f6a267fc700 1 -- 172.21.15.153:0/2767521590 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2000b320 con 0x7f6a281501e0 2024-08-17T02:29:16.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.294+0000 7f6a2cf8e700 1 -- 172.21.15.153:0/2767521590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a281501e0 msgr2=0x7f6a280ab7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.294+0000 7f6a2cf8e700 1 --2- 172.21.15.153:0/2767521590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a281501e0 0x7f6a280ab7f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000d0d0 tx=0x7f6a2000b990 comp rx=0 tx=0).stop 2024-08-17T02:29:16.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.294+0000 7f6a2cf8e700 1 -- 172.21.15.153:0/2767521590 shutdown_connections 2024-08-17T02:29:16.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.294+0000 7f6a2cf8e700 1 --2- 172.21.15.153:0/2767521590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a281501e0 0x7f6a280ab7f0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.294+0000 7f6a2cf8e700 1 -- 172.21.15.153:0/2767521590 >> 172.21.15.153:0/2767521590 conn(0x7f6a2806e310 msgr2=0x7f6a2806b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:16.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.294+0000 7f6a2cf8e700 1 -- 172.21.15.153:0/2767521590 shutdown_connections 2024-08-17T02:29:16.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.294+0000 7f6a2cf8e700 1 -- 172.21.15.153:0/2767521590 wait complete. 2024-08-17T02:29:16.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.294+0000 7f6a2cf8e700 1 Processor -- start 2024-08-17T02:29:16.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.294+0000 7f6a2cf8e700 1 -- start start 2024-08-17T02:29:16.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.294+0000 7f6a2cf8e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a28068db0 0x7f6a28165a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:16.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.294+0000 7f6a2cf8e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a280abd30 0x7f6a281526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:16.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.294+0000 7f6a2cf8e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a281501e0 0x7f6a2813aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:16.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.294+0000 7f6a2cf8e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a28165fb0 con 0x7f6a28068db0 2024-08-17T02:29:16.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.294+0000 7f6a2cf8e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2806a8e0 con 0x7f6a280abd30 2024-08-17T02:29:16.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.294+0000 7f6a2cf8e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a28152c30 con 0x7f6a281501e0 2024-08-17T02:29:16.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.294+0000 7f6a277fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a28068db0 0x7f6a28165a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:16.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.294+0000 7f6a277fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a28068db0 0x7f6a28165a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52564/0 (socket says 172.21.15.153:52564) 2024-08-17T02:29:16.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.294+0000 7f6a277fe700 1 -- 172.21.15.153:0/2919677571 learned_addr learned my addr 172.21.15.153:0/2919677571 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:16.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.298+0000 7f6a26ffd700 1 --2- 172.21.15.153:0/2919677571 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a280abd30 0x7f6a281526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:16.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.298+0000 7f6a27fff700 1 --2- 172.21.15.153:0/2919677571 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a281501e0 0x7f6a2813aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:16.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.298+0000 7f6a277fe700 1 -- 172.21.15.153:0/2919677571 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a281501e0 msgr2=0x7f6a2813aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.298+0000 7f6a277fe700 1 --2- 172.21.15.153:0/2919677571 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a281501e0 0x7f6a2813aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.298+0000 7f6a277fe700 1 -- 172.21.15.153:0/2919677571 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a280abd30 msgr2=0x7f6a281526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.298+0000 7f6a277fe700 1 --2- 172.21.15.153:0/2919677571 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a280abd30 0x7f6a281526f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.298+0000 7f6a277fe700 1 -- 172.21.15.153:0/2919677571 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2000bc30 con 0x7f6a28068db0 2024-08-17T02:29:16.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.298+0000 7f6a27fff700 1 --2- 172.21.15.153:0/2919677571 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a281501e0 0x7f6a2813aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:16.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.298+0000 7f6a277fe700 1 --2- 172.21.15.153:0/2919677571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a28068db0 0x7f6a28165a70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000d820 tx=0x7f6a20019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:16.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.298+0000 7f6a0f7fe700 1 -- 172.21.15.153:0/2919677571 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a20009c50 con 0x7f6a28068db0 2024-08-17T02:29:16.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.298+0000 7f6a0f7fe700 1 -- 172.21.15.153:0/2919677571 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a20009dd0 con 0x7f6a28068db0 2024-08-17T02:29:16.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.298+0000 7f6a0f7fe700 1 -- 172.21.15.153:0/2919677571 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a20020680 con 0x7f6a28068db0 2024-08-17T02:29:16.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.298+0000 7f6a2cf8e700 1 -- 172.21.15.153:0/2919677571 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a28152eb0 con 0x7f6a28068db0 2024-08-17T02:29:16.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.298+0000 7f6a2cf8e700 1 -- 172.21.15.153:0/2919677571 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a28153470 con 0x7f6a28068db0 2024-08-17T02:29:16.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.298+0000 7f6a2cf8e700 1 -- 172.21.15.153:0/2919677571 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a280638f0 con 0x7f6a28068db0 2024-08-17T02:29:16.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.302+0000 7f6a0f7fe700 1 -- 172.21.15.153:0/2919677571 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6a20020a30 con 0x7f6a28068db0 2024-08-17T02:29:16.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.302+0000 7f6a0f7fe700 1 --2- 172.21.15.153:0/2919677571 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6a14060860 0x7f6a14062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:16.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.302+0000 7f6a0f7fe700 1 -- 172.21.15.153:0/2919677571 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6689+0+0 (secure 0 0 0) 0x7f6a200818d0 con 0x7f6a28068db0 2024-08-17T02:29:16.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.302+0000 7f6a26ffd700 1 --2- 172.21.15.153:0/2919677571 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6a14060860 0x7f6a14062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:16.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.302+0000 7f6a26ffd700 1 --2- 172.21.15.153:0/2919677571 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6a14060860 0x7f6a14062d10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6a28162b90 tx=0x7f6a1c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:16.309 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.306+0000 7f6a0f7fe700 1 -- 172.21.15.153:0/2919677571 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f6a20051920 con 0x7f6a28068db0 2024-08-17T02:29:16.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:16.510+0000 7f6a2cf8e700 1 -- 172.21.15.153:0/2919677571 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6a280ad5d0 con 0x7f6a28068db0 2024-08-17T02:29:17.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.174+0000 7f6a0f7fe700 1 -- 172.21.15.153:0/2919677571 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6a20054f40 con 0x7f6a28068db0 2024-08-17T02:29:17.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.182+0000 7f6a2cf8e700 1 -- 172.21.15.153:0/2919677571 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6a14060860 msgr2=0x7f6a14062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.182+0000 7f6a2cf8e700 1 --2- 172.21.15.153:0/2919677571 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6a14060860 0x7f6a14062d10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6a28162b90 tx=0x7f6a1c009040 comp rx=0 tx=0).stop 2024-08-17T02:29:17.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.182+0000 7f6a2cf8e700 1 -- 172.21.15.153:0/2919677571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a28068db0 msgr2=0x7f6a28165a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.182+0000 7f6a2cf8e700 1 --2- 172.21.15.153:0/2919677571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a28068db0 0x7f6a28165a70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000d820 tx=0x7f6a20019000 comp rx=0 tx=0).stop 2024-08-17T02:29:17.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.182+0000 7f6a2cf8e700 1 -- 172.21.15.153:0/2919677571 shutdown_connections 2024-08-17T02:29:17.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.182+0000 7f6a2cf8e700 1 --2- 172.21.15.153:0/2919677571 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f6a14060860 0x7f6a14062d10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.182+0000 7f6a2cf8e700 1 --2- 172.21.15.153:0/2919677571 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a281501e0 0x7f6a2813aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.182+0000 7f6a2cf8e700 1 --2- 172.21.15.153:0/2919677571 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a280abd30 0x7f6a281526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.182+0000 7f6a2cf8e700 1 --2- 172.21.15.153:0/2919677571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a28068db0 0x7f6a28165a70 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.182+0000 7f6a2cf8e700 1 -- 172.21.15.153:0/2919677571 >> 172.21.15.153:0/2919677571 conn(0x7f6a2806e310 msgr2=0x7f6a2814c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:17.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.182+0000 7f6a2cf8e700 1 -- 172.21.15.153:0/2919677571 shutdown_connections 2024-08-17T02:29:17.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.182+0000 7f6a2cf8e700 1 -- 172.21.15.153:0/2919677571 wait complete. 2024-08-17T02:29:17.198 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:29:17.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.314+0000 7fb7ae452700 1 Processor -- start 2024-08-17T02:29:17.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.314+0000 7fb7ae452700 1 -- start start 2024-08-17T02:29:17.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.318+0000 7fb7ae452700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb7a813f7f0 0x7fb7a80ab6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.318+0000 7fb7ae452700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb7a806f1d0 0x7fb7a80c8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.318+0000 7fb7ae452700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7a80b0660 con 0x7fb7a813fbc0 2024-08-17T02:29:17.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.318+0000 7fb7ae452700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7a80abdc0 con 0x7fb7a806f1d0 2024-08-17T02:29:17.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.318+0000 7fb7ae452700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7a80b0af0 con 0x7fb7a813f7f0 2024-08-17T02:29:17.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.318+0000 7fb7adc51700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb7a806f1d0 0x7fb7a80c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.318+0000 7fb7adc51700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb7a806f1d0 0x7fb7a80c8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52570/0 (socket says 172.21.15.153:52570) 2024-08-17T02:29:17.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.318+0000 7fb7adc51700 1 -- 172.21.15.153:0/3528906820 learned_addr learned my addr 172.21.15.153:0/3528906820 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:17.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.318+0000 7fb7ad450700 1 --2- 172.21.15.153:0/3528906820 >> v2:172.21.15.174:3300/0 conn(0x7fb7a813f7f0 0x7fb7a80ab6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.318+0000 7fb7a7fff700 1 -- 172.21.15.153:0/3528906820 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1373722957 0 0) 0x7fb7a80b0660 con 0x7fb7a813fbc0 2024-08-17T02:29:17.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.318+0000 7fb7a7fff700 1 -- 172.21.15.153:0/3528906820 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb794003570 con 0x7fb7a813fbc0 2024-08-17T02:29:17.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.318+0000 7fb7adc51700 1 -- 172.21.15.153:0/3528906820 >> v2:172.21.15.174:3300/0 conn(0x7fb7a813f7f0 msgr2=0x7fb7a80ab6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:17.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.318+0000 7fb7adc51700 1 --2- 172.21.15.153:0/3528906820 >> v2:172.21.15.174:3300/0 conn(0x7fb7a813f7f0 0x7fb7a80ab6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.318+0000 7fb7adc51700 1 -- 172.21.15.153:0/3528906820 >> v1:172.21.15.174:6789/0 conn(0x7fb7a813fbc0 legacy=0x7fb7a806eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.318+0000 7fb7adc51700 1 -- 172.21.15.153:0/3528906820 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a80afd30 con 0x7fb7a806f1d0 2024-08-17T02:29:17.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.318+0000 7fb7adc51700 1 --2- 172.21.15.153:0/3528906820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7a806f1d0 0x7fb7a80c8010 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8064e00 tx=0x7fb790009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=796c2e667505a1ec server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.318+0000 7fb7a7fff700 1 -- 172.21.15.153:0/3528906820 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79000b640 con 0x7fb7a806f1d0 2024-08-17T02:29:17.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.318+0000 7fb7a7fff700 1 -- 172.21.15.153:0/3528906820 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb79000b7a0 con 0x7fb7a806f1d0 2024-08-17T02:29:17.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.318+0000 7fb7a7fff700 1 -- 172.21.15.153:0/3528906820 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79000bb20 con 0x7fb7a806f1d0 2024-08-17T02:29:17.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.318+0000 7fb7ae452700 1 -- 172.21.15.153:0/3528906820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7a806f1d0 msgr2=0x7fb7a80c8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.318+0000 7fb7ae452700 1 --2- 172.21.15.153:0/3528906820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7a806f1d0 0x7fb7a80c8010 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8064e00 tx=0x7fb790009250 comp rx=0 tx=0).stop 2024-08-17T02:29:17.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.318+0000 7fb7ae452700 1 -- 172.21.15.153:0/3528906820 shutdown_connections 2024-08-17T02:29:17.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.318+0000 7fb7ae452700 1 --2- 172.21.15.153:0/3528906820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7a806f1d0 0x7fb7a80c8010 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.318+0000 7fb7ae452700 1 --2- 172.21.15.153:0/3528906820 >> v2:172.21.15.174:3300/0 conn(0x7fb7a813f7f0 0x7fb7a80ab6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.318+0000 7fb7ae452700 1 -- 172.21.15.153:0/3528906820 >> 172.21.15.153:0/3528906820 conn(0x7fb7a8066e00 msgr2=0x7fb7a8067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:17.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.318+0000 7fb7ae452700 1 -- 172.21.15.153:0/3528906820 shutdown_connections 2024-08-17T02:29:17.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.318+0000 7fb7ae452700 1 -- 172.21.15.153:0/3528906820 wait complete. 2024-08-17T02:29:17.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.322+0000 7fb7ae452700 1 Processor -- start 2024-08-17T02:29:17.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.322+0000 7fb7ae452700 1 -- start start 2024-08-17T02:29:17.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.322+0000 7fb7ae452700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7a806f1d0 0x7fb7a8169b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.322+0000 7fb7ae452700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7a813f7f0 0x7fb7a8157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.322+0000 7fb7ae452700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7a813fbc0 0x7fb7a813d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.322+0000 7fb7ae452700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a81696a0 con 0x7fb7a806f1d0 2024-08-17T02:29:17.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.322+0000 7fb7ae452700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a8158060 con 0x7fb7a813f7f0 2024-08-17T02:29:17.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.322+0000 7fb7ae452700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a8168a90 con 0x7fb7a813fbc0 2024-08-17T02:29:17.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.322+0000 7fb7ad450700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7a806f1d0 0x7fb7a8169b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.322+0000 7fb7ad450700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7a806f1d0 0x7fb7a8169b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52582/0 (socket says 172.21.15.153:52582) 2024-08-17T02:29:17.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.322+0000 7fb7ad450700 1 -- 172.21.15.153:0/978252172 learned_addr learned my addr 172.21.15.153:0/978252172 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:17.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.322+0000 7fb7acc4f700 1 --2- 172.21.15.153:0/978252172 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7a813f7f0 0x7fb7a8157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.322+0000 7fb7adc51700 1 --2- 172.21.15.153:0/978252172 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7a813fbc0 0x7fb7a813d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.322+0000 7fb7ad450700 1 -- 172.21.15.153:0/978252172 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7a813fbc0 msgr2=0x7fb7a813d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.322+0000 7fb7ad450700 1 --2- 172.21.15.153:0/978252172 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7a813fbc0 0x7fb7a813d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.322+0000 7fb7ad450700 1 -- 172.21.15.153:0/978252172 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7a813f7f0 msgr2=0x7fb7a8157b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.322+0000 7fb7ad450700 1 --2- 172.21.15.153:0/978252172 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7a813f7f0 0x7fb7a8157b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.322+0000 7fb7ad450700 1 -- 172.21.15.153:0/978252172 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7900094f0 con 0x7fb7a806f1d0 2024-08-17T02:29:17.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.322+0000 7fb7acc4f700 1 --2- 172.21.15.153:0/978252172 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7a813f7f0 0x7fb7a8157b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:17.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.322+0000 7fb7ad450700 1 --2- 172.21.15.153:0/978252172 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7a806f1d0 0x7fb7a8169b30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb7a000ec80 tx=0x7fb7a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.322+0000 7fb7a57fa700 1 -- 172.21.15.153:0/978252172 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a000c9d0 con 0x7fb7a806f1d0 2024-08-17T02:29:17.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.322+0000 7fb7a57fa700 1 -- 172.21.15.153:0/978252172 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a000cb30 con 0x7fb7a806f1d0 2024-08-17T02:29:17.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.322+0000 7fb7ae452700 1 -- 172.21.15.153:0/978252172 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7a8168d70 con 0x7fb7a806f1d0 2024-08-17T02:29:17.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.322+0000 7fb7a57fa700 1 -- 172.21.15.153:0/978252172 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a0013470 con 0x7fb7a806f1d0 2024-08-17T02:29:17.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.322+0000 7fb7ae452700 1 -- 172.21.15.153:0/978252172 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7a8169330 con 0x7fb7a806f1d0 2024-08-17T02:29:17.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.326+0000 7fb7ae452700 1 -- 172.21.15.153:0/978252172 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7a80644b0 con 0x7fb7a806f1d0 2024-08-17T02:29:17.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.326+0000 7fb7a57fa700 1 -- 172.21.15.153:0/978252172 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb7a0013820 con 0x7fb7a806f1d0 2024-08-17T02:29:17.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.326+0000 7fb7a57fa700 1 --2- 172.21.15.153:0/978252172 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb788060860 0x7fb788062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.326+0000 7fb7a57fa700 1 -- 172.21.15.153:0/978252172 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6689+0+0 (secure 0 0 0) 0x7fb7a007d2f0 con 0x7fb7a806f1d0 2024-08-17T02:29:17.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.326+0000 7fb7acc4f700 1 --2- 172.21.15.153:0/978252172 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb788060860 0x7fb788062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.326+0000 7fb7acc4f700 1 --2- 172.21.15.153:0/978252172 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb788060860 0x7fb788062d10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb798007fd0 tx=0x7fb798009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.334+0000 7fb7a57fa700 1 -- 172.21.15.153:0/978252172 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb7a004d360 con 0x7fb7a806f1d0 2024-08-17T02:29:17.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:17.494+0000 7fb7ae452700 1 -- 172.21.15.153:0/978252172 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb7a806f9f0 con 0x7fb7a806f1d0 2024-08-17T02:29:18.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.286+0000 7fb7a57fa700 1 -- 172.21.15.153:0/978252172 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v39) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb7a0050980 con 0x7fb7a806f1d0 2024-08-17T02:29:18.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.290+0000 7fb7ae452700 1 -- 172.21.15.153:0/978252172 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb788060860 msgr2=0x7fb788062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.290+0000 7fb7ae452700 1 --2- 172.21.15.153:0/978252172 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb788060860 0x7fb788062d10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb798007fd0 tx=0x7fb798009040 comp rx=0 tx=0).stop 2024-08-17T02:29:18.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.290+0000 7fb7ae452700 1 -- 172.21.15.153:0/978252172 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7a806f1d0 msgr2=0x7fb7a8169b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.290+0000 7fb7ae452700 1 --2- 172.21.15.153:0/978252172 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7a806f1d0 0x7fb7a8169b30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb7a000ec80 tx=0x7fb7a00091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.290+0000 7fb7ae452700 1 -- 172.21.15.153:0/978252172 shutdown_connections 2024-08-17T02:29:18.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.290+0000 7fb7ae452700 1 --2- 172.21.15.153:0/978252172 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb788060860 0x7fb788062d10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.290+0000 7fb7ae452700 1 --2- 172.21.15.153:0/978252172 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7a813fbc0 0x7fb7a813d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.290+0000 7fb7ae452700 1 --2- 172.21.15.153:0/978252172 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7a813f7f0 0x7fb7a8157b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.290+0000 7fb7ae452700 1 --2- 172.21.15.153:0/978252172 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7a806f1d0 0x7fb7a8169b30 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.290+0000 7fb7ae452700 1 -- 172.21.15.153:0/978252172 >> 172.21.15.153:0/978252172 conn(0x7fb7a8066e00 msgr2=0x7fb7a8069890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:18.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.290+0000 7fb7ae452700 1 -- 172.21.15.153:0/978252172 shutdown_connections 2024-08-17T02:29:18.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.290+0000 7fb7ae452700 1 -- 172.21.15.153:0/978252172 wait complete. 2024-08-17T02:29:18.295 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:29:18.307 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:29:18.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.418+0000 7fb796e7c700 1 Processor -- start 2024-08-17T02:29:18.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.418+0000 7fb796e7c700 1 -- start start 2024-08-17T02:29:18.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.422+0000 7fb796e7c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb7900cd2b0 0x7fb7900cd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.422+0000 7fb796e7c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb7900caeb0 0x7fb7900ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.422+0000 7fb796e7c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7900cb300 0x7fb7900ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.422+0000 7fb796e7c700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7900cc480 con 0x7fb7900caeb0 2024-08-17T02:29:18.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.422+0000 7fb796e7c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb790159720 con 0x7fb7900cd2b0 2024-08-17T02:29:18.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.422+0000 7fb796e7c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7900cb870 con 0x7fb7900cb300 2024-08-17T02:29:18.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.422+0000 7fb78ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb7900caeb0 0x7fb7900ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.422+0000 7fb78ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb7900caeb0 0x7fb7900ce460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52588/0 (socket says 172.21.15.153:52588) 2024-08-17T02:29:18.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.422+0000 7fb78ffff700 1 -- 172.21.15.153:0/317675595 learned_addr learned my addr 172.21.15.153:0/317675595 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:18.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.422+0000 7fb795419700 1 --2- 172.21.15.153:0/317675595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7900cb300 0x7fb7900ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.422+0000 7fb794c18700 1 --2- 172.21.15.153:0/317675595 >> v2:172.21.15.174:3300/0 conn(0x7fb7900cd2b0 0x7fb7900cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.422+0000 7fb78ffff700 1 -- 172.21.15.153:0/317675595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7900cb300 msgr2=0x7fb7900ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:18.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.422+0000 7fb78ffff700 1 --2- 172.21.15.153:0/317675595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7900cb300 0x7fb7900ce9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.422+0000 7fb78ffff700 1 -- 172.21.15.153:0/317675595 >> v2:172.21.15.174:3300/0 conn(0x7fb7900cd2b0 msgr2=0x7fb7900cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:18.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.422+0000 7fb78ffff700 1 --2- 172.21.15.153:0/317675595 >> v2:172.21.15.174:3300/0 conn(0x7fb7900cd2b0 0x7fb7900cd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.422+0000 7fb78ffff700 1 -- 172.21.15.153:0/317675595 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7900cbb50 con 0x7fb7900caeb0 2024-08-17T02:29:18.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.422+0000 7fb794c18700 1 --2- 172.21.15.153:0/317675595 >> v2:172.21.15.174:3300/0 conn(0x7fb7900cd2b0 0x7fb7900cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:18.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.422+0000 7fb78ffff700 1 --2- 172.21.15.153:0/317675595 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7900caeb0 0x7fb7900ce460 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb79008a610 tx=0x7fb780009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d64754d2f109ea47 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:18.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.422+0000 7fb78f7fe700 1 -- 172.21.15.153:0/317675595 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb780009e70 con 0x7fb7900caeb0 2024-08-17T02:29:18.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.422+0000 7fb78f7fe700 1 -- 172.21.15.153:0/317675595 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb78000b860 con 0x7fb7900caeb0 2024-08-17T02:29:18.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.422+0000 7fb78f7fe700 1 -- 172.21.15.153:0/317675595 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78000bc00 con 0x7fb7900caeb0 2024-08-17T02:29:18.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.422+0000 7fb796e7c700 1 -- 172.21.15.153:0/317675595 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7900caeb0 msgr2=0x7fb7900ce460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.422+0000 7fb796e7c700 1 --2- 172.21.15.153:0/317675595 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7900caeb0 0x7fb7900ce460 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb79008a610 tx=0x7fb780009250 comp rx=0 tx=0).stop 2024-08-17T02:29:18.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.422+0000 7fb796e7c700 1 -- 172.21.15.153:0/317675595 shutdown_connections 2024-08-17T02:29:18.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.422+0000 7fb796e7c700 1 --2- 172.21.15.153:0/317675595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7900cb300 0x7fb7900ce9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.422+0000 7fb796e7c700 1 --2- 172.21.15.153:0/317675595 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7900caeb0 0x7fb7900ce460 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.422+0000 7fb796e7c700 1 --2- 172.21.15.153:0/317675595 >> v2:172.21.15.174:3300/0 conn(0x7fb7900cd2b0 0x7fb7900cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.422+0000 7fb796e7c700 1 -- 172.21.15.153:0/317675595 >> 172.21.15.153:0/317675595 conn(0x7fb790099550 msgr2=0x7fb790067590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:18.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.422+0000 7fb796e7c700 1 -- 172.21.15.153:0/317675595 shutdown_connections 2024-08-17T02:29:18.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.422+0000 7fb796e7c700 1 -- 172.21.15.153:0/317675595 wait complete. 2024-08-17T02:29:18.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.426+0000 7fb796e7c700 1 Processor -- start 2024-08-17T02:29:18.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.426+0000 7fb796e7c700 1 -- start start 2024-08-17T02:29:18.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.426+0000 7fb796e7c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7900caeb0 0x7fb7900c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.426+0000 7fb796e7c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7900cb300 0x7fb7900b5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.426+0000 7fb796e7c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7900cd2b0 0x7fb7900688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.426+0000 7fb796e7c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7900b5eb0 con 0x7fb7900cd2b0 2024-08-17T02:29:18.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.426+0000 7fb796e7c700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7900ca230 con 0x7fb7900caeb0 2024-08-17T02:29:18.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.426+0000 7fb796e7c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7900b34f0 con 0x7fb7900cb300 2024-08-17T02:29:18.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.426+0000 7fb795419700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7900cd2b0 0x7fb7900688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.426+0000 7fb795419700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7900cd2b0 0x7fb7900688a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52596/0 (socket says 172.21.15.153:52596) 2024-08-17T02:29:18.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.426+0000 7fb795419700 1 -- 172.21.15.153:0/1674697852 learned_addr learned my addr 172.21.15.153:0/1674697852 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:18.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.426+0000 7fb794c18700 1 --2- 172.21.15.153:0/1674697852 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7900caeb0 0x7fb7900c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.426+0000 7fb78ffff700 1 --2- 172.21.15.153:0/1674697852 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7900cb300 0x7fb7900b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.426+0000 7fb795419700 1 -- 172.21.15.153:0/1674697852 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7900cb300 msgr2=0x7fb7900b5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.426+0000 7fb795419700 1 --2- 172.21.15.153:0/1674697852 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7900cb300 0x7fb7900b5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.426+0000 7fb795419700 1 -- 172.21.15.153:0/1674697852 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7900caeb0 msgr2=0x7fb7900c95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.426+0000 7fb795419700 1 --2- 172.21.15.153:0/1674697852 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7900caeb0 0x7fb7900c95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.426+0000 7fb795419700 1 -- 172.21.15.153:0/1674697852 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7800094f0 con 0x7fb7900cd2b0 2024-08-17T02:29:18.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.426+0000 7fb794c18700 1 --2- 172.21.15.153:0/1674697852 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7900caeb0 0x7fb7900c95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:18.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.430+0000 7fb795419700 1 --2- 172.21.15.153:0/1674697852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7900cd2b0 0x7fb7900688a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb788009df0 tx=0x7fb78800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:18.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.430+0000 7fb78cff9700 1 -- 172.21.15.153:0/1674697852 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78800cb50 con 0x7fb7900cd2b0 2024-08-17T02:29:18.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.430+0000 7fb78cff9700 1 -- 172.21.15.153:0/1674697852 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb78800f040 con 0x7fb7900cd2b0 2024-08-17T02:29:18.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.430+0000 7fb796e7c700 1 -- 172.21.15.153:0/1674697852 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7900c9c70 con 0x7fb7900cd2b0 2024-08-17T02:29:18.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.430+0000 7fb78cff9700 1 -- 172.21.15.153:0/1674697852 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb788014480 con 0x7fb7900cd2b0 2024-08-17T02:29:18.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.430+0000 7fb796e7c700 1 -- 172.21.15.153:0/1674697852 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7900b3180 con 0x7fb7900cd2b0 2024-08-17T02:29:18.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.430+0000 7fb796e7c700 1 -- 172.21.15.153:0/1674697852 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7900b3660 con 0x7fb7900cd2b0 2024-08-17T02:29:18.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.430+0000 7fb78cff9700 1 -- 172.21.15.153:0/1674697852 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb788014830 con 0x7fb7900cd2b0 2024-08-17T02:29:18.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.430+0000 7fb78cff9700 1 --2- 172.21.15.153:0/1674697852 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb77c060860 0x7fb77c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.434+0000 7fb78cff9700 1 -- 172.21.15.153:0/1674697852 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6251+0+0 (secure 0 0 0) 0x7fb78807d6e0 con 0x7fb7900cd2b0 2024-08-17T02:29:18.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.434+0000 7fb794c18700 1 --2- 172.21.15.153:0/1674697852 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb77c060860 0x7fb77c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.434+0000 7fb794c18700 1 --2- 172.21.15.153:0/1674697852 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb77c060860 0x7fb77c062d10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb784006f00 tx=0x7fb784008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:18.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.438+0000 7fb78cff9700 1 -- 172.21.15.153:0/1674697852 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb78804d910 con 0x7fb7900cd2b0 2024-08-17T02:29:18.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:18.602+0000 7fb796e7c700 1 -- 172.21.15.153:0/1674697852 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb7900638f0 con 0x7fb7900cd2b0 2024-08-17T02:29:19.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.298+0000 7fb78cff9700 1 -- 172.21.15.153:0/1674697852 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v40) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb788050f30 con 0x7fb7900cd2b0 2024-08-17T02:29:19.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.302+0000 7fb796e7c700 1 -- 172.21.15.153:0/1674697852 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb77c060860 msgr2=0x7fb77c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.302+0000 7fb796e7c700 1 --2- 172.21.15.153:0/1674697852 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb77c060860 0x7fb77c062d10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb784006f00 tx=0x7fb784008040 comp rx=0 tx=0).stop 2024-08-17T02:29:19.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.302+0000 7fb796e7c700 1 -- 172.21.15.153:0/1674697852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7900cd2b0 msgr2=0x7fb7900688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.302+0000 7fb796e7c700 1 --2- 172.21.15.153:0/1674697852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7900cd2b0 0x7fb7900688a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb788009df0 tx=0x7fb78800b040 comp rx=0 tx=0).stop 2024-08-17T02:29:19.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.306+0000 7fb796e7c700 1 -- 172.21.15.153:0/1674697852 shutdown_connections 2024-08-17T02:29:19.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.306+0000 7fb796e7c700 1 --2- 172.21.15.153:0/1674697852 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb77c060860 0x7fb77c062d10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.306+0000 7fb796e7c700 1 --2- 172.21.15.153:0/1674697852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7900cd2b0 0x7fb7900688a0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.308 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.306+0000 7fb796e7c700 1 --2- 172.21.15.153:0/1674697852 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7900cb300 0x7fb7900b5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.308 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.306+0000 7fb796e7c700 1 --2- 172.21.15.153:0/1674697852 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7900caeb0 0x7fb7900c95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.308 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.306+0000 7fb796e7c700 1 -- 172.21.15.153:0/1674697852 >> 172.21.15.153:0/1674697852 conn(0x7fb790099550 msgr2=0x7fb7900acdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:19.308 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.306+0000 7fb796e7c700 1 -- 172.21.15.153:0/1674697852 shutdown_connections 2024-08-17T02:29:19.308 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.306+0000 7fb796e7c700 1 -- 172.21.15.153:0/1674697852 wait complete. 2024-08-17T02:29:19.308 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' removed 2024-08-17T02:29:19.320 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:19.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.418+0000 7fbff209c700 1 Processor -- start 2024-08-17T02:29:19.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.418+0000 7fbff209c700 1 -- start start 2024-08-17T02:29:19.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.422+0000 7fbff209c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbfec154900 0x7fbfec0b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.422+0000 7fbff209c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbfec0b12d0 0x7fbfec0cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.422+0000 7fbff209c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfec0cb390 0x7fbfec06df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.422+0000 7fbff209c700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfec068790 con 0x7fbfec154900 2024-08-17T02:29:19.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.422+0000 7fbff209c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfec1583f0 con 0x7fbfec0b12d0 2024-08-17T02:29:19.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.422+0000 7fbff209c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfec0b1730 con 0x7fbfec0cb390 2024-08-17T02:29:19.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.422+0000 7fbff109a700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbfec154900 0x7fbfec0b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.422+0000 7fbff109a700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbfec154900 0x7fbfec0b0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52602/0 (socket says 172.21.15.153:52602) 2024-08-17T02:29:19.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.422+0000 7fbff109a700 1 -- 172.21.15.153:0/565799993 learned_addr learned my addr 172.21.15.153:0/565799993 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:19.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.422+0000 7fbff0899700 1 --2- 172.21.15.153:0/565799993 >> v2:172.21.15.174:3300/0 conn(0x7fbfec0b12d0 0x7fbfec0cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.422+0000 7fbff189b700 1 --2- 172.21.15.153:0/565799993 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfec0cb390 0x7fbfec06df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.422+0000 7fbff109a700 1 -- 172.21.15.153:0/565799993 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfec0cb390 msgr2=0x7fbfec06df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:19.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.422+0000 7fbff109a700 1 --2- 172.21.15.153:0/565799993 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfec0cb390 0x7fbfec06df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.422+0000 7fbff109a700 1 -- 172.21.15.153:0/565799993 >> v2:172.21.15.174:3300/0 conn(0x7fbfec0b12d0 msgr2=0x7fbfec0cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:19.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.422+0000 7fbff109a700 1 --2- 172.21.15.153:0/565799993 >> v2:172.21.15.174:3300/0 conn(0x7fbfec0b12d0 0x7fbfec0cae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.422+0000 7fbff109a700 1 -- 172.21.15.153:0/565799993 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfec0cbaa0 con 0x7fbfec154900 2024-08-17T02:29:19.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.422+0000 7fbff109a700 1 --2- 172.21.15.153:0/565799993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfec154900 0x7fbfec0b0d90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fbfec06f390 tx=0x7fbfe0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdeba476fb493f66 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:19.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.422+0000 7fbfdffff700 1 -- 172.21.15.153:0/565799993 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe000b640 con 0x7fbfec154900 2024-08-17T02:29:19.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.422+0000 7fbfdffff700 1 -- 172.21.15.153:0/565799993 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe000b7a0 con 0x7fbfec154900 2024-08-17T02:29:19.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.422+0000 7fbfdffff700 1 -- 172.21.15.153:0/565799993 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe000bb60 con 0x7fbfec154900 2024-08-17T02:29:19.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.422+0000 7fbff209c700 1 -- 172.21.15.153:0/565799993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfec154900 msgr2=0x7fbfec0b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.422+0000 7fbff209c700 1 --2- 172.21.15.153:0/565799993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfec154900 0x7fbfec0b0d90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fbfec06f390 tx=0x7fbfe0009250 comp rx=0 tx=0).stop 2024-08-17T02:29:19.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.422+0000 7fbff209c700 1 -- 172.21.15.153:0/565799993 shutdown_connections 2024-08-17T02:29:19.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.422+0000 7fbff209c700 1 --2- 172.21.15.153:0/565799993 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfec0cb390 0x7fbfec06df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.422+0000 7fbff209c700 1 --2- 172.21.15.153:0/565799993 >> v2:172.21.15.174:3300/0 conn(0x7fbfec0b12d0 0x7fbfec0cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.422+0000 7fbff209c700 1 --2- 172.21.15.153:0/565799993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfec154900 0x7fbfec0b0d90 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.422+0000 7fbff209c700 1 -- 172.21.15.153:0/565799993 >> 172.21.15.153:0/565799993 conn(0x7fbfec0678d0 msgr2=0x7fbfec067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:19.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.422+0000 7fbff209c700 1 -- 172.21.15.153:0/565799993 shutdown_connections 2024-08-17T02:29:19.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.422+0000 7fbff209c700 1 -- 172.21.15.153:0/565799993 wait complete. 2024-08-17T02:29:19.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.426+0000 7fbff209c700 1 Processor -- start 2024-08-17T02:29:19.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.426+0000 7fbff209c700 1 -- start start 2024-08-17T02:29:19.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.426+0000 7fbff209c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbfec0b12d0 0x7fbfec1508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.426+0000 7fbff209c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfec0cb390 0x7fbfec069f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.426+0000 7fbff209c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfec154900 0x7fbfec06a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.426+0000 7fbff209c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfec15a970 con 0x7fbfec0cb390 2024-08-17T02:29:19.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.426+0000 7fbff209c700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfec15b210 con 0x7fbfec0b12d0 2024-08-17T02:29:19.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.426+0000 7fbff209c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfec150e10 con 0x7fbfec154900 2024-08-17T02:29:19.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.426+0000 7fbff0899700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfec0cb390 0x7fbfec069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.426+0000 7fbff0899700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfec0cb390 0x7fbfec069f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52618/0 (socket says 172.21.15.153:52618) 2024-08-17T02:29:19.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.426+0000 7fbff0899700 1 -- 172.21.15.153:0/3071412803 learned_addr learned my addr 172.21.15.153:0/3071412803 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:19.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.426+0000 7fbff109a700 1 --2- 172.21.15.153:0/3071412803 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbfec0b12d0 0x7fbfec1508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.426+0000 7fbff189b700 1 --2- 172.21.15.153:0/3071412803 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfec154900 0x7fbfec06a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.426+0000 7fbff0899700 1 -- 172.21.15.153:0/3071412803 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfec154900 msgr2=0x7fbfec06a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.426+0000 7fbff0899700 1 --2- 172.21.15.153:0/3071412803 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfec154900 0x7fbfec06a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.426+0000 7fbff0899700 1 -- 172.21.15.153:0/3071412803 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbfec0b12d0 msgr2=0x7fbfec1508d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.426+0000 7fbff0899700 1 --2- 172.21.15.153:0/3071412803 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbfec0b12d0 0x7fbfec1508d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.426+0000 7fbff0899700 1 -- 172.21.15.153:0/3071412803 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe00094f0 con 0x7fbfec0cb390 2024-08-17T02:29:19.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.426+0000 7fbff109a700 1 --2- 172.21.15.153:0/3071412803 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbfec0b12d0 0x7fbfec1508d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:19.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.426+0000 7fbff0899700 1 --2- 172.21.15.153:0/3071412803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfec0cb390 0x7fbfec069f10 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fbfe800ecb0 tx=0x7fbfe80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:19.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.426+0000 7fbfdd7fa700 1 -- 172.21.15.153:0/3071412803 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe800c9d0 con 0x7fbfec0cb390 2024-08-17T02:29:19.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.426+0000 7fbfdd7fa700 1 -- 172.21.15.153:0/3071412803 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe800cb30 con 0x7fbfec0cb390 2024-08-17T02:29:19.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.426+0000 7fbfdd7fa700 1 -- 172.21.15.153:0/3071412803 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe800ced0 con 0x7fbfec0cb390 2024-08-17T02:29:19.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.426+0000 7fbff209c700 1 -- 172.21.15.153:0/3071412803 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfec15cad0 con 0x7fbfec0cb390 2024-08-17T02:29:19.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.426+0000 7fbff209c700 1 -- 172.21.15.153:0/3071412803 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfec15aea0 con 0x7fbfec0cb390 2024-08-17T02:29:19.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.430+0000 7fbff209c700 1 -- 172.21.15.153:0/3071412803 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfec15b3a0 con 0x7fbfec0cb390 2024-08-17T02:29:19.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.430+0000 7fbfdd7fa700 1 -- 172.21.15.153:0/3071412803 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fbfe8013680 con 0x7fbfec0cb390 2024-08-17T02:29:19.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.430+0000 7fbfdd7fa700 1 --2- 172.21.15.153:0/3071412803 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fbfd0060890 0x7fbfd0062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.430+0000 7fbff109a700 1 --2- 172.21.15.153:0/3071412803 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fbfd0060890 0x7fbfd0062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.430+0000 7fbfdd7fa700 1 -- 172.21.15.153:0/3071412803 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fbfe807cf20 con 0x7fbfec0cb390 2024-08-17T02:29:19.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.430+0000 7fbff109a700 1 --2- 172.21.15.153:0/3071412803 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fbfd0060890 0x7fbfd0062d40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbfec06f390 tx=0x7fbfe0017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:19.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.438+0000 7fbfdd7fa700 1 -- 172.21.15.153:0/3071412803 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fbfe804d2f0 con 0x7fbfec0cb390 2024-08-17T02:29:19.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.602+0000 7fbff209c700 1 -- 172.21.15.153:0/3071412803 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbfec0643a0 con 0x7fbfec0cb390 2024-08-17T02:29:19.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.606+0000 7fbfdd7fa700 1 -- 172.21.15.153:0/3071412803 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+15562 (secure 0 0 0) 0x7fbfe8050910 con 0x7fbfec0cb390 2024-08-17T02:29:19.608 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:29:19.608 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":40,"fsid":"56d41c33-b929-456d-96be-2aac4ecd299d","created":"2024-08-17T02:25:47.756085+0000","modified":"2024-08-17T02:29:19.284456+0000","last_up_change":"2024-08-17T02:25:58.643690+0000","last_in_change":"2024-08-17T02:25:49.809186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:58.093273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000118573.meta","create_time":"2024-08-17T02:27:08.568651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000118573"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000118573.data","create_time":"2024-08-17T02:27:08.668955+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000118573"}}}],"osds":[{"osd":0,"uuid":"0736f8e6-818e-42e6-a0dc-8aaf813315d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":24234},{"type":"v1","addr":"172.21.15.153:6817","nonce":24234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":24234},{"type":"v1","addr":"172.21.15.153:6819","nonce":24234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":24234},{"type":"v1","addr":"172.21.15.153:6823","nonce":24234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":24234},{"type":"v1","addr":"172.21.15.153:6821","nonce":24234}]},"public_addr":"172.21.15.153:6817/24234","cluster_addr":"172.21.15.153:6819/24234","heartbeat_back_addr":"172.21.15.153:6823/24234","heartbeat_front_addr":"172.21.15.153:6821/24234","state":["exists","up"]},{"osd":1,"uuid":"011762e9-6c2d-441a-aa56-68474639d72f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":24232},{"type":"v1","addr":"172.21.15.153:6801","nonce":24232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":24232},{"type":"v1","addr":"172.21.15.153:6803","nonce":24232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":24232},{"type":"v1","addr":"172.21.15.153:6809","nonce":24232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":24232},{"type":"v1","addr":"172.21.15.153:6806","nonce":24232}]},"public_addr":"172.21.15.153:6801/24232","cluster_addr":"172.21.15.153:6803/24232","heartbeat_back_addr":"172.21.15.153:6809/24232","heartbeat_front_addr":"172.21.15.153:6806/24232","state":["exists","up"]},{"osd":2,"uuid":"b562cd97-aa12-455e-b46a-e720a2ec9d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":24235},{"type":"v1","addr":"172.21.15.153:6808","nonce":24235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":24235},{"type":"v1","addr":"172.21.15.153:6811","nonce":24235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":24235},{"type":"v1","addr":"172.21.15.153:6815","nonce":24235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":24235},{"type":"v1","addr":"172.21.15.153:6813","nonce":24235}]},"public_addr":"172.21.15.153:6808/24235","cluster_addr":"172.21.15.153:6811/24235","heartbeat_back_addr":"172.21.15.153:6815/24235","heartbeat_front_addr":"172.21.15.153:6813/24235","state":["exists","up"]},{"osd":3,"uuid":"222da52f-90c2-4132-a5d2-6f6cf83d4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":24236},{"type":"v1","addr":"172.21.15.153:6825","nonce":24236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":24236},{"type":"v1","addr":"172.21.15.153:6827","nonce":24236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":24236},{"type":"v1","addr":"172.21.15.153:6831","nonce":24236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":24236},{"type":"v1","addr":"172.21.15.153:6829","nonce":24236}]},"public_addr":"172.21.15.153:6825/24236","cluster_addr":"172.21.15.153:6827/24236","heartbeat_back_addr":"172.21.15.153:6831/24236","heartbeat_front_addr":"172.21.15.153:6829/24236","state":["exists","up"]},{"osd":4,"uuid":"a38a04cd-032b-4977-a260-1ef3567d0c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24456},{"type":"v1","addr":"172.21.15.174:6809","nonce":24456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24456},{"type":"v1","addr":"172.21.15.174:6811","nonce":24456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24456},{"type":"v1","addr":"172.21.15.174:6815","nonce":24456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24456},{"type":"v1","addr":"172.21.15.174:6813","nonce":24456}]},"public_addr":"172.21.15.174:6809/24456","cluster_addr":"172.21.15.174:6811/24456","heartbeat_back_addr":"172.21.15.174:6815/24456","heartbeat_front_addr":"172.21.15.174:6813/24456","state":["exists","up"]},{"osd":5,"uuid":"c7778084-e751-48da-87a1-ab8bbe85aa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24457},{"type":"v1","addr":"172.21.15.174:6825","nonce":24457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24457},{"type":"v1","addr":"172.21.15.174:6827","nonce":24457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24457},{"type":"v1","addr":"172.21.15.174:6831","nonce":24457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24457},{"type":"v1","addr":"172.21.15.174:6829","nonce":24457}]},"public_addr":"172.21.15.174:6825/24457","cluster_addr":"172.21.15.174:6827/24457","heartbeat_back_addr":"172.21.15.174:6831/24457","heartbeat_front_addr":"172.21.15.174:6829/24457","state":["exists","up"]},{"osd":6,"uuid":"2d8e0715-254f-442c-9625-50721d0bc858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24477},{"type":"v1","addr":"172.21.15.174:6801","nonce":24477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24477},{"type":"v1","addr":"172.21.15.174:6803","nonce":24477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24477},{"type":"v1","addr":"172.21.15.174:6807","nonce":24477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24477},{"type":"v1","addr":"172.21.15.174:6805","nonce":24477}]},"public_addr":"172.21.15.174:6801/24477","cluster_addr":"172.21.15.174:6803/24477","heartbeat_back_addr":"172.21.15.174:6807/24477","heartbeat_front_addr":"172.21.15.174:6805/24477","state":["exists","up"]},{"osd":7,"uuid":"dffda25a-4601-4ddb-9a27-b0be1cadde27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24455},{"type":"v1","addr":"172.21.15.174:6817","nonce":24455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24455},{"type":"v1","addr":"172.21.15.174:6819","nonce":24455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24455},{"type":"v1","addr":"172.21.15.174:6823","nonce":24455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24455},{"type":"v1","addr":"172.21.15.174:6821","nonce":24455}]},"public_addr":"172.21.15.174:6817/24455","cluster_addr":"172.21.15.174:6819/24455","heartbeat_back_addr":"172.21.15.174:6823/24455","heartbeat_front_addr":"172.21.15.174:6821/24455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.990117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.033862+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.748087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.112877+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.070448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.360961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.110940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.226377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.153:6837/2567193475":"2024-08-18T02:29:16.167908+0000","172.21.15.153:6836/2567193475":"2024-08-18T02:29:16.167908+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:19.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.606+0000 7fbff209c700 1 -- 172.21.15.153:0/3071412803 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fbfd0060890 msgr2=0x7fbfd0062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.606+0000 7fbff209c700 1 --2- 172.21.15.153:0/3071412803 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fbfd0060890 0x7fbfd0062d40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbfec06f390 tx=0x7fbfe0017000 comp rx=0 tx=0).stop 2024-08-17T02:29:19.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.606+0000 7fbff209c700 1 -- 172.21.15.153:0/3071412803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfec0cb390 msgr2=0x7fbfec069f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.606+0000 7fbff209c700 1 --2- 172.21.15.153:0/3071412803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfec0cb390 0x7fbfec069f10 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fbfe800ecb0 tx=0x7fbfe80091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.606+0000 7fbff209c700 1 -- 172.21.15.153:0/3071412803 shutdown_connections 2024-08-17T02:29:19.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.606+0000 7fbff209c700 1 --2- 172.21.15.153:0/3071412803 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fbfd0060890 0x7fbfd0062d40 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.606+0000 7fbff209c700 1 --2- 172.21.15.153:0/3071412803 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfec154900 0x7fbfec06a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.606+0000 7fbff209c700 1 --2- 172.21.15.153:0/3071412803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfec0cb390 0x7fbfec069f10 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.606+0000 7fbff209c700 1 --2- 172.21.15.153:0/3071412803 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbfec0b12d0 0x7fbfec1508d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.606+0000 7fbff209c700 1 -- 172.21.15.153:0/3071412803 >> 172.21.15.153:0/3071412803 conn(0x7fbfec0678d0 msgr2=0x7fbfec06cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:19.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.606+0000 7fbff209c700 1 -- 172.21.15.153:0/3071412803 shutdown_connections 2024-08-17T02:29:19.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.606+0000 7fbff209c700 1 -- 172.21.15.153:0/3071412803 wait complete. 2024-08-17T02:29:19.626 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:58.093273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000000118573.meta', 'create_time': '2024-08-17T02:27:08.568651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000118573'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000000118573.data', 'create_time': '2024-08-17T02:27:08.668955+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000118573'}}}] 2024-08-17T02:29:19.626 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:29:19.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.738+0000 7f7bf359e700 1 Processor -- start 2024-08-17T02:29:19.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.738+0000 7f7bf359e700 1 -- start start 2024-08-17T02:29:19.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.738+0000 7f7bf359e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7bf4156ed0 0x7f7bf40afed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.738+0000 7f7bf359e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bf40afa40 con 0x7f7bf40b35e0 2024-08-17T02:29:19.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.738+0000 7f7bf359e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bf40aee30 con 0x7f7bf40b0de0 2024-08-17T02:29:19.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.738+0000 7f7bf359e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf40af110 con 0x7f7bf4156ed0 2024-08-17T02:29:19.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.738+0000 7f7bf2d9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f7bf40b35e0 0x7f7bf40cba00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35528/0 (socket says 172.21.15.153:35528) 2024-08-17T02:29:19.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.738+0000 7f7bf2d9d700 1 -- 172.21.15.153:0/345468911 learned_addr learned my addr 172.21.15.153:0/345468911 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:29:19.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.738+0000 7f7bf159a700 1 -- 172.21.15.153:0/345468911 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 419488956 0 0) 0x7f7bf40afa40 con 0x7f7bf40b35e0 2024-08-17T02:29:19.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.738+0000 7f7bf259c700 1 --2- 172.21.15.153:0/345468911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7bf4156ed0 0x7f7bf40afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.738+0000 7f7bf159a700 1 -- 172.21.15.153:0/345468911 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bdc003570 con 0x7f7bf40b35e0 2024-08-17T02:29:19.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.738+0000 7f7bf159a700 1 -- 172.21.15.153:0/345468911 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4022116940 0 0) 0x7f7bdc003570 con 0x7f7bf40b35e0 2024-08-17T02:29:19.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.738+0000 7f7bf159a700 1 -- 172.21.15.153:0/345468911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7bf4156ed0 msgr2=0x7f7bf40afed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:19.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.738+0000 7f7bf159a700 1 --2- 172.21.15.153:0/345468911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7bf4156ed0 0x7f7bf40afed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.738+0000 7f7bf159a700 1 -- 172.21.15.153:0/345468911 >> v1:172.21.15.174:6789/0 conn(0x7f7bf40b0de0 legacy=0x7f7bf40b2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.738+0000 7f7bf159a700 1 -- 172.21.15.153:0/345468911 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf40af3f0 con 0x7f7bf40b35e0 2024-08-17T02:29:19.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.738+0000 7f7bf159a700 1 -- 172.21.15.153:0/345468911 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3701463666 0 0) 0x7f7bec0017f0 con 0x7f7bf40b35e0 2024-08-17T02:29:19.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.738+0000 7f7bf159a700 1 -- 172.21.15.153:0/345468911 >> v1:172.21.15.153:6789/0 conn(0x7f7bf40b35e0 legacy=0x7f7bf40cba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.738+0000 7f7bf159a700 1 --2- 172.21.15.153:0/345468911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7bf4156ed0 0x7f7bdc003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.738+0000 7f7bf159a700 1 --2- 172.21.15.153:0/345468911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bdc003fd0 0x7f7bdc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.738+0000 7f7bf159a700 1 --2- 172.21.15.153:0/345468911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7bdc004d50 0x7f7bdc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.738+0000 7f7bf159a700 1 -- 172.21.15.153:0/345468911 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf40af110 con 0x7f7bdc003fd0 2024-08-17T02:29:19.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.738+0000 7f7bf159a700 1 -- 172.21.15.153:0/345468911 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc00bb40 con 0x7f7bdc004d50 2024-08-17T02:29:19.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.738+0000 7f7bf159a700 1 -- 172.21.15.153:0/345468911 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc00bd00 con 0x7f7bf4156ed0 2024-08-17T02:29:19.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.738+0000 7f7bf259c700 1 --2- 172.21.15.153:0/345468911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7bf4156ed0 0x7f7bdc003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.738+0000 7f7bf2d9d700 1 --2- 172.21.15.153:0/345468911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7bdc004d50 0x7f7bdc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.738+0000 7f7bf1d9b700 1 --2- 172.21.15.153:0/345468911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bdc003fd0 0x7f7bdc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.738+0000 7f7bf259c700 1 -- 172.21.15.153:0/345468911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7bdc004d50 msgr2=0x7f7bdc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:19.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.738+0000 7f7bf259c700 1 --2- 172.21.15.153:0/345468911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7bdc004d50 0x7f7bdc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.738+0000 7f7bf259c700 1 -- 172.21.15.153:0/345468911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bdc003fd0 msgr2=0x7f7bdc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:19.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.738+0000 7f7bf259c700 1 --2- 172.21.15.153:0/345468911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bdc003fd0 0x7f7bdc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.738+0000 7f7bf259c700 1 -- 172.21.15.153:0/345468911 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bdc003570 con 0x7f7bf4156ed0 2024-08-17T02:29:19.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.742+0000 7f7bf259c700 1 --2- 172.21.15.153:0/345468911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7bf4156ed0 0x7f7bdc003a90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7be8009c00 tx=0x7f7be80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23540cdeb8e23b5a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:19.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.742+0000 7f7bf159a700 1 -- 172.21.15.153:0/345468911 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be800e710 con 0x7f7bf4156ed0 2024-08-17T02:29:19.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.742+0000 7f7bf159a700 1 -- 172.21.15.153:0/345468911 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be800e870 con 0x7f7bf4156ed0 2024-08-17T02:29:19.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.742+0000 7f7bf159a700 1 -- 172.21.15.153:0/345468911 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be800ec30 con 0x7f7bf4156ed0 2024-08-17T02:29:19.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.742+0000 7f7bf359e700 1 -- 172.21.15.153:0/345468911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7bf4156ed0 msgr2=0x7f7bdc003a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.742+0000 7f7bf359e700 1 --2- 172.21.15.153:0/345468911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7bf4156ed0 0x7f7bdc003a90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7be8009c00 tx=0x7f7be80091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.742+0000 7f7bf2d9d700 1 -- 172.21.15.153:0/345468911 reap_dead start 2024-08-17T02:29:19.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.742+0000 7f7bf359e700 1 -- 172.21.15.153:0/345468911 shutdown_connections 2024-08-17T02:29:19.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.742+0000 7f7bf359e700 1 -- 172.21.15.153:0/345468911 >> 172.21.15.153:0/345468911 conn(0x7f7bf40ce990 msgr2=0x7f7bf406c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:19.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.742+0000 7f7bf359e700 1 -- 172.21.15.153:0/345468911 shutdown_connections 2024-08-17T02:29:19.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.742+0000 7f7bf359e700 1 -- 172.21.15.153:0/345468911 wait complete. 2024-08-17T02:29:19.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.742+0000 7f7bf359e700 1 Processor -- start 2024-08-17T02:29:19.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.742+0000 7f7bf359e700 1 -- start start 2024-08-17T02:29:19.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.746+0000 7f7bf359e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bf4156ed0 0x7f7bf41515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.746+0000 7f7bf359e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7bf4166d40 0x7f7bf4152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.746+0000 7f7bf359e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7bf41671b0 0x7f7bf4153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.746+0000 7f7bf359e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf41594c0 con 0x7f7bf4156ed0 2024-08-17T02:29:19.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.746+0000 7f7bf359e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf4158b90 con 0x7f7bf41671b0 2024-08-17T02:29:19.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.746+0000 7f7bf359e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf4158e70 con 0x7f7bf4166d40 2024-08-17T02:29:19.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.746+0000 7f7bf259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bf4156ed0 0x7f7bf41515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.746+0000 7f7bf259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bf4156ed0 0x7f7bf41515e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52634/0 (socket says 172.21.15.153:52634) 2024-08-17T02:29:19.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.746+0000 7f7bf259c700 1 -- 172.21.15.153:0/1701866458 learned_addr learned my addr 172.21.15.153:0/1701866458 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:19.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.746+0000 7f7bf1d9b700 1 --2- 172.21.15.153:0/1701866458 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7bf4166d40 0x7f7bf4152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.746+0000 7f7bf2d9d700 1 --2- 172.21.15.153:0/1701866458 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7bf41671b0 0x7f7bf4153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.749 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.746+0000 7f7bf259c700 1 -- 172.21.15.153:0/1701866458 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7bf4166d40 msgr2=0x7f7bf4152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.749 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.746+0000 7f7bf259c700 1 --2- 172.21.15.153:0/1701866458 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7bf4166d40 0x7f7bf4152f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.749 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.746+0000 7f7bf259c700 1 -- 172.21.15.153:0/1701866458 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7bf41671b0 msgr2=0x7f7bf4153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.749 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.746+0000 7f7bf259c700 1 --2- 172.21.15.153:0/1701866458 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7bf41671b0 0x7f7bf4153480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.749 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.746+0000 7f7bf259c700 1 -- 172.21.15.153:0/1701866458 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf4159150 con 0x7f7bf4156ed0 2024-08-17T02:29:19.749 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.746+0000 7f7bf259c700 1 --2- 172.21.15.153:0/1701866458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bf4156ed0 0x7f7bf41515e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc00be90 tx=0x7f7be801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:19.749 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.746+0000 7f7be27fc700 1 -- 172.21.15.153:0/1701866458 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be8022070 con 0x7f7bf4156ed0 2024-08-17T02:29:19.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.746+0000 7f7be27fc700 1 -- 172.21.15.153:0/1701866458 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be800ebf0 con 0x7f7bf4156ed0 2024-08-17T02:29:19.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.746+0000 7f7bf359e700 1 -- 172.21.15.153:0/1701866458 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf4151b20 con 0x7f7bf4156ed0 2024-08-17T02:29:19.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.746+0000 7f7be27fc700 1 -- 172.21.15.153:0/1701866458 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be801c680 con 0x7f7bf4156ed0 2024-08-17T02:29:19.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.746+0000 7f7bf359e700 1 -- 172.21.15.153:0/1701866458 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf4157ba0 con 0x7f7bf4156ed0 2024-08-17T02:29:19.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.746+0000 7f7bf359e700 1 -- 172.21.15.153:0/1701866458 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bf4064330 con 0x7f7bf4156ed0 2024-08-17T02:29:19.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.750+0000 7f7be27fc700 1 -- 172.21.15.153:0/1701866458 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7be801cab0 con 0x7f7bf4156ed0 2024-08-17T02:29:19.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.750+0000 7f7be27fc700 1 --2- 172.21.15.153:0/1701866458 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7bd4060890 0x7f7bd4062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.750+0000 7f7bf1d9b700 1 --2- 172.21.15.153:0/1701866458 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7bd4060890 0x7f7bd4062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.750+0000 7f7be27fc700 1 -- 172.21.15.153:0/1701866458 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f7be807e360 con 0x7f7bf4156ed0 2024-08-17T02:29:19.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.750+0000 7f7bf1d9b700 1 --2- 172.21.15.153:0/1701866458 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7bd4060890 0x7f7bd4062d40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4156b00 tx=0x7f7be4007d10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:19.760 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.758+0000 7f7be27fc700 1 -- 172.21.15.153:0/1701866458 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f7be804e800 con 0x7f7bf4156ed0 2024-08-17T02:29:19.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.934+0000 7f7bf359e700 1 -- 172.21.15.153:0/1701866458 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7bf40ae460 con 0x7f7bf4156ed0 2024-08-17T02:29:19.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.934+0000 7f7be27fc700 1 -- 172.21.15.153:0/1701866458 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7be8017020 con 0x7f7bf4156ed0 2024-08-17T02:29:19.937 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2024-08-17T02:29:19.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.938+0000 7f7bf359e700 1 -- 172.21.15.153:0/1701866458 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7bd4060890 msgr2=0x7f7bd4062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.938+0000 7f7bf359e700 1 --2- 172.21.15.153:0/1701866458 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7bd4060890 0x7f7bd4062d40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4156b00 tx=0x7f7be4007d10 comp rx=0 tx=0).stop 2024-08-17T02:29:19.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.938+0000 7f7bf359e700 1 -- 172.21.15.153:0/1701866458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bf4156ed0 msgr2=0x7f7bf41515e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.938+0000 7f7bf359e700 1 --2- 172.21.15.153:0/1701866458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bf4156ed0 0x7f7bf41515e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc00be90 tx=0x7f7be801a000 comp rx=0 tx=0).stop 2024-08-17T02:29:19.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.938+0000 7f7bf359e700 1 -- 172.21.15.153:0/1701866458 shutdown_connections 2024-08-17T02:29:19.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.938+0000 7f7bf359e700 1 --2- 172.21.15.153:0/1701866458 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7bd4060890 0x7f7bd4062d40 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.938+0000 7f7bf359e700 1 --2- 172.21.15.153:0/1701866458 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7bf41671b0 0x7f7bf4153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.938+0000 7f7bf359e700 1 --2- 172.21.15.153:0/1701866458 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7bf4166d40 0x7f7bf4152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.938+0000 7f7bf359e700 1 --2- 172.21.15.153:0/1701866458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bf4156ed0 0x7f7bf41515e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.938+0000 7f7bf359e700 1 -- 172.21.15.153:0/1701866458 >> 172.21.15.153:0/1701866458 conn(0x7f7bf40ce990 msgr2=0x7f7bf4155c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:19.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.938+0000 7f7bf359e700 1 -- 172.21.15.153:0/1701866458 shutdown_connections 2024-08-17T02:29:19.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:19.938+0000 7f7bf359e700 1 -- 172.21.15.153:0/1701866458 wait complete. 2024-08-17T02:29:19.950 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000118573.meta pg_num 2024-08-17T02:29:20.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.058+0000 7f2f8f1be700 1 Processor -- start 2024-08-17T02:29:20.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.058+0000 7f2f8f1be700 1 -- start start 2024-08-17T02:29:20.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.062+0000 7f2f8f1be700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2f88067510 0x7f2f880ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.062+0000 7f2f8f1be700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2f88159480 0x7f2f880cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.062+0000 7f2f8f1be700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f880ce210 con 0x7f2f881590b0 2024-08-17T02:29:20.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.062+0000 7f2f8f1be700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f880cba00 con 0x7f2f88159480 2024-08-17T02:29:20.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.062+0000 7f2f8f1be700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f880cdc90 con 0x7f2f88067510 2024-08-17T02:29:20.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.062+0000 7f2f8e9bd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2f88159480 0x7f2f880cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.062+0000 7f2f8e1bc700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f2f881590b0 0x7f2f88066e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35538/0 (socket says 172.21.15.153:35538) 2024-08-17T02:29:20.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.062+0000 7f2f8e9bd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2f88159480 0x7f2f880cebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52636/0 (socket says 172.21.15.153:52636) 2024-08-17T02:29:20.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.062+0000 7f2f8e9bd700 1 -- 172.21.15.153:0/4103049144 learned_addr learned my addr 172.21.15.153:0/4103049144 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:20.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.062+0000 7f2f8d9bb700 1 --2- 172.21.15.153:0/4103049144 >> v2:172.21.15.174:3300/0 conn(0x7f2f88067510 0x7f2f880ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.062+0000 7f2f8e9bd700 1 -- 172.21.15.153:0/4103049144 >> v2:172.21.15.174:3300/0 conn(0x7f2f88067510 msgr2=0x7f2f880ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:20.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.062+0000 7f2f8e9bd700 1 --2- 172.21.15.153:0/4103049144 >> v2:172.21.15.174:3300/0 conn(0x7f2f88067510 0x7f2f880ce6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.062+0000 7f2f8e9bd700 1 -- 172.21.15.153:0/4103049144 >> v1:172.21.15.153:6789/0 conn(0x7f2f881590b0 legacy=0x7f2f88066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.062+0000 7f2f8e9bd700 1 -- 172.21.15.153:0/4103049144 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f880cb440 con 0x7f2f88159480 2024-08-17T02:29:20.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.062+0000 7f2f8e9bd700 1 --2- 172.21.15.153:0/4103049144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f88159480 0x7f2f880cebe0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2f88067c20 tx=0x7f2f80009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3377bc2d25e92ac server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:20.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.062+0000 7f2f8d1ba700 1 -- 172.21.15.153:0/4103049144 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8000e070 con 0x7f2f88159480 2024-08-17T02:29:20.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.062+0000 7f2f8d1ba700 1 -- 172.21.15.153:0/4103049144 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8000ba50 con 0x7f2f88159480 2024-08-17T02:29:20.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.062+0000 7f2f8d1ba700 1 -- 172.21.15.153:0/4103049144 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f800092e0 con 0x7f2f88159480 2024-08-17T02:29:20.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.062+0000 7f2f8f1be700 1 -- 172.21.15.153:0/4103049144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f88159480 msgr2=0x7f2f880cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.062+0000 7f2f8f1be700 1 --2- 172.21.15.153:0/4103049144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f88159480 0x7f2f880cebe0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2f88067c20 tx=0x7f2f80009840 comp rx=0 tx=0).stop 2024-08-17T02:29:20.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.062+0000 7f2f8f1be700 1 -- 172.21.15.153:0/4103049144 shutdown_connections 2024-08-17T02:29:20.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.062+0000 7f2f8f1be700 1 --2- 172.21.15.153:0/4103049144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f88159480 0x7f2f880cebe0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.062+0000 7f2f8f1be700 1 --2- 172.21.15.153:0/4103049144 >> v2:172.21.15.174:3300/0 conn(0x7f2f88067510 0x7f2f880ce6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.062+0000 7f2f8f1be700 1 -- 172.21.15.153:0/4103049144 >> 172.21.15.153:0/4103049144 conn(0x7f2f880d0b90 msgr2=0x7f2f880ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:20.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.062+0000 7f2f8f1be700 1 -- 172.21.15.153:0/4103049144 shutdown_connections 2024-08-17T02:29:20.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.062+0000 7f2f8f1be700 1 -- 172.21.15.153:0/4103049144 wait complete. 2024-08-17T02:29:20.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.062+0000 7f2f8f1be700 1 Processor -- start 2024-08-17T02:29:20.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.062+0000 7f2f8f1be700 1 -- start start 2024-08-17T02:29:20.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.066+0000 7f2f8f1be700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f88067510 0x7f2f880b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.066+0000 7f2f8f1be700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2f881590b0 0x7f2f880c7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.066+0000 7f2f8f1be700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f88159480 0x7f2f88156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.066+0000 7f2f8f1be700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f880b4000 con 0x7f2f88159480 2024-08-17T02:29:20.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.066+0000 7f2f8f1be700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f880b4390 con 0x7f2f88067510 2024-08-17T02:29:20.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.066+0000 7f2f8f1be700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f880b3760 con 0x7f2f881590b0 2024-08-17T02:29:20.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.066+0000 7f2f8e9bd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f88159480 0x7f2f88156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.066+0000 7f2f8e1bc700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f88067510 0x7f2f880b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.066+0000 7f2f8e9bd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f88159480 0x7f2f88156c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52646/0 (socket says 172.21.15.153:52646) 2024-08-17T02:29:20.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.066+0000 7f2f8e9bd700 1 -- 172.21.15.153:0/836085626 learned_addr learned my addr 172.21.15.153:0/836085626 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:20.069 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.066+0000 7f2f8d9bb700 1 --2- 172.21.15.153:0/836085626 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2f881590b0 0x7f2f880c7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.069 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.066+0000 7f2f8e9bd700 1 -- 172.21.15.153:0/836085626 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2f881590b0 msgr2=0x7f2f880c7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.069 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.066+0000 7f2f8e9bd700 1 --2- 172.21.15.153:0/836085626 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2f881590b0 0x7f2f880c7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.069 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.066+0000 7f2f8e9bd700 1 -- 172.21.15.153:0/836085626 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f88067510 msgr2=0x7f2f880b2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.069 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.066+0000 7f2f8e9bd700 1 --2- 172.21.15.153:0/836085626 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f88067510 0x7f2f880b2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.069 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.066+0000 7f2f8e9bd700 1 -- 172.21.15.153:0/836085626 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f80009ae0 con 0x7f2f88159480 2024-08-17T02:29:20.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.066+0000 7f2f8e9bd700 1 --2- 172.21.15.153:0/836085626 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f88159480 0x7f2f88156c50 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f2f80009fd0 tx=0x7f2f80018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:20.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.066+0000 7f2f7a7fc700 1 -- 172.21.15.153:0/836085626 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8000be60 con 0x7f2f88159480 2024-08-17T02:29:20.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.066+0000 7f2f7a7fc700 1 -- 172.21.15.153:0/836085626 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f80008d90 con 0x7f2f88159480 2024-08-17T02:29:20.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.066+0000 7f2f8f1be700 1 -- 172.21.15.153:0/836085626 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f880b3a40 con 0x7f2f88159480 2024-08-17T02:29:20.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.066+0000 7f2f7a7fc700 1 -- 172.21.15.153:0/836085626 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f800256b0 con 0x7f2f88159480 2024-08-17T02:29:20.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.066+0000 7f2f8f1be700 1 -- 172.21.15.153:0/836085626 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f880b33a0 con 0x7f2f88159480 2024-08-17T02:29:20.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.070+0000 7f2f8f1be700 1 -- 172.21.15.153:0/836085626 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f88064330 con 0x7f2f88159480 2024-08-17T02:29:20.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.070+0000 7f2f7a7fc700 1 -- 172.21.15.153:0/836085626 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2f80003040 con 0x7f2f88159480 2024-08-17T02:29:20.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.070+0000 7f2f7a7fc700 1 --2- 172.21.15.153:0/836085626 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2f6c060860 0x7f2f6c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.070+0000 7f2f8e1bc700 1 --2- 172.21.15.153:0/836085626 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2f6c060860 0x7f2f6c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.070+0000 7f2f7a7fc700 1 -- 172.21.15.153:0/836085626 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f2f8007e8a0 con 0x7f2f88159480 2024-08-17T02:29:20.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.074+0000 7f2f8e1bc700 1 --2- 172.21.15.153:0/836085626 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2f6c060860 0x7f2f6c062d10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c004fd0 tx=0x7f2f7c007eb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:20.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.082+0000 7f2f7a7fc700 1 -- 172.21.15.153:0/836085626 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f2f8004ec70 con 0x7f2f88159480 2024-08-17T02:29:20.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.242+0000 7f2f8f1be700 1 -- 172.21.15.153:0/836085626 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000118573.meta", "var": "pg_num"} v 0) v1 -- 0x7f2f880b44d0 con 0x7f2f88159480 2024-08-17T02:29:20.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.242+0000 7f2f7a7fc700 1 -- 172.21.15.153:0/836085626 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000118573.meta", "var": "pg_num"}]=0 v40) v1 ==== 124+0+11 (secure 0 0 0) 0x7f2f800200c0 con 0x7f2f88159480 2024-08-17T02:29:20.246 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2024-08-17T02:29:20.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.246+0000 7f2f8f1be700 1 -- 172.21.15.153:0/836085626 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2f6c060860 msgr2=0x7f2f6c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.246+0000 7f2f8f1be700 1 --2- 172.21.15.153:0/836085626 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2f6c060860 0x7f2f6c062d10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c004fd0 tx=0x7f2f7c007eb0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.246+0000 7f2f8f1be700 1 -- 172.21.15.153:0/836085626 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f88159480 msgr2=0x7f2f88156c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.246+0000 7f2f8f1be700 1 --2- 172.21.15.153:0/836085626 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f88159480 0x7f2f88156c50 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f2f80009fd0 tx=0x7f2f80018000 comp rx=0 tx=0).stop 2024-08-17T02:29:20.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.246+0000 7f2f8f1be700 1 -- 172.21.15.153:0/836085626 shutdown_connections 2024-08-17T02:29:20.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.246+0000 7f2f8f1be700 1 --2- 172.21.15.153:0/836085626 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2f6c060860 0x7f2f6c062d10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.246+0000 7f2f8f1be700 1 --2- 172.21.15.153:0/836085626 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f88159480 0x7f2f88156c50 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.246+0000 7f2f8f1be700 1 --2- 172.21.15.153:0/836085626 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2f881590b0 0x7f2f880c7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.246+0000 7f2f8f1be700 1 --2- 172.21.15.153:0/836085626 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f88067510 0x7f2f880b2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.246+0000 7f2f8f1be700 1 -- 172.21.15.153:0/836085626 >> 172.21.15.153:0/836085626 conn(0x7f2f880d0b90 msgr2=0x7f2f88066e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:20.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.246+0000 7f2f8f1be700 1 -- 172.21.15.153:0/836085626 shutdown_connections 2024-08-17T02:29:20.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.246+0000 7f2f8f1be700 1 -- 172.21.15.153:0/836085626 wait complete. 2024-08-17T02:29:20.261 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000118573.data pg_num 2024-08-17T02:29:20.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.378+0000 7f9a9ec49700 1 Processor -- start 2024-08-17T02:29:20.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.378+0000 7f9a9ec49700 1 -- start start 2024-08-17T02:29:20.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.378+0000 7f9a9ec49700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a981574f0 0x7f9a98157940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.378+0000 7f9a9ec49700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9a980b0d90 0x7f9a980b1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.378+0000 7f9a9ec49700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a9806e010 con 0x7f9a981514d0 2024-08-17T02:29:20.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.378+0000 7f9a9ec49700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a980b1750 con 0x7f9a980b0d90 2024-08-17T02:29:20.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.378+0000 7f9a9ec49700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a98157fb0 con 0x7f9a981574f0 2024-08-17T02:29:20.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.378+0000 7f9a9e448700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9a980b0d90 0x7f9a980b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.378+0000 7f9a9e448700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9a980b0d90 0x7f9a980b1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52652/0 (socket says 172.21.15.153:52652) 2024-08-17T02:29:20.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.378+0000 7f9a9e448700 1 -- 172.21.15.153:0/2465862930 learned_addr learned my addr 172.21.15.153:0/2465862930 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:20.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.378+0000 7f9a9d446700 1 --2- 172.21.15.153:0/2465862930 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a981574f0 0x7f9a98157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.382+0000 7f9a9e448700 1 -- 172.21.15.153:0/2465862930 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a981574f0 msgr2=0x7f9a98157940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:20.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.382+0000 7f9a9e448700 1 --2- 172.21.15.153:0/2465862930 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a981574f0 0x7f9a98157940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.382+0000 7f9a9e448700 1 -- 172.21.15.153:0/2465862930 >> v1:172.21.15.174:6789/0 conn(0x7f9a981514d0 legacy=0x7f9a9806ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.382+0000 7f9a9e448700 1 -- 172.21.15.153:0/2465862930 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a98158290 con 0x7f9a980b0d90 2024-08-17T02:29:20.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.382+0000 7f9a9e448700 1 --2- 172.21.15.153:0/2465862930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a980b0d90 0x7f9a980b1210 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9a90009f20 tx=0x7f9a90009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=747a35e434e9c4a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:20.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.382+0000 7f9a9cc45700 1 -- 172.21.15.153:0/2465862930 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9000e070 con 0x7f9a980b0d90 2024-08-17T02:29:20.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.382+0000 7f9a9cc45700 1 -- 172.21.15.153:0/2465862930 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9000ba80 con 0x7f9a980b0d90 2024-08-17T02:29:20.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.382+0000 7f9a9cc45700 1 -- 172.21.15.153:0/2465862930 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a900092e0 con 0x7f9a980b0d90 2024-08-17T02:29:20.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.382+0000 7f9a9ec49700 1 -- 172.21.15.153:0/2465862930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a980b0d90 msgr2=0x7f9a980b1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.382+0000 7f9a9ec49700 1 --2- 172.21.15.153:0/2465862930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a980b0d90 0x7f9a980b1210 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9a90009f20 tx=0x7f9a90009840 comp rx=0 tx=0).stop 2024-08-17T02:29:20.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.382+0000 7f9a9ec49700 1 -- 172.21.15.153:0/2465862930 shutdown_connections 2024-08-17T02:29:20.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.382+0000 7f9a9ec49700 1 --2- 172.21.15.153:0/2465862930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a980b0d90 0x7f9a980b1210 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.382+0000 7f9a9ec49700 1 --2- 172.21.15.153:0/2465862930 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a981574f0 0x7f9a98157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.382+0000 7f9a9ec49700 1 -- 172.21.15.153:0/2465862930 >> 172.21.15.153:0/2465862930 conn(0x7f9a980678a0 msgr2=0x7f9a98067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:20.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.382+0000 7f9a9ec49700 1 -- 172.21.15.153:0/2465862930 shutdown_connections 2024-08-17T02:29:20.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.382+0000 7f9a9ec49700 1 -- 172.21.15.153:0/2465862930 wait complete. 2024-08-17T02:29:20.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.386+0000 7f9a9ec49700 1 Processor -- start 2024-08-17T02:29:20.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.386+0000 7f9a9ec49700 1 -- start start 2024-08-17T02:29:20.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.386+0000 7f9a9ec49700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a980b0d90 0x7f9a9806a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.386+0000 7f9a9ec49700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a981514d0 0x7f9a98147340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.386+0000 7f9a9ec49700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a981574f0 0x7f9a98148bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.386+0000 7f9a9ec49700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a98148760 con 0x7f9a981514d0 2024-08-17T02:29:20.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.386+0000 7f9a9ec49700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9806a910 con 0x7f9a980b0d90 2024-08-17T02:29:20.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.386+0000 7f9a9ec49700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a98147880 con 0x7f9a981574f0 2024-08-17T02:29:20.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.386+0000 7f9a9d446700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a981514d0 0x7f9a98147340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.386+0000 7f9a9d446700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a981514d0 0x7f9a98147340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52660/0 (socket says 172.21.15.153:52660) 2024-08-17T02:29:20.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.386+0000 7f9a9d446700 1 -- 172.21.15.153:0/1383354848 learned_addr learned my addr 172.21.15.153:0/1383354848 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:20.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.386+0000 7f9a9dc47700 1 --2- 172.21.15.153:0/1383354848 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a980b0d90 0x7f9a9806a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.386+0000 7f9a9e448700 1 --2- 172.21.15.153:0/1383354848 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a981574f0 0x7f9a98148bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.386+0000 7f9a9d446700 1 -- 172.21.15.153:0/1383354848 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a981574f0 msgr2=0x7f9a98148bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.386+0000 7f9a9d446700 1 --2- 172.21.15.153:0/1383354848 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a981574f0 0x7f9a98148bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.386+0000 7f9a9d446700 1 -- 172.21.15.153:0/1383354848 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a980b0d90 msgr2=0x7f9a9806a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.386+0000 7f9a9d446700 1 --2- 172.21.15.153:0/1383354848 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a980b0d90 0x7f9a9806a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.386+0000 7f9a9d446700 1 -- 172.21.15.153:0/1383354848 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a90009ae0 con 0x7f9a981514d0 2024-08-17T02:29:20.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.386+0000 7f9a9d446700 1 --2- 172.21.15.153:0/1383354848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a981514d0 0x7f9a98147340 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9a9400d860 tx=0x7f9a94008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:20.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.386+0000 7f9a8dffb700 1 -- 172.21.15.153:0/1383354848 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a940125f0 con 0x7f9a981514d0 2024-08-17T02:29:20.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.386+0000 7f9a8dffb700 1 -- 172.21.15.153:0/1383354848 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a94012750 con 0x7f9a981514d0 2024-08-17T02:29:20.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.390+0000 7f9a8dffb700 1 -- 172.21.15.153:0/1383354848 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a94012b10 con 0x7f9a981514d0 2024-08-17T02:29:20.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.390+0000 7f9a9ec49700 1 -- 172.21.15.153:0/1383354848 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a98147b50 con 0x7f9a981514d0 2024-08-17T02:29:20.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.390+0000 7f9a9ec49700 1 -- 172.21.15.153:0/1383354848 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a98148110 con 0x7f9a981514d0 2024-08-17T02:29:20.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.390+0000 7f9a9ec49700 1 -- 172.21.15.153:0/1383354848 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a98148910 con 0x7f9a981514d0 2024-08-17T02:29:20.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.390+0000 7f9a8dffb700 1 -- 172.21.15.153:0/1383354848 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9a9401e460 con 0x7f9a981514d0 2024-08-17T02:29:20.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.390+0000 7f9a8dffb700 1 --2- 172.21.15.153:0/1383354848 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9a84060860 0x7f9a84062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.390+0000 7f9a8dffb700 1 -- 172.21.15.153:0/1383354848 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f9a9407d180 con 0x7f9a981514d0 2024-08-17T02:29:20.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.390+0000 7f9a9dc47700 1 --2- 172.21.15.153:0/1383354848 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9a84060860 0x7f9a84062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.394+0000 7f9a9dc47700 1 --2- 172.21.15.153:0/1383354848 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9a84060860 0x7f9a84062d10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9a88003a80 tx=0x7f9a88007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:20.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.398+0000 7f9a8dffb700 1 -- 172.21.15.153:0/1383354848 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f9a98148910 con 0x7f9a981514d0 2024-08-17T02:29:20.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.562+0000 7f9a9ec49700 1 -- 172.21.15.153:0/1383354848 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000118573.data", "var": "pg_num"} v 0) v1 -- 0x7f9a98064330 con 0x7f9a981514d0 2024-08-17T02:29:20.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.562+0000 7f9a8dffb700 1 -- 172.21.15.153:0/1383354848 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000118573.data", "var": "pg_num"}]=0 v40) v1 ==== 124+0+11 (secure 0 0 0) 0x7f9a94050d50 con 0x7f9a981514d0 2024-08-17T02:29:20.564 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2024-08-17T02:29:20.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.562+0000 7f9a9ec49700 1 -- 172.21.15.153:0/1383354848 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9a84060860 msgr2=0x7f9a84062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.562+0000 7f9a9ec49700 1 --2- 172.21.15.153:0/1383354848 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9a84060860 0x7f9a84062d10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9a88003a80 tx=0x7f9a88007ec0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.562+0000 7f9a9ec49700 1 -- 172.21.15.153:0/1383354848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a981514d0 msgr2=0x7f9a98147340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.562+0000 7f9a9ec49700 1 --2- 172.21.15.153:0/1383354848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a981514d0 0x7f9a98147340 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9a9400d860 tx=0x7f9a94008040 comp rx=0 tx=0).stop 2024-08-17T02:29:20.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.562+0000 7f9a9ec49700 1 -- 172.21.15.153:0/1383354848 shutdown_connections 2024-08-17T02:29:20.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.562+0000 7f9a9ec49700 1 --2- 172.21.15.153:0/1383354848 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9a84060860 0x7f9a84062d10 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.562+0000 7f9a9ec49700 1 --2- 172.21.15.153:0/1383354848 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a981574f0 0x7f9a98148bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.562+0000 7f9a9ec49700 1 --2- 172.21.15.153:0/1383354848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a981514d0 0x7f9a98147340 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.562+0000 7f9a9ec49700 1 --2- 172.21.15.153:0/1383354848 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a980b0d90 0x7f9a9806a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.562+0000 7f9a9ec49700 1 -- 172.21.15.153:0/1383354848 >> 172.21.15.153:0/1383354848 conn(0x7f9a980678a0 msgr2=0x7f9a9814a100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:20.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.562+0000 7f9a9ec49700 1 -- 172.21.15.153:0/1383354848 shutdown_connections 2024-08-17T02:29:20.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.562+0000 7f9a9ec49700 1 -- 172.21.15.153:0/1383354848 wait complete. 2024-08-17T02:29:20.578 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:20.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.678+0000 7fde4bbbf700 1 Processor -- start 2024-08-17T02:29:20.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.678+0000 7fde4bbbf700 1 -- start start 2024-08-17T02:29:20.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.678+0000 7fde4bbbf700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fde440af030 0x7fde440a9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.678+0000 7fde4bbbf700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fde441598a0 0x7fde440b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.678+0000 7fde4bbbf700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde440b00d0 con 0x7fde440a8f50 2024-08-17T02:29:20.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.678+0000 7fde4bbbf700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde440b11b0 con 0x7fde441598a0 2024-08-17T02:29:20.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.678+0000 7fde4bbbf700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde44159d40 con 0x7fde440af030 2024-08-17T02:29:20.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.678+0000 7fde4a15c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fde441598a0 0x7fde440b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.678+0000 7fde4a15c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fde441598a0 0x7fde440b0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52666/0 (socket says 172.21.15.153:52666) 2024-08-17T02:29:20.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.678+0000 7fde4a15c700 1 -- 172.21.15.153:0/3038416596 learned_addr learned my addr 172.21.15.153:0/3038416596 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:20.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.678+0000 7fde4915a700 1 --2- 172.21.15.153:0/3038416596 >> v2:172.21.15.174:3300/0 conn(0x7fde440af030 0x7fde440a9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.678+0000 7fde4a15c700 1 -- 172.21.15.153:0/3038416596 >> v2:172.21.15.174:3300/0 conn(0x7fde440af030 msgr2=0x7fde440a9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:20.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.678+0000 7fde4a15c700 1 --2- 172.21.15.153:0/3038416596 >> v2:172.21.15.174:3300/0 conn(0x7fde440af030 0x7fde440a9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.678+0000 7fde4a15c700 1 -- 172.21.15.153:0/3038416596 >> v1:172.21.15.174:6789/0 conn(0x7fde440a8f50 legacy=0x7fde440b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.678+0000 7fde4a15c700 1 -- 172.21.15.153:0/3038416596 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde440af4c0 con 0x7fde441598a0 2024-08-17T02:29:20.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.678+0000 7fde4a15c700 1 --2- 172.21.15.153:0/3038416596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde441598a0 0x7fde440b0c70 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fde440ae480 tx=0x7fde3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d0ca9a940b382 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:20.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.678+0000 7fde48959700 1 -- 172.21.15.153:0/3038416596 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c00b860 con 0x7fde441598a0 2024-08-17T02:29:20.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.678+0000 7fde48959700 1 -- 172.21.15.153:0/3038416596 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3c00b9c0 con 0x7fde441598a0 2024-08-17T02:29:20.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.678+0000 7fde48959700 1 -- 172.21.15.153:0/3038416596 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c00bd60 con 0x7fde441598a0 2024-08-17T02:29:20.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.678+0000 7fde4bbbf700 1 -- 172.21.15.153:0/3038416596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde441598a0 msgr2=0x7fde440b0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.678+0000 7fde4bbbf700 1 --2- 172.21.15.153:0/3038416596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde441598a0 0x7fde440b0c70 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fde440ae480 tx=0x7fde3c009250 comp rx=0 tx=0).stop 2024-08-17T02:29:20.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.678+0000 7fde4bbbf700 1 -- 172.21.15.153:0/3038416596 shutdown_connections 2024-08-17T02:29:20.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.678+0000 7fde4bbbf700 1 --2- 172.21.15.153:0/3038416596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde441598a0 0x7fde440b0c70 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.678+0000 7fde4bbbf700 1 --2- 172.21.15.153:0/3038416596 >> v2:172.21.15.174:3300/0 conn(0x7fde440af030 0x7fde440a9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.678+0000 7fde4bbbf700 1 -- 172.21.15.153:0/3038416596 >> 172.21.15.153:0/3038416596 conn(0x7fde44066e00 msgr2=0x7fde44067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:20.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.678+0000 7fde4bbbf700 1 -- 172.21.15.153:0/3038416596 shutdown_connections 2024-08-17T02:29:20.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.682+0000 7fde4bbbf700 1 -- 172.21.15.153:0/3038416596 wait complete. 2024-08-17T02:29:20.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.682+0000 7fde4bbbf700 1 Processor -- start 2024-08-17T02:29:20.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.682+0000 7fde4bbbf700 1 -- start start 2024-08-17T02:29:20.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.686+0000 7fde4bbbf700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde440a8f50 0x7fde441409f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.686+0000 7fde4bbbf700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde440af030 0x7fde4416c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.686+0000 7fde4bbbf700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde441598a0 0x7fde4415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.686+0000 7fde4bbbf700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde440969f0 con 0x7fde441598a0 2024-08-17T02:29:20.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.686+0000 7fde4bbbf700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde44096fb0 con 0x7fde440af030 2024-08-17T02:29:20.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.686+0000 7fde4bbbf700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde4416d2b0 con 0x7fde440a8f50 2024-08-17T02:29:20.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.686+0000 7fde4a15c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde441598a0 0x7fde4415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.686+0000 7fde4a15c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde441598a0 0x7fde4415b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52672/0 (socket says 172.21.15.153:52672) 2024-08-17T02:29:20.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.686+0000 7fde4a15c700 1 -- 172.21.15.153:0/2075969207 learned_addr learned my addr 172.21.15.153:0/2075969207 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:20.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.686+0000 7fde4915a700 1 --2- 172.21.15.153:0/2075969207 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde440af030 0x7fde4416c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.686+0000 7fde4995b700 1 --2- 172.21.15.153:0/2075969207 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde440a8f50 0x7fde441409f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.686+0000 7fde4a15c700 1 -- 172.21.15.153:0/2075969207 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde440a8f50 msgr2=0x7fde441409f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.686+0000 7fde4a15c700 1 --2- 172.21.15.153:0/2075969207 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde440a8f50 0x7fde441409f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.686+0000 7fde4a15c700 1 -- 172.21.15.153:0/2075969207 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde440af030 msgr2=0x7fde4416c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.686+0000 7fde4a15c700 1 --2- 172.21.15.153:0/2075969207 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde440af030 0x7fde4416c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.686+0000 7fde4a15c700 1 -- 172.21.15.153:0/2075969207 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde3c0094f0 con 0x7fde441598a0 2024-08-17T02:29:20.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.686+0000 7fde4915a700 1 --2- 172.21.15.153:0/2075969207 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde440af030 0x7fde4416c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:20.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.686+0000 7fde4a15c700 1 --2- 172.21.15.153:0/2075969207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde441598a0 0x7fde4415b6a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fde4406f870 tx=0x7fde3c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:20.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.686+0000 7fde39ffb700 1 -- 172.21.15.153:0/2075969207 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c01a630 con 0x7fde441598a0 2024-08-17T02:29:20.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.686+0000 7fde39ffb700 1 -- 172.21.15.153:0/2075969207 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3c01a790 con 0x7fde441598a0 2024-08-17T02:29:20.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.686+0000 7fde4bbbf700 1 -- 172.21.15.153:0/2075969207 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde4416d590 con 0x7fde441598a0 2024-08-17T02:29:20.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.686+0000 7fde39ffb700 1 -- 172.21.15.153:0/2075969207 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c01ab30 con 0x7fde441598a0 2024-08-17T02:29:20.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.686+0000 7fde4bbbf700 1 -- 172.21.15.153:0/2075969207 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde440cb730 con 0x7fde441598a0 2024-08-17T02:29:20.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.686+0000 7fde4bbbf700 1 -- 172.21.15.153:0/2075969207 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde440645c0 con 0x7fde441598a0 2024-08-17T02:29:20.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.690+0000 7fde39ffb700 1 -- 172.21.15.153:0/2075969207 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fde3c02d440 con 0x7fde441598a0 2024-08-17T02:29:20.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.690+0000 7fde39ffb700 1 --2- 172.21.15.153:0/2075969207 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fde30060860 0x7fde30062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.690+0000 7fde39ffb700 1 -- 172.21.15.153:0/2075969207 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fde3c07ea10 con 0x7fde441598a0 2024-08-17T02:29:20.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.690+0000 7fde4995b700 1 --2- 172.21.15.153:0/2075969207 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fde30060860 0x7fde30062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.690+0000 7fde4995b700 1 --2- 172.21.15.153:0/2075969207 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fde30060860 0x7fde30062d10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fde34003860 tx=0x7fde34009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:20.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.694+0000 7fde39ffb700 1 -- 172.21.15.153:0/2075969207 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fde3c04ed40 con 0x7fde441598a0 2024-08-17T02:29:20.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.894+0000 7fde4bbbf700 1 -- 172.21.15.153:0/2075969207 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde440970f0 con 0x7fde441598a0 2024-08-17T02:29:20.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.894+0000 7fde39ffb700 1 -- 172.21.15.153:0/2075969207 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4623 (secure 0 0 0) 0x7fde3c015020 con 0x7fde441598a0 2024-08-17T02:29:20.898 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:29:20.898 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4885,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/747297575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":747297575},{"type":"v1","addr":"172.21.15.174:6833","nonce":747297575}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4891,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1080524090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1080524090},{"type":"v1","addr":"172.21.15.174:6835","nonce":1080524090}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5379,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/1564937222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1564937222},{"type":"v1","addr":"172.21.15.153:6837","nonce":1564937222}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:09.642872+0000","modified":"2024-08-17T02:27:11.644228+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5013},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5013":{"gid":5013,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":7,"addr":"172.21.15.153:6835/2569513399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2569513399},{"type":"v1","addr":"172.21.15.153:6835","nonce":2569513399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000118573","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:29:20.901 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.898+0000 7fde4bbbf700 1 -- 172.21.15.153:0/2075969207 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fde30060860 msgr2=0x7fde30062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.901 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.898+0000 7fde4bbbf700 1 --2- 172.21.15.153:0/2075969207 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fde30060860 0x7fde30062d10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fde34003860 tx=0x7fde34009040 comp rx=0 tx=0).stop 2024-08-17T02:29:20.901 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.898+0000 7fde4bbbf700 1 -- 172.21.15.153:0/2075969207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde441598a0 msgr2=0x7fde4415b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.901 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.898+0000 7fde4bbbf700 1 --2- 172.21.15.153:0/2075969207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde441598a0 0x7fde4415b6a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fde4406f870 tx=0x7fde3c017000 comp rx=0 tx=0).stop 2024-08-17T02:29:20.901 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.898+0000 7fde4bbbf700 1 -- 172.21.15.153:0/2075969207 shutdown_connections 2024-08-17T02:29:20.901 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.898+0000 7fde4bbbf700 1 --2- 172.21.15.153:0/2075969207 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fde30060860 0x7fde30062d10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.902 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.898+0000 7fde4bbbf700 1 --2- 172.21.15.153:0/2075969207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde441598a0 0x7fde4415b6a0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.902 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.898+0000 7fde4bbbf700 1 --2- 172.21.15.153:0/2075969207 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde440af030 0x7fde4416c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.902 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.898+0000 7fde4bbbf700 1 --2- 172.21.15.153:0/2075969207 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde440a8f50 0x7fde441409f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.902 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.898+0000 7fde4bbbf700 1 -- 172.21.15.153:0/2075969207 >> 172.21.15.153:0/2075969207 conn(0x7fde44066e00 msgr2=0x7fde4415a100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:20.902 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.898+0000 7fde4bbbf700 1 -- 172.21.15.153:0/2075969207 shutdown_connections 2024-08-17T02:29:20.902 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:20.898+0000 7fde4bbbf700 1 -- 172.21.15.153:0/2075969207 wait complete. 2024-08-17T02:29:20.902 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 20 2024-08-17T02:29:20.913 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:21.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.014+0000 7f174249b700 1 Processor -- start 2024-08-17T02:29:21.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.014+0000 7f174249b700 1 -- start start 2024-08-17T02:29:21.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f174249b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f173c156760 0x7f173c0b0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f174249b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f173c0a9f60 con 0x7f173c0af5a0 2024-08-17T02:29:21.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f174249b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f173c156bc0 con 0x7f173c155380 2024-08-17T02:29:21.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f174249b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f173c06e4b0 con 0x7f173c156760 2024-08-17T02:29:21.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f173b7fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f173c0af5a0 0x7f173c0afa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35554/0 (socket says 172.21.15.153:35554) 2024-08-17T02:29:21.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f173b7fe700 1 -- 172.21.15.153:0/645725196 learned_addr learned my addr 172.21.15.153:0/645725196 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:29:21.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f1740a38700 1 --2- 172.21.15.153:0/645725196 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f173c156760 0x7f173c0b0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f173affd700 1 -- 172.21.15.153:0/645725196 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2463293147 0 0) 0x7f173c0a9f60 con 0x7f173c0af5a0 2024-08-17T02:29:21.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f173affd700 1 -- 172.21.15.153:0/645725196 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1724003570 con 0x7f173c0af5a0 2024-08-17T02:29:21.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f173affd700 1 -- 172.21.15.153:0/645725196 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3556042529 0 0) 0x7f173c156bc0 con 0x7f173c155380 2024-08-17T02:29:21.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f173affd700 1 -- 172.21.15.153:0/645725196 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f173c0a9f60 con 0x7f173c155380 2024-08-17T02:29:21.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f173affd700 1 -- 172.21.15.153:0/645725196 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3423612039 0 0) 0x7f1724003570 con 0x7f173c0af5a0 2024-08-17T02:29:21.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f173affd700 1 -- 172.21.15.153:0/645725196 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f173c156760 msgr2=0x7f173c0b0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:21.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f173affd700 1 --2- 172.21.15.153:0/645725196 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f173c156760 0x7f173c0b0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f173affd700 1 -- 172.21.15.153:0/645725196 >> v1:172.21.15.174:6789/0 conn(0x7f173c155380 legacy=0x7f173c0a9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f173affd700 1 -- 172.21.15.153:0/645725196 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f173c06e6a0 con 0x7f173c0af5a0 2024-08-17T02:29:21.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f173affd700 1 -- 172.21.15.153:0/645725196 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3701463666 0 0) 0x7f172c001810 con 0x7f173c0af5a0 2024-08-17T02:29:21.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f1740a38700 1 --2- 172.21.15.153:0/645725196 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f173c156760 0x7f173c0b0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:21.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f173affd700 1 -- 172.21.15.153:0/645725196 >> v1:172.21.15.153:6789/0 conn(0x7f173c0af5a0 legacy=0x7f173c0afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f173affd700 1 --2- 172.21.15.153:0/645725196 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1724003c20 0x7f1724004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f173affd700 1 --2- 172.21.15.153:0/645725196 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1724004810 0x7f1724004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f173affd700 1 --2- 172.21.15.153:0/645725196 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f173c156760 0x7f17240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f173affd700 1 -- 172.21.15.153:0/645725196 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172400bb10 con 0x7f1724004810 2024-08-17T02:29:21.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f173affd700 1 -- 172.21.15.153:0/645725196 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172400bc50 con 0x7f1724003c20 2024-08-17T02:29:21.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f173affd700 1 -- 172.21.15.153:0/645725196 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f172400be10 con 0x7f173c156760 2024-08-17T02:29:21.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f173b7fe700 1 --2- 172.21.15.153:0/645725196 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1724004810 0x7f1724004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f173bfff700 1 --2- 172.21.15.153:0/645725196 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1724003c20 0x7f1724004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f1740a38700 1 --2- 172.21.15.153:0/645725196 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f173c156760 0x7f17240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f173b7fe700 1 -- 172.21.15.153:0/645725196 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f173c156760 msgr2=0x7f17240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:21.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f173b7fe700 1 --2- 172.21.15.153:0/645725196 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f173c156760 0x7f17240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f173b7fe700 1 -- 172.21.15.153:0/645725196 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1724003c20 msgr2=0x7f1724004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:21.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f173b7fe700 1 --2- 172.21.15.153:0/645725196 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1724003c20 0x7f1724004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f173b7fe700 1 -- 172.21.15.153:0/645725196 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1734009420 con 0x7f1724004810 2024-08-17T02:29:21.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f173b7fe700 1 --2- 172.21.15.153:0/645725196 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1724004810 0x7f1724004c80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f172c00a8c0 tx=0x7f172c0021b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a8e67de8c51c21 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:21.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f173affd700 1 -- 172.21.15.153:0/645725196 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172c007150 con 0x7f1724004810 2024-08-17T02:29:21.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f173affd700 1 -- 172.21.15.153:0/645725196 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f172c0072b0 con 0x7f1724004810 2024-08-17T02:29:21.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f173affd700 1 -- 172.21.15.153:0/645725196 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172c007650 con 0x7f1724004810 2024-08-17T02:29:21.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f174249b700 1 -- 172.21.15.153:0/645725196 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1724004810 msgr2=0x7f1724004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f174249b700 1 --2- 172.21.15.153:0/645725196 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1724004810 0x7f1724004c80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f172c00a8c0 tx=0x7f172c0021b0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f1740a38700 1 -- 172.21.15.153:0/645725196 reap_dead start 2024-08-17T02:29:21.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f174249b700 1 -- 172.21.15.153:0/645725196 shutdown_connections 2024-08-17T02:29:21.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f174249b700 1 -- 172.21.15.153:0/645725196 >> 172.21.15.153:0/645725196 conn(0x7f173c066e00 msgr2=0x7f173c067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:21.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f174249b700 1 -- 172.21.15.153:0/645725196 shutdown_connections 2024-08-17T02:29:21.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.018+0000 7f174249b700 1 -- 172.21.15.153:0/645725196 wait complete. 2024-08-17T02:29:21.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.022+0000 7f174249b700 1 Processor -- start 2024-08-17T02:29:21.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.022+0000 7f174249b700 1 -- start start 2024-08-17T02:29:21.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.022+0000 7f174249b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1724004810 0x7f173c097400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.022+0000 7f174249b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f173c0990f0 0x7f173c067400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.022+0000 7f174249b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f173c067940 0x7f173c14e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.022+0000 7f174249b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f173c097c50 con 0x7f173c067940 2024-08-17T02:29:21.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.022+0000 7f174249b700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f173c097f30 con 0x7f1724004810 2024-08-17T02:29:21.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.022+0000 7f174249b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f173c098210 con 0x7f173c0990f0 2024-08-17T02:29:21.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.022+0000 7f1740a38700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f173c067940 0x7f173c14e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.022+0000 7f1740a38700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f173c067940 0x7f173c14e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52696/0 (socket says 172.21.15.153:52696) 2024-08-17T02:29:21.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.022+0000 7f1740a38700 1 -- 172.21.15.153:0/4284239267 learned_addr learned my addr 172.21.15.153:0/4284239267 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:21.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.022+0000 7f173bfff700 1 --2- 172.21.15.153:0/4284239267 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1724004810 0x7f173c097400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.022+0000 7f173b7fe700 1 --2- 172.21.15.153:0/4284239267 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f173c0990f0 0x7f173c067400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.022+0000 7f1740a38700 1 -- 172.21.15.153:0/4284239267 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f173c0990f0 msgr2=0x7f173c067400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.022+0000 7f1740a38700 1 --2- 172.21.15.153:0/4284239267 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f173c0990f0 0x7f173c067400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.022+0000 7f1740a38700 1 -- 172.21.15.153:0/4284239267 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1724004810 msgr2=0x7f173c097400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.022+0000 7f1740a38700 1 --2- 172.21.15.153:0/4284239267 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1724004810 0x7f173c097400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.022+0000 7f1740a38700 1 -- 172.21.15.153:0/4284239267 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f173c0984f0 con 0x7f173c067940 2024-08-17T02:29:21.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.022+0000 7f1740a38700 1 --2- 172.21.15.153:0/4284239267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f173c067940 0x7f173c14e440 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f173c156b30 tx=0x7f1734008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:21.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.022+0000 7f1723fff700 1 -- 172.21.15.153:0/4284239267 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1734015670 con 0x7f173c067940 2024-08-17T02:29:21.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.022+0000 7f1723fff700 1 -- 172.21.15.153:0/4284239267 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17340157d0 con 0x7f173c067940 2024-08-17T02:29:21.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.022+0000 7f174249b700 1 -- 172.21.15.153:0/4284239267 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f173c0987d0 con 0x7f173c067940 2024-08-17T02:29:21.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.022+0000 7f1723fff700 1 -- 172.21.15.153:0/4284239267 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1734015b70 con 0x7f173c067940 2024-08-17T02:29:21.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.022+0000 7f174249b700 1 -- 172.21.15.153:0/4284239267 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f173c098cf0 con 0x7f173c067940 2024-08-17T02:29:21.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.026+0000 7f174249b700 1 -- 172.21.15.153:0/4284239267 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f173c0989c0 con 0x7f173c067940 2024-08-17T02:29:21.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.026+0000 7f1723fff700 1 -- 172.21.15.153:0/4284239267 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1734020460 con 0x7f173c067940 2024-08-17T02:29:21.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.026+0000 7f1723fff700 1 --2- 172.21.15.153:0/4284239267 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1728060860 0x7f1728062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.026+0000 7f1723fff700 1 -- 172.21.15.153:0/4284239267 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f173407ce80 con 0x7f173c067940 2024-08-17T02:29:21.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.026+0000 7f173bfff700 1 --2- 172.21.15.153:0/4284239267 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1728060860 0x7f1728062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.026+0000 7f173bfff700 1 --2- 172.21.15.153:0/4284239267 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1728060860 0x7f1728062d10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1730003d40 tx=0x7f1730007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:21.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.030+0000 7f1723fff700 1 -- 172.21.15.153:0/4284239267 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f173404d250 con 0x7f173c067940 2024-08-17T02:29:21.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.198+0000 7f174249b700 1 -- 172.21.15.153:0/4284239267 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f173c0645c0 con 0x7f173c067940 2024-08-17T02:29:21.203 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.202+0000 7f1723fff700 1 -- 172.21.15.153:0/4284239267 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+15562 (secure 0 0 0) 0x7f1734050870 con 0x7f173c067940 2024-08-17T02:29:21.203 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:29:21.204 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":40,"fsid":"56d41c33-b929-456d-96be-2aac4ecd299d","created":"2024-08-17T02:25:47.756085+0000","modified":"2024-08-17T02:29:19.284456+0000","last_up_change":"2024-08-17T02:25:58.643690+0000","last_in_change":"2024-08-17T02:25:49.809186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:58.093273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000118573.meta","create_time":"2024-08-17T02:27:08.568651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000118573"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000118573.data","create_time":"2024-08-17T02:27:08.668955+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000118573"}}}],"osds":[{"osd":0,"uuid":"0736f8e6-818e-42e6-a0dc-8aaf813315d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":24234},{"type":"v1","addr":"172.21.15.153:6817","nonce":24234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":24234},{"type":"v1","addr":"172.21.15.153:6819","nonce":24234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":24234},{"type":"v1","addr":"172.21.15.153:6823","nonce":24234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":24234},{"type":"v1","addr":"172.21.15.153:6821","nonce":24234}]},"public_addr":"172.21.15.153:6817/24234","cluster_addr":"172.21.15.153:6819/24234","heartbeat_back_addr":"172.21.15.153:6823/24234","heartbeat_front_addr":"172.21.15.153:6821/24234","state":["exists","up"]},{"osd":1,"uuid":"011762e9-6c2d-441a-aa56-68474639d72f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":24232},{"type":"v1","addr":"172.21.15.153:6801","nonce":24232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":24232},{"type":"v1","addr":"172.21.15.153:6803","nonce":24232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":24232},{"type":"v1","addr":"172.21.15.153:6809","nonce":24232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":24232},{"type":"v1","addr":"172.21.15.153:6806","nonce":24232}]},"public_addr":"172.21.15.153:6801/24232","cluster_addr":"172.21.15.153:6803/24232","heartbeat_back_addr":"172.21.15.153:6809/24232","heartbeat_front_addr":"172.21.15.153:6806/24232","state":["exists","up"]},{"osd":2,"uuid":"b562cd97-aa12-455e-b46a-e720a2ec9d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":24235},{"type":"v1","addr":"172.21.15.153:6808","nonce":24235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":24235},{"type":"v1","addr":"172.21.15.153:6811","nonce":24235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":24235},{"type":"v1","addr":"172.21.15.153:6815","nonce":24235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":24235},{"type":"v1","addr":"172.21.15.153:6813","nonce":24235}]},"public_addr":"172.21.15.153:6808/24235","cluster_addr":"172.21.15.153:6811/24235","heartbeat_back_addr":"172.21.15.153:6815/24235","heartbeat_front_addr":"172.21.15.153:6813/24235","state":["exists","up"]},{"osd":3,"uuid":"222da52f-90c2-4132-a5d2-6f6cf83d4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":24236},{"type":"v1","addr":"172.21.15.153:6825","nonce":24236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":24236},{"type":"v1","addr":"172.21.15.153:6827","nonce":24236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":24236},{"type":"v1","addr":"172.21.15.153:6831","nonce":24236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":24236},{"type":"v1","addr":"172.21.15.153:6829","nonce":24236}]},"public_addr":"172.21.15.153:6825/24236","cluster_addr":"172.21.15.153:6827/24236","heartbeat_back_addr":"172.21.15.153:6831/24236","heartbeat_front_addr":"172.21.15.153:6829/24236","state":["exists","up"]},{"osd":4,"uuid":"a38a04cd-032b-4977-a260-1ef3567d0c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24456},{"type":"v1","addr":"172.21.15.174:6809","nonce":24456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24456},{"type":"v1","addr":"172.21.15.174:6811","nonce":24456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24456},{"type":"v1","addr":"172.21.15.174:6815","nonce":24456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24456},{"type":"v1","addr":"172.21.15.174:6813","nonce":24456}]},"public_addr":"172.21.15.174:6809/24456","cluster_addr":"172.21.15.174:6811/24456","heartbeat_back_addr":"172.21.15.174:6815/24456","heartbeat_front_addr":"172.21.15.174:6813/24456","state":["exists","up"]},{"osd":5,"uuid":"c7778084-e751-48da-87a1-ab8bbe85aa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24457},{"type":"v1","addr":"172.21.15.174:6825","nonce":24457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24457},{"type":"v1","addr":"172.21.15.174:6827","nonce":24457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24457},{"type":"v1","addr":"172.21.15.174:6831","nonce":24457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24457},{"type":"v1","addr":"172.21.15.174:6829","nonce":24457}]},"public_addr":"172.21.15.174:6825/24457","cluster_addr":"172.21.15.174:6827/24457","heartbeat_back_addr":"172.21.15.174:6831/24457","heartbeat_front_addr":"172.21.15.174:6829/24457","state":["exists","up"]},{"osd":6,"uuid":"2d8e0715-254f-442c-9625-50721d0bc858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24477},{"type":"v1","addr":"172.21.15.174:6801","nonce":24477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24477},{"type":"v1","addr":"172.21.15.174:6803","nonce":24477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24477},{"type":"v1","addr":"172.21.15.174:6807","nonce":24477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24477},{"type":"v1","addr":"172.21.15.174:6805","nonce":24477}]},"public_addr":"172.21.15.174:6801/24477","cluster_addr":"172.21.15.174:6803/24477","heartbeat_back_addr":"172.21.15.174:6807/24477","heartbeat_front_addr":"172.21.15.174:6805/24477","state":["exists","up"]},{"osd":7,"uuid":"dffda25a-4601-4ddb-9a27-b0be1cadde27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24455},{"type":"v1","addr":"172.21.15.174:6817","nonce":24455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24455},{"type":"v1","addr":"172.21.15.174:6819","nonce":24455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24455},{"type":"v1","addr":"172.21.15.174:6823","nonce":24455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24455},{"type":"v1","addr":"172.21.15.174:6821","nonce":24455}]},"public_addr":"172.21.15.174:6817/24455","cluster_addr":"172.21.15.174:6819/24455","heartbeat_back_addr":"172.21.15.174:6823/24455","heartbeat_front_addr":"172.21.15.174:6821/24455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.990117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.033862+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.748087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.112877+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.070448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.360961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.110940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.226377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.153:6837/2567193475":"2024-08-18T02:29:16.167908+0000","172.21.15.153:6836/2567193475":"2024-08-18T02:29:16.167908+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:21.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.202+0000 7f174249b700 1 -- 172.21.15.153:0/4284239267 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1728060860 msgr2=0x7f1728062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.202+0000 7f174249b700 1 --2- 172.21.15.153:0/4284239267 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1728060860 0x7f1728062d10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1730003d40 tx=0x7f1730007d30 comp rx=0 tx=0).stop 2024-08-17T02:29:21.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.202+0000 7f174249b700 1 -- 172.21.15.153:0/4284239267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f173c067940 msgr2=0x7f173c14e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.202+0000 7f174249b700 1 --2- 172.21.15.153:0/4284239267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f173c067940 0x7f173c14e440 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f173c156b30 tx=0x7f1734008040 comp rx=0 tx=0).stop 2024-08-17T02:29:21.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.202+0000 7f174249b700 1 -- 172.21.15.153:0/4284239267 shutdown_connections 2024-08-17T02:29:21.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.202+0000 7f174249b700 1 --2- 172.21.15.153:0/4284239267 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1728060860 0x7f1728062d10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.202+0000 7f174249b700 1 --2- 172.21.15.153:0/4284239267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f173c067940 0x7f173c14e440 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.202+0000 7f174249b700 1 --2- 172.21.15.153:0/4284239267 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f173c0990f0 0x7f173c067400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.202+0000 7f174249b700 1 --2- 172.21.15.153:0/4284239267 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1724004810 0x7f173c097400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.202+0000 7f174249b700 1 -- 172.21.15.153:0/4284239267 >> 172.21.15.153:0/4284239267 conn(0x7f173c066e00 msgr2=0x7f173c0a91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:21.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.202+0000 7f174249b700 1 -- 172.21.15.153:0/4284239267 shutdown_connections 2024-08-17T02:29:21.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.202+0000 7f174249b700 1 -- 172.21.15.153:0/4284239267 wait complete. 2024-08-17T02:29:21.218 INFO:tasks.cephfs.filesystem:Destroying file system volume_0000000000118573 and related pools 2024-08-17T02:29:21.218 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:21.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.322+0000 7f477359e700 1 Processor -- start 2024-08-17T02:29:21.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.322+0000 7f477359e700 1 -- start start 2024-08-17T02:29:21.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.322+0000 7f477359e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f47740b0350 0x7f47740ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.322+0000 7f477359e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f477406df10 0x7f477406e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.322+0000 7f477359e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f477406e8b0 con 0x7f4774155d20 2024-08-17T02:29:21.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.322+0000 7f477359e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47740b07a0 con 0x7f47740b0350 2024-08-17T02:29:21.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.322+0000 7f477359e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47740af2b0 con 0x7f477406df10 2024-08-17T02:29:21.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.322+0000 7f476bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f47740b0350 0x7f47740ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.322+0000 7f476bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f47740b0350 0x7f47740ad7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52704/0 (socket says 172.21.15.153:52704) 2024-08-17T02:29:21.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.322+0000 7f476bfff700 1 -- 172.21.15.153:0/3280826979 learned_addr learned my addr 172.21.15.153:0/3280826979 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:21.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.322+0000 7f477259c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f4774155d20 0x7f47740aea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35562/0 (socket says 172.21.15.153:35562) 2024-08-17T02:29:21.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.322+0000 7f4772d9d700 1 --2- 172.21.15.153:0/3280826979 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f477406df10 0x7f477406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.322+0000 7f4771d9b700 1 -- 172.21.15.153:0/3280826979 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2344656329 0 0) 0x7f4764001110 con 0x7f4774155d20 2024-08-17T02:29:21.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.322+0000 7f476bfff700 1 -- 172.21.15.153:0/3280826979 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f477406df10 msgr2=0x7f477406e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:21.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.322+0000 7f476bfff700 1 --2- 172.21.15.153:0/3280826979 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f477406df10 0x7f477406e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.322+0000 7f476bfff700 1 -- 172.21.15.153:0/3280826979 >> v1:172.21.15.153:6789/0 conn(0x7f4774155d20 legacy=0x7f47740aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.326+0000 7f476bfff700 1 -- 172.21.15.153:0/3280826979 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47740af590 con 0x7f47740b0350 2024-08-17T02:29:21.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.326+0000 7f4772d9d700 1 --2- 172.21.15.153:0/3280826979 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f477406df10 0x7f477406e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:21.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.326+0000 7f476bfff700 1 --2- 172.21.15.153:0/3280826979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47740b0350 0x7f47740ad7c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f475c0099b0 tx=0x7f475c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e79136ea3f38720 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:21.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.326+0000 7f4771d9b700 1 -- 172.21.15.153:0/3280826979 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c00b860 con 0x7f47740b0350 2024-08-17T02:29:21.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.326+0000 7f4771d9b700 1 -- 172.21.15.153:0/3280826979 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475c00b9c0 con 0x7f47740b0350 2024-08-17T02:29:21.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.326+0000 7f4771d9b700 1 -- 172.21.15.153:0/3280826979 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c00bd60 con 0x7f47740b0350 2024-08-17T02:29:21.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.326+0000 7f477359e700 1 -- 172.21.15.153:0/3280826979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47740b0350 msgr2=0x7f47740ad7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.326+0000 7f477359e700 1 --2- 172.21.15.153:0/3280826979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47740b0350 0x7f47740ad7c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f475c0099b0 tx=0x7f475c009250 comp rx=0 tx=0).stop 2024-08-17T02:29:21.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.326+0000 7f477359e700 1 -- 172.21.15.153:0/3280826979 shutdown_connections 2024-08-17T02:29:21.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.326+0000 7f477359e700 1 --2- 172.21.15.153:0/3280826979 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f477406df10 0x7f477406e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.326+0000 7f477359e700 1 --2- 172.21.15.153:0/3280826979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47740b0350 0x7f47740ad7c0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.326+0000 7f477359e700 1 -- 172.21.15.153:0/3280826979 >> 172.21.15.153:0/3280826979 conn(0x7f47740678d0 msgr2=0x7f4774067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:21.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.326+0000 7f477359e700 1 -- 172.21.15.153:0/3280826979 shutdown_connections 2024-08-17T02:29:21.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.326+0000 7f477359e700 1 -- 172.21.15.153:0/3280826979 wait complete. 2024-08-17T02:29:21.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.326+0000 7f477359e700 1 Processor -- start 2024-08-17T02:29:21.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.326+0000 7f477359e700 1 -- start start 2024-08-17T02:29:21.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.330+0000 7f477359e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f477406df10 0x7f4774143890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.330+0000 7f477359e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f47740b0350 0x7f4774157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.330+0000 7f477359e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4774155d20 0x7f47741355b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.330+0000 7f477359e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4774148320 con 0x7f477406df10 2024-08-17T02:29:21.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.330+0000 7f477359e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4774158410 con 0x7f4774155d20 2024-08-17T02:29:21.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.330+0000 7f477359e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4774147d60 con 0x7f47740b0350 2024-08-17T02:29:21.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.330+0000 7f477259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f477406df10 0x7f4774143890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.330+0000 7f477259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f477406df10 0x7f4774143890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52712/0 (socket says 172.21.15.153:52712) 2024-08-17T02:29:21.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.330+0000 7f477259c700 1 -- 172.21.15.153:0/2147098357 learned_addr learned my addr 172.21.15.153:0/2147098357 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:21.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.330+0000 7f476bfff700 1 --2- 172.21.15.153:0/2147098357 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f47740b0350 0x7f4774157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.330+0000 7f4772d9d700 1 --2- 172.21.15.153:0/2147098357 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4774155d20 0x7f47741355b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.330+0000 7f477259c700 1 -- 172.21.15.153:0/2147098357 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f47740b0350 msgr2=0x7f4774157680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.330+0000 7f477259c700 1 --2- 172.21.15.153:0/2147098357 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f47740b0350 0x7f4774157680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.330+0000 7f477259c700 1 -- 172.21.15.153:0/2147098357 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4774155d20 msgr2=0x7f47741355b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.330+0000 7f477259c700 1 --2- 172.21.15.153:0/2147098357 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4774155d20 0x7f47741355b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.330+0000 7f477259c700 1 -- 172.21.15.153:0/2147098357 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f475c0094f0 con 0x7f477406df10 2024-08-17T02:29:21.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.330+0000 7f4772d9d700 1 --2- 172.21.15.153:0/2147098357 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4774155d20 0x7f47741355b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:21.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.330+0000 7f477259c700 1 --2- 172.21.15.153:0/2147098357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f477406df10 0x7f4774143890 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f476400c5b0 tx=0x7f4764001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:21.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.330+0000 7f476a7fc700 1 -- 172.21.15.153:0/2147098357 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4764005a70 con 0x7f477406df10 2024-08-17T02:29:21.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.330+0000 7f476a7fc700 1 -- 172.21.15.153:0/2147098357 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4764005bd0 con 0x7f477406df10 2024-08-17T02:29:21.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.330+0000 7f477359e700 1 -- 172.21.15.153:0/2147098357 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4774148040 con 0x7f477406df10 2024-08-17T02:29:21.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.330+0000 7f476a7fc700 1 -- 172.21.15.153:0/2147098357 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47640070d0 con 0x7f477406df10 2024-08-17T02:29:21.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.330+0000 7f477359e700 1 -- 172.21.15.153:0/2147098357 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4774143dd0 con 0x7f477406df10 2024-08-17T02:29:21.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.334+0000 7f477359e700 1 -- 172.21.15.153:0/2147098357 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4774157f00 con 0x7f477406df10 2024-08-17T02:29:21.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.334+0000 7f476a7fc700 1 -- 172.21.15.153:0/2147098357 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4764007480 con 0x7f477406df10 2024-08-17T02:29:21.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.334+0000 7f476a7fc700 1 --2- 172.21.15.153:0/2147098357 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4754060890 0x7f4754062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.334+0000 7f476bfff700 1 --2- 172.21.15.153:0/2147098357 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4754060890 0x7f4754062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.334+0000 7f476a7fc700 1 -- 172.21.15.153:0/2147098357 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f476407bfa0 con 0x7f477406df10 2024-08-17T02:29:21.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.334+0000 7f476bfff700 1 --2- 172.21.15.153:0/2147098357 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4754060890 0x7f4754062d40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f475c0099b0 tx=0x7f475c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:21.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.342+0000 7f476a7fc700 1 -- 172.21.15.153:0/2147098357 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f4774157f00 con 0x7f477406df10 2024-08-17T02:29:21.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.534+0000 7f477359e700 1 -- 172.21.15.153:0/2147098357 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f477406e8b0 con 0x7f477406df10 2024-08-17T02:29:21.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.534+0000 7f476a7fc700 1 -- 172.21.15.153:0/2147098357 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4623 (secure 0 0 0) 0x7f477406e8b0 con 0x7f477406df10 2024-08-17T02:29:21.537 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:29:21.537 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4885,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/747297575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":747297575},{"type":"v1","addr":"172.21.15.174:6833","nonce":747297575}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4891,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1080524090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1080524090},{"type":"v1","addr":"172.21.15.174:6835","nonce":1080524090}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5379,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/1564937222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1564937222},{"type":"v1","addr":"172.21.15.153:6837","nonce":1564937222}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:09.642872+0000","modified":"2024-08-17T02:27:11.644228+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5013},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5013":{"gid":5013,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":7,"addr":"172.21.15.153:6835/2569513399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2569513399},{"type":"v1","addr":"172.21.15.153:6835","nonce":2569513399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000118573","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:29:21.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.538+0000 7f477359e700 1 -- 172.21.15.153:0/2147098357 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4754060890 msgr2=0x7f4754062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.538+0000 7f477359e700 1 --2- 172.21.15.153:0/2147098357 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4754060890 0x7f4754062d40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f475c0099b0 tx=0x7f475c017000 comp rx=0 tx=0).stop 2024-08-17T02:29:21.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.538+0000 7f477359e700 1 -- 172.21.15.153:0/2147098357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f477406df10 msgr2=0x7f4774143890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.538+0000 7f477359e700 1 --2- 172.21.15.153:0/2147098357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f477406df10 0x7f4774143890 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f476400c5b0 tx=0x7f4764001040 comp rx=0 tx=0).stop 2024-08-17T02:29:21.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.538+0000 7f477359e700 1 -- 172.21.15.153:0/2147098357 shutdown_connections 2024-08-17T02:29:21.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.538+0000 7f477359e700 1 --2- 172.21.15.153:0/2147098357 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4754060890 0x7f4754062d40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.538+0000 7f477359e700 1 --2- 172.21.15.153:0/2147098357 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4774155d20 0x7f47741355b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.538+0000 7f477359e700 1 --2- 172.21.15.153:0/2147098357 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f47740b0350 0x7f4774157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.538+0000 7f477359e700 1 --2- 172.21.15.153:0/2147098357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f477406df10 0x7f4774143890 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.538+0000 7f477359e700 1 -- 172.21.15.153:0/2147098357 >> 172.21.15.153:0/2147098357 conn(0x7f47740678d0 msgr2=0x7f477406a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:21.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.538+0000 7f477359e700 1 -- 172.21.15.153:0/2147098357 shutdown_connections 2024-08-17T02:29:21.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.538+0000 7f477359e700 1 -- 172.21.15.153:0/2147098357 wait complete. 2024-08-17T02:29:21.540 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 20 2024-08-17T02:29:21.550 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:21.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.654+0000 7f1c713c6700 1 Processor -- start 2024-08-17T02:29:21.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.654+0000 7f1c713c6700 1 -- start start 2024-08-17T02:29:21.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.654+0000 7f1c713c6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1c6c154900 0x7f1c6c0b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.654+0000 7f1c713c6700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c6c0b1730 con 0x7f1c6c0cb560 2024-08-17T02:29:21.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.654+0000 7f1c713c6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c6c0cbaa0 con 0x7f1c6c0b12d0 2024-08-17T02:29:21.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.654+0000 7f1c713c6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c6c068790 con 0x7f1c6c154900 2024-08-17T02:29:21.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.654+0000 7f1c70bc5700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f1c6c0cb560 0x7f1c6c160ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35574/0 (socket says 172.21.15.153:35574) 2024-08-17T02:29:21.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.654+0000 7f1c70bc5700 1 -- 172.21.15.153:0/1338068639 learned_addr learned my addr 172.21.15.153:0/1338068639 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:29:21.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.654+0000 7f1c6bfff700 1 --2- 172.21.15.153:0/1338068639 >> v2:172.21.15.174:3300/0 conn(0x7f1c6c154900 0x7f1c6c0b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.658+0000 7f1c6b7fe700 1 -- 172.21.15.153:0/1338068639 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2142558726 0 0) 0x7f1c64001490 con 0x7f1c6c0cb560 2024-08-17T02:29:21.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.658+0000 7f1c6b7fe700 1 -- 172.21.15.153:0/1338068639 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c58003570 con 0x7f1c6c0cb560 2024-08-17T02:29:21.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.658+0000 7f1c6b7fe700 1 -- 172.21.15.153:0/1338068639 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 504113491 0 0) 0x7f1c6c0cbaa0 con 0x7f1c6c0b12d0 2024-08-17T02:29:21.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.658+0000 7f1c6b7fe700 1 -- 172.21.15.153:0/1338068639 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c64001490 con 0x7f1c6c0b12d0 2024-08-17T02:29:21.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.658+0000 7f1c6bfff700 1 -- 172.21.15.153:0/1338068639 >> v1:172.21.15.174:6789/0 conn(0x7f1c6c0b12d0 legacy=0x7f1c6c0cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.658+0000 7f1c6bfff700 1 -- 172.21.15.153:0/1338068639 >> v1:172.21.15.153:6789/0 conn(0x7f1c6c0cb560 legacy=0x7f1c6c160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.658+0000 7f1c6bfff700 1 -- 172.21.15.153:0/1338068639 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6c157630 con 0x7f1c6c154900 2024-08-17T02:29:21.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.658+0000 7f1c6bfff700 1 --2- 172.21.15.153:0/1338068639 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1c6c154900 0x7f1c6c0b0d90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c0098e0 tx=0x7f1c5c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf9bb7f1b22725c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:21.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.658+0000 7f1c6b7fe700 1 -- 172.21.15.153:0/1338068639 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c011630 con 0x7f1c6c154900 2024-08-17T02:29:21.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.658+0000 7f1c6b7fe700 1 -- 172.21.15.153:0/1338068639 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5c011790 con 0x7f1c6c154900 2024-08-17T02:29:21.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.658+0000 7f1c6b7fe700 1 -- 172.21.15.153:0/1338068639 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c011b10 con 0x7f1c6c154900 2024-08-17T02:29:21.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.658+0000 7f1c713c6700 1 -- 172.21.15.153:0/1338068639 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1c6c154900 msgr2=0x7f1c6c0b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.658+0000 7f1c713c6700 1 --2- 172.21.15.153:0/1338068639 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1c6c154900 0x7f1c6c0b0d90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c0098e0 tx=0x7f1c5c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.658+0000 7f1c713c6700 1 -- 172.21.15.153:0/1338068639 shutdown_connections 2024-08-17T02:29:21.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.658+0000 7f1c713c6700 1 --2- 172.21.15.153:0/1338068639 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1c6c154900 0x7f1c6c0b0d90 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.658+0000 7f1c713c6700 1 -- 172.21.15.153:0/1338068639 >> 172.21.15.153:0/1338068639 conn(0x7f1c6c0678d0 msgr2=0x7f1c6c067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:21.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.658+0000 7f1c713c6700 1 -- 172.21.15.153:0/1338068639 shutdown_connections 2024-08-17T02:29:21.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.658+0000 7f1c713c6700 1 -- 172.21.15.153:0/1338068639 wait complete. 2024-08-17T02:29:21.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.662+0000 7f1c713c6700 1 Processor -- start 2024-08-17T02:29:21.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.662+0000 7f1c713c6700 1 -- start start 2024-08-17T02:29:21.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.662+0000 7f1c713c6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1c6c0b12d0 0x7f1c6c0a6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.662+0000 7f1c713c6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c6c0cb560 0x7f1c6c148620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.662+0000 7f1c713c6700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1c6c154900 0x7f1c6c1532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.662+0000 7f1c713c6700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c0a8110 con 0x7f1c6c0cb560 2024-08-17T02:29:21.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.662+0000 7f1c713c6700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c0a6bb0 con 0x7f1c6c154900 2024-08-17T02:29:21.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.662+0000 7f1c713c6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c0a85a0 con 0x7f1c6c0b12d0 2024-08-17T02:29:21.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.662+0000 7f1c63fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c6c0cb560 0x7f1c6c148620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.662+0000 7f1c63fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c6c0cb560 0x7f1c6c148620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52724/0 (socket says 172.21.15.153:52724) 2024-08-17T02:29:21.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.662+0000 7f1c63fff700 1 -- 172.21.15.153:0/868730223 learned_addr learned my addr 172.21.15.153:0/868730223 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:21.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.662+0000 7f1c6bfff700 1 --2- 172.21.15.153:0/868730223 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1c6c0b12d0 0x7f1c6c0a6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.662+0000 7f1c70bc5700 1 --2- 172.21.15.153:0/868730223 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1c6c154900 0x7f1c6c1532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.662+0000 7f1c63fff700 1 -- 172.21.15.153:0/868730223 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1c6c0b12d0 msgr2=0x7f1c6c0a6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.662+0000 7f1c63fff700 1 --2- 172.21.15.153:0/868730223 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1c6c0b12d0 0x7f1c6c0a6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.662+0000 7f1c63fff700 1 -- 172.21.15.153:0/868730223 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1c6c154900 msgr2=0x7f1c6c1532b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.662+0000 7f1c63fff700 1 --2- 172.21.15.153:0/868730223 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1c6c154900 0x7f1c6c1532b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.662+0000 7f1c63fff700 1 -- 172.21.15.153:0/868730223 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c5c009420 con 0x7f1c6c0cb560 2024-08-17T02:29:21.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.662+0000 7f1c6bfff700 1 --2- 172.21.15.153:0/868730223 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1c6c0b12d0 0x7f1c6c0a6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:21.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.662+0000 7f1c63fff700 1 --2- 172.21.15.153:0/868730223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c6c0cb560 0x7f1c6c148620 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1c5400c7c0 tx=0x7f1c54007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:21.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.662+0000 7f1c68ff9700 1 -- 172.21.15.153:0/868730223 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c54010510 con 0x7f1c6c0cb560 2024-08-17T02:29:21.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.662+0000 7f1c68ff9700 1 -- 172.21.15.153:0/868730223 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c54010670 con 0x7f1c6c0cb560 2024-08-17T02:29:21.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.662+0000 7f1c713c6700 1 -- 172.21.15.153:0/868730223 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c6c0a7500 con 0x7f1c6c0cb560 2024-08-17T02:29:21.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.662+0000 7f1c68ff9700 1 -- 172.21.15.153:0/868730223 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c54010a30 con 0x7f1c6c0cb560 2024-08-17T02:29:21.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.662+0000 7f1c713c6700 1 -- 172.21.15.153:0/868730223 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c6c0a7ac0 con 0x7f1c6c0cb560 2024-08-17T02:29:21.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.666+0000 7f1c713c6700 1 -- 172.21.15.153:0/868730223 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c6c0a82c0 con 0x7f1c6c0cb560 2024-08-17T02:29:21.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.666+0000 7f1c68ff9700 1 -- 172.21.15.153:0/868730223 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1c5401b400 con 0x7f1c6c0cb560 2024-08-17T02:29:21.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.666+0000 7f1c68ff9700 1 --2- 172.21.15.153:0/868730223 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1c4c060860 0x7f1c4c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.666+0000 7f1c68ff9700 1 -- 172.21.15.153:0/868730223 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f1c5407c8d0 con 0x7f1c6c0cb560 2024-08-17T02:29:21.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.666+0000 7f1c6bfff700 1 --2- 172.21.15.153:0/868730223 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1c4c060860 0x7f1c4c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.666+0000 7f1c6bfff700 1 --2- 172.21.15.153:0/868730223 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1c4c060860 0x7f1c4c062d10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c0093f0 tx=0x7f1c5c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:21.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.674+0000 7f1c68ff9700 1 -- 172.21.15.153:0/868730223 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1c6c0a82c0 con 0x7f1c6c0cb560 2024-08-17T02:29:21.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.878+0000 7f1c713c6700 1 -- 172.21.15.153:0/868730223 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c6c0643a0 con 0x7f1c6c0cb560 2024-08-17T02:29:21.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.878+0000 7f1c68ff9700 1 -- 172.21.15.153:0/868730223 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4623 (secure 0 0 0) 0x7f1c54016090 con 0x7f1c6c0cb560 2024-08-17T02:29:21.880 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:29:21.880 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4885,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/747297575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":747297575},{"type":"v1","addr":"172.21.15.174:6833","nonce":747297575}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4891,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1080524090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1080524090},{"type":"v1","addr":"172.21.15.174:6835","nonce":1080524090}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5379,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/1564937222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1564937222},{"type":"v1","addr":"172.21.15.153:6837","nonce":1564937222}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:09.642872+0000","modified":"2024-08-17T02:27:11.644228+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5013},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5013":{"gid":5013,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":7,"addr":"172.21.15.153:6835/2569513399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2569513399},{"type":"v1","addr":"172.21.15.153:6835","nonce":2569513399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000118573","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:29:21.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.878+0000 7f1c713c6700 1 -- 172.21.15.153:0/868730223 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1c4c060860 msgr2=0x7f1c4c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.878+0000 7f1c713c6700 1 --2- 172.21.15.153:0/868730223 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1c4c060860 0x7f1c4c062d10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c0093f0 tx=0x7f1c5c017000 comp rx=0 tx=0).stop 2024-08-17T02:29:21.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.878+0000 7f1c713c6700 1 -- 172.21.15.153:0/868730223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c6c0cb560 msgr2=0x7f1c6c148620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.878+0000 7f1c713c6700 1 --2- 172.21.15.153:0/868730223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c6c0cb560 0x7f1c6c148620 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1c5400c7c0 tx=0x7f1c54007dc0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.882+0000 7f1c713c6700 1 -- 172.21.15.153:0/868730223 shutdown_connections 2024-08-17T02:29:21.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.882+0000 7f1c713c6700 1 --2- 172.21.15.153:0/868730223 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1c4c060860 0x7f1c4c062d10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.882+0000 7f1c713c6700 1 --2- 172.21.15.153:0/868730223 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1c6c154900 0x7f1c6c1532b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.882+0000 7f1c713c6700 1 --2- 172.21.15.153:0/868730223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c6c0cb560 0x7f1c6c148620 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.882+0000 7f1c713c6700 1 --2- 172.21.15.153:0/868730223 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1c6c0b12d0 0x7f1c6c0a6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.882+0000 7f1c713c6700 1 -- 172.21.15.153:0/868730223 >> 172.21.15.153:0/868730223 conn(0x7f1c6c0678d0 msgr2=0x7f1c6c06d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:21.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.882+0000 7f1c713c6700 1 -- 172.21.15.153:0/868730223 shutdown_connections 2024-08-17T02:29:21.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.882+0000 7f1c713c6700 1 -- 172.21.15.153:0/868730223 wait complete. 2024-08-17T02:29:21.884 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 20 2024-08-17T02:29:21.895 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:22.001 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.998+0000 7f7c2ecda700 1 Processor -- start 2024-08-17T02:29:22.001 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.998+0000 7f7c2ecda700 1 -- start start 2024-08-17T02:29:22.002 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.998+0000 7f7c2ecda700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c28155d20 0x7f7c280b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.002 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.998+0000 7f7c2ecda700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7c280ad7c0 0x7f7c280aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.002 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.998+0000 7f7c2ecda700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7c2806df10 0x7f7c2806e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.002 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.998+0000 7f7c2ecda700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c280adc10 con 0x7f7c2806df10 2024-08-17T02:29:22.002 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.998+0000 7f7c2ecda700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c2806e8d0 con 0x7f7c280ad7c0 2024-08-17T02:29:22.002 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.998+0000 7f7c2ecda700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c280af2b0 con 0x7f7c28155d20 2024-08-17T02:29:22.002 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.998+0000 7f7c2e4d9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7c2806df10 0x7f7c2806e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.002 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.998+0000 7f7c2e4d9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7c2806df10 0x7f7c2806e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52734/0 (socket says 172.21.15.153:52734) 2024-08-17T02:29:22.003 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.998+0000 7f7c2e4d9700 1 -- 172.21.15.153:0/2536763975 learned_addr learned my addr 172.21.15.153:0/2536763975 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:22.003 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.998+0000 7f7c2d4d7700 1 --2- 172.21.15.153:0/2536763975 >> v2:172.21.15.174:3300/0 conn(0x7f7c280ad7c0 0x7f7c280aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.003 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:21.998+0000 7f7c2dcd8700 1 --2- 172.21.15.153:0/2536763975 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c28155d20 0x7f7c280b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.004 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.002+0000 7f7c2e4d9700 1 -- 172.21.15.153:0/2536763975 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c28155d20 msgr2=0x7f7c280b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:22.004 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.002+0000 7f7c2e4d9700 1 --2- 172.21.15.153:0/2536763975 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c28155d20 0x7f7c280b0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.004 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.002+0000 7f7c2e4d9700 1 -- 172.21.15.153:0/2536763975 >> v2:172.21.15.174:3300/0 conn(0x7f7c280ad7c0 msgr2=0x7f7c280aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:22.004 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.002+0000 7f7c2e4d9700 1 --2- 172.21.15.153:0/2536763975 >> v2:172.21.15.174:3300/0 conn(0x7f7c280ad7c0 0x7f7c280aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.004 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.002+0000 7f7c2e4d9700 1 -- 172.21.15.153:0/2536763975 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c280af590 con 0x7f7c2806df10 2024-08-17T02:29:22.004 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.002+0000 7f7c2e4d9700 1 --2- 172.21.15.153:0/2536763975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c2806df10 0x7f7c2806e390 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7c28070d00 tx=0x7f7c2000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88666a8fd624936f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:22.004 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.002+0000 7f7c2ccd6700 1 -- 172.21.15.153:0/2536763975 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2000dbb0 con 0x7f7c2806df10 2024-08-17T02:29:22.004 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.002+0000 7f7c2ccd6700 1 -- 172.21.15.153:0/2536763975 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2000dd10 con 0x7f7c2806df10 2024-08-17T02:29:22.004 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.002+0000 7f7c2ccd6700 1 -- 172.21.15.153:0/2536763975 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c200196b0 con 0x7f7c2806df10 2024-08-17T02:29:22.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.002+0000 7f7c2ecda700 1 -- 172.21.15.153:0/2536763975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c2806df10 msgr2=0x7f7c2806e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:22.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.002+0000 7f7c2ecda700 1 --2- 172.21.15.153:0/2536763975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c2806df10 0x7f7c2806e390 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7c28070d00 tx=0x7f7c2000b4f0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.002+0000 7f7c2ecda700 1 -- 172.21.15.153:0/2536763975 shutdown_connections 2024-08-17T02:29:22.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.002+0000 7f7c2ecda700 1 --2- 172.21.15.153:0/2536763975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c2806df10 0x7f7c2806e390 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.002+0000 7f7c2ecda700 1 --2- 172.21.15.153:0/2536763975 >> v2:172.21.15.174:3300/0 conn(0x7f7c280ad7c0 0x7f7c280aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.002+0000 7f7c2ecda700 1 --2- 172.21.15.153:0/2536763975 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c28155d20 0x7f7c280b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.002+0000 7f7c2ecda700 1 -- 172.21.15.153:0/2536763975 >> 172.21.15.153:0/2536763975 conn(0x7f7c280678d0 msgr2=0x7f7c28067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:22.006 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.002+0000 7f7c2ecda700 1 -- 172.21.15.153:0/2536763975 shutdown_connections 2024-08-17T02:29:22.006 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.002+0000 7f7c2ecda700 1 -- 172.21.15.153:0/2536763975 wait complete. 2024-08-17T02:29:22.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.006+0000 7f7c2ecda700 1 Processor -- start 2024-08-17T02:29:22.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.006+0000 7f7c2ecda700 1 -- start start 2024-08-17T02:29:22.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.006+0000 7f7c2ecda700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c2806df10 0x7f7c281549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.006+0000 7f7c2ecda700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c280ad7c0 0x7f7c2815d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.006+0000 7f7c2ecda700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c28155d20 0x7f7c281435d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.006+0000 7f7c2ecda700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2815e690 con 0x7f7c2806df10 2024-08-17T02:29:22.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.006+0000 7f7c2ecda700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2815de50 con 0x7f7c28155d20 2024-08-17T02:29:22.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.006+0000 7f7c2ecda700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2815e0d0 con 0x7f7c280ad7c0 2024-08-17T02:29:22.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.006+0000 7f7c2dcd8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c2806df10 0x7f7c281549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.006+0000 7f7c2dcd8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c2806df10 0x7f7c281549b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52748/0 (socket says 172.21.15.153:52748) 2024-08-17T02:29:22.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.006+0000 7f7c2dcd8700 1 -- 172.21.15.153:0/2997483979 learned_addr learned my addr 172.21.15.153:0/2997483979 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:22.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.006+0000 7f7c2d4d7700 1 --2- 172.21.15.153:0/2997483979 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c280ad7c0 0x7f7c2815d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.006+0000 7f7c2e4d9700 1 --2- 172.21.15.153:0/2997483979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c28155d20 0x7f7c281435d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.010+0000 7f7c2dcd8700 1 -- 172.21.15.153:0/2997483979 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c280ad7c0 msgr2=0x7f7c2815d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:22.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.010+0000 7f7c2dcd8700 1 --2- 172.21.15.153:0/2997483979 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c280ad7c0 0x7f7c2815d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.010+0000 7f7c2dcd8700 1 -- 172.21.15.153:0/2997483979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c28155d20 msgr2=0x7f7c281435d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:22.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.010+0000 7f7c2dcd8700 1 --2- 172.21.15.153:0/2997483979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c28155d20 0x7f7c281435d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.010+0000 7f7c2dcd8700 1 -- 172.21.15.153:0/2997483979 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2000b790 con 0x7f7c2806df10 2024-08-17T02:29:22.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.010+0000 7f7c2dcd8700 1 --2- 172.21.15.153:0/2997483979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c2806df10 0x7f7c281549b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7c1800d860 tx=0x7f7c18008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:22.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.010+0000 7f7c1dffb700 1 -- 172.21.15.153:0/2997483979 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c180125f0 con 0x7f7c2806df10 2024-08-17T02:29:22.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.010+0000 7f7c1dffb700 1 -- 172.21.15.153:0/2997483979 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c18012750 con 0x7f7c2806df10 2024-08-17T02:29:22.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.010+0000 7f7c2ecda700 1 -- 172.21.15.153:0/2997483979 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c2815e3b0 con 0x7f7c2806df10 2024-08-17T02:29:22.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.010+0000 7f7c1dffb700 1 -- 172.21.15.153:0/2997483979 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c18012b10 con 0x7f7c2806df10 2024-08-17T02:29:22.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.010+0000 7f7c2ecda700 1 -- 172.21.15.153:0/2997483979 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c28159d40 con 0x7f7c2806df10 2024-08-17T02:29:22.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.010+0000 7f7c2ecda700 1 -- 172.21.15.153:0/2997483979 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c280643a0 con 0x7f7c2806df10 2024-08-17T02:29:22.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.010+0000 7f7c1dffb700 1 -- 172.21.15.153:0/2997483979 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7c1801e460 con 0x7f7c2806df10 2024-08-17T02:29:22.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.014+0000 7f7c1dffb700 1 --2- 172.21.15.153:0/2997483979 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7c14060860 0x7f7c14062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.014+0000 7f7c1dffb700 1 -- 172.21.15.153:0/2997483979 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f7c1807d220 con 0x7f7c2806df10 2024-08-17T02:29:22.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.014+0000 7f7c2d4d7700 1 --2- 172.21.15.153:0/2997483979 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7c14060860 0x7f7c14062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.014+0000 7f7c2d4d7700 1 --2- 172.21.15.153:0/2997483979 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7c14060860 0x7f7c14062d10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7c28154ef0 tx=0x7f7c2400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:22.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.018+0000 7f7c1dffb700 1 -- 172.21.15.153:0/2997483979 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f7c1804d550 con 0x7f7c2806df10 2024-08-17T02:29:22.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.178+0000 7f7c2ecda700 1 -- 172.21.15.153:0/2997483979 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c2806f5f0 con 0x7f7c2806df10 2024-08-17T02:29:22.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.178+0000 7f7c1dffb700 1 -- 172.21.15.153:0/2997483979 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+15562 (secure 0 0 0) 0x7f7c18050b70 con 0x7f7c2806df10 2024-08-17T02:29:22.181 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:29:22.181 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":40,"fsid":"56d41c33-b929-456d-96be-2aac4ecd299d","created":"2024-08-17T02:25:47.756085+0000","modified":"2024-08-17T02:29:19.284456+0000","last_up_change":"2024-08-17T02:25:58.643690+0000","last_in_change":"2024-08-17T02:25:49.809186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:58.093273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000118573.meta","create_time":"2024-08-17T02:27:08.568651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000118573"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000118573.data","create_time":"2024-08-17T02:27:08.668955+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000118573"}}}],"osds":[{"osd":0,"uuid":"0736f8e6-818e-42e6-a0dc-8aaf813315d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":24234},{"type":"v1","addr":"172.21.15.153:6817","nonce":24234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":24234},{"type":"v1","addr":"172.21.15.153:6819","nonce":24234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":24234},{"type":"v1","addr":"172.21.15.153:6823","nonce":24234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":24234},{"type":"v1","addr":"172.21.15.153:6821","nonce":24234}]},"public_addr":"172.21.15.153:6817/24234","cluster_addr":"172.21.15.153:6819/24234","heartbeat_back_addr":"172.21.15.153:6823/24234","heartbeat_front_addr":"172.21.15.153:6821/24234","state":["exists","up"]},{"osd":1,"uuid":"011762e9-6c2d-441a-aa56-68474639d72f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":24232},{"type":"v1","addr":"172.21.15.153:6801","nonce":24232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":24232},{"type":"v1","addr":"172.21.15.153:6803","nonce":24232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":24232},{"type":"v1","addr":"172.21.15.153:6809","nonce":24232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":24232},{"type":"v1","addr":"172.21.15.153:6806","nonce":24232}]},"public_addr":"172.21.15.153:6801/24232","cluster_addr":"172.21.15.153:6803/24232","heartbeat_back_addr":"172.21.15.153:6809/24232","heartbeat_front_addr":"172.21.15.153:6806/24232","state":["exists","up"]},{"osd":2,"uuid":"b562cd97-aa12-455e-b46a-e720a2ec9d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":24235},{"type":"v1","addr":"172.21.15.153:6808","nonce":24235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":24235},{"type":"v1","addr":"172.21.15.153:6811","nonce":24235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":24235},{"type":"v1","addr":"172.21.15.153:6815","nonce":24235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":24235},{"type":"v1","addr":"172.21.15.153:6813","nonce":24235}]},"public_addr":"172.21.15.153:6808/24235","cluster_addr":"172.21.15.153:6811/24235","heartbeat_back_addr":"172.21.15.153:6815/24235","heartbeat_front_addr":"172.21.15.153:6813/24235","state":["exists","up"]},{"osd":3,"uuid":"222da52f-90c2-4132-a5d2-6f6cf83d4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":24236},{"type":"v1","addr":"172.21.15.153:6825","nonce":24236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":24236},{"type":"v1","addr":"172.21.15.153:6827","nonce":24236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":24236},{"type":"v1","addr":"172.21.15.153:6831","nonce":24236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":24236},{"type":"v1","addr":"172.21.15.153:6829","nonce":24236}]},"public_addr":"172.21.15.153:6825/24236","cluster_addr":"172.21.15.153:6827/24236","heartbeat_back_addr":"172.21.15.153:6831/24236","heartbeat_front_addr":"172.21.15.153:6829/24236","state":["exists","up"]},{"osd":4,"uuid":"a38a04cd-032b-4977-a260-1ef3567d0c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24456},{"type":"v1","addr":"172.21.15.174:6809","nonce":24456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24456},{"type":"v1","addr":"172.21.15.174:6811","nonce":24456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24456},{"type":"v1","addr":"172.21.15.174:6815","nonce":24456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24456},{"type":"v1","addr":"172.21.15.174:6813","nonce":24456}]},"public_addr":"172.21.15.174:6809/24456","cluster_addr":"172.21.15.174:6811/24456","heartbeat_back_addr":"172.21.15.174:6815/24456","heartbeat_front_addr":"172.21.15.174:6813/24456","state":["exists","up"]},{"osd":5,"uuid":"c7778084-e751-48da-87a1-ab8bbe85aa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24457},{"type":"v1","addr":"172.21.15.174:6825","nonce":24457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24457},{"type":"v1","addr":"172.21.15.174:6827","nonce":24457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24457},{"type":"v1","addr":"172.21.15.174:6831","nonce":24457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24457},{"type":"v1","addr":"172.21.15.174:6829","nonce":24457}]},"public_addr":"172.21.15.174:6825/24457","cluster_addr":"172.21.15.174:6827/24457","heartbeat_back_addr":"172.21.15.174:6831/24457","heartbeat_front_addr":"172.21.15.174:6829/24457","state":["exists","up"]},{"osd":6,"uuid":"2d8e0715-254f-442c-9625-50721d0bc858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24477},{"type":"v1","addr":"172.21.15.174:6801","nonce":24477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24477},{"type":"v1","addr":"172.21.15.174:6803","nonce":24477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24477},{"type":"v1","addr":"172.21.15.174:6807","nonce":24477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24477},{"type":"v1","addr":"172.21.15.174:6805","nonce":24477}]},"public_addr":"172.21.15.174:6801/24477","cluster_addr":"172.21.15.174:6803/24477","heartbeat_back_addr":"172.21.15.174:6807/24477","heartbeat_front_addr":"172.21.15.174:6805/24477","state":["exists","up"]},{"osd":7,"uuid":"dffda25a-4601-4ddb-9a27-b0be1cadde27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24455},{"type":"v1","addr":"172.21.15.174:6817","nonce":24455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24455},{"type":"v1","addr":"172.21.15.174:6819","nonce":24455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24455},{"type":"v1","addr":"172.21.15.174:6823","nonce":24455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24455},{"type":"v1","addr":"172.21.15.174:6821","nonce":24455}]},"public_addr":"172.21.15.174:6817/24455","cluster_addr":"172.21.15.174:6819/24455","heartbeat_back_addr":"172.21.15.174:6823/24455","heartbeat_front_addr":"172.21.15.174:6821/24455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.990117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.033862+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.748087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.112877+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.070448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.360961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.110940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.226377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.153:6837/2567193475":"2024-08-18T02:29:16.167908+0000","172.21.15.153:6836/2567193475":"2024-08-18T02:29:16.167908+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:22.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.182+0000 7f7c2ecda700 1 -- 172.21.15.153:0/2997483979 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7c14060860 msgr2=0x7f7c14062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:22.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.182+0000 7f7c2ecda700 1 --2- 172.21.15.153:0/2997483979 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7c14060860 0x7f7c14062d10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7c28154ef0 tx=0x7f7c2400b040 comp rx=0 tx=0).stop 2024-08-17T02:29:22.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.182+0000 7f7c2ecda700 1 -- 172.21.15.153:0/2997483979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c2806df10 msgr2=0x7f7c281549b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:22.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.182+0000 7f7c2ecda700 1 --2- 172.21.15.153:0/2997483979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c2806df10 0x7f7c281549b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7c1800d860 tx=0x7f7c18008040 comp rx=0 tx=0).stop 2024-08-17T02:29:22.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.182+0000 7f7c2ecda700 1 -- 172.21.15.153:0/2997483979 shutdown_connections 2024-08-17T02:29:22.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.182+0000 7f7c2ecda700 1 --2- 172.21.15.153:0/2997483979 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f7c14060860 0x7f7c14062d10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.182+0000 7f7c2ecda700 1 --2- 172.21.15.153:0/2997483979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c28155d20 0x7f7c281435d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.182+0000 7f7c2ecda700 1 --2- 172.21.15.153:0/2997483979 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c280ad7c0 0x7f7c2815d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.182+0000 7f7c2ecda700 1 --2- 172.21.15.153:0/2997483979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c2806df10 0x7f7c281549b0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.182+0000 7f7c2ecda700 1 -- 172.21.15.153:0/2997483979 >> 172.21.15.153:0/2997483979 conn(0x7f7c280678d0 msgr2=0x7f7c28151530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:22.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.182+0000 7f7c2ecda700 1 -- 172.21.15.153:0/2997483979 shutdown_connections 2024-08-17T02:29:22.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.182+0000 7f7c2ecda700 1 -- 172.21.15.153:0/2997483979 wait complete. 2024-08-17T02:29:22.195 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail volume_0000000000118573 2024-08-17T02:29:22.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.302+0000 7f2caf59e700 1 Processor -- start 2024-08-17T02:29:22.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.302+0000 7f2caf59e700 1 -- start start 2024-08-17T02:29:22.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.302+0000 7f2caf59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2cb00d0010 0x7f2cb00d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.302+0000 7f2caf59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb00cf190 con 0x7f2cb015cea0 2024-08-17T02:29:22.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.302+0000 7f2caf59e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb00d09a0 con 0x7f2cb0159040 2024-08-17T02:29:22.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.302+0000 7f2caf59e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb015d9f0 con 0x7f2cb00d0010 2024-08-17T02:29:22.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.302+0000 7f2caed9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f2cb015cea0 0x7f2cb015d2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:49804/0 (socket says 172.21.15.153:49804) 2024-08-17T02:29:22.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.302+0000 7f2cadd9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2cb00d0010 0x7f2cb00d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.302+0000 7f2caed9d700 1 -- 172.21.15.153:0/3626140336 learned_addr learned my addr 172.21.15.153:0/3626140336 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:29:22.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.302+0000 7f2cadd9b700 1 -- 172.21.15.153:0/3626140336 >> v1:172.21.15.174:6789/0 conn(0x7f2cb0159040 legacy=0x7f2cb00cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:22.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.302+0000 7f2cadd9b700 1 -- 172.21.15.153:0/3626140336 >> v1:172.21.15.153:6789/0 conn(0x7f2cb015cea0 legacy=0x7f2cb015d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:22.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.302+0000 7f2cadd9b700 1 -- 172.21.15.153:0/3626140336 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb00ce5e0 con 0x7f2cb00d0010 2024-08-17T02:29:22.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.302+0000 7f2cadd9b700 1 --2- 172.21.15.153:0/3626140336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2cb00d0010 0x7f2cb00d0460 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f2ca00098e0 tx=0x7f2ca00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a998312be72f96e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:22.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.302+0000 7f2cad59a700 1 -- 172.21.15.153:0/3626140336 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca0009e80 con 0x7f2cb00d0010 2024-08-17T02:29:22.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.302+0000 7f2cad59a700 1 -- 172.21.15.153:0/3626140336 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca000b860 con 0x7f2cb00d0010 2024-08-17T02:29:22.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.302+0000 7f2cad59a700 1 -- 172.21.15.153:0/3626140336 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca000bbe0 con 0x7f2cb00d0010 2024-08-17T02:29:22.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.302+0000 7f2caf59e700 1 -- 172.21.15.153:0/3626140336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2cb00d0010 msgr2=0x7f2cb00d0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:22.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.302+0000 7f2caf59e700 1 --2- 172.21.15.153:0/3626140336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2cb00d0010 0x7f2cb00d0460 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f2ca00098e0 tx=0x7f2ca00091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.302+0000 7f2caf59e700 1 -- 172.21.15.153:0/3626140336 shutdown_connections 2024-08-17T02:29:22.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.302+0000 7f2caf59e700 1 --2- 172.21.15.153:0/3626140336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2cb00d0010 0x7f2cb00d0460 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.302+0000 7f2caf59e700 1 -- 172.21.15.153:0/3626140336 >> 172.21.15.153:0/3626140336 conn(0x7f2cb0068250 msgr2=0x7f2cb0068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:22.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.302+0000 7f2caf59e700 1 -- 172.21.15.153:0/3626140336 shutdown_connections 2024-08-17T02:29:22.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.302+0000 7f2caf59e700 1 -- 172.21.15.153:0/3626140336 wait complete. 2024-08-17T02:29:22.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.306+0000 7f2caf59e700 1 Processor -- start 2024-08-17T02:29:22.308 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.306+0000 7f2caf59e700 1 -- start start 2024-08-17T02:29:22.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.306+0000 7f2caf59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2cb00d0010 0x7f2cb016ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.306+0000 7f2caf59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2cb0159040 0x7f2cb0147ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.306+0000 7f2caf59e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2cb015cea0 0x7f2cb00a8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.306+0000 7f2caf59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb016aa60 con 0x7f2cb00d0010 2024-08-17T02:29:22.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.306+0000 7f2caf59e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb01481e0 con 0x7f2cb015cea0 2024-08-17T02:29:22.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.306+0000 7f2caf59e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb00a8ea0 con 0x7f2cb0159040 2024-08-17T02:29:22.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.306+0000 7f2cae59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2cb00d0010 0x7f2cb016ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.306+0000 7f2cae59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2cb00d0010 0x7f2cb016ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40510/0 (socket says 172.21.15.153:40510) 2024-08-17T02:29:22.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.306+0000 7f2cae59c700 1 -- 172.21.15.153:0/3523741673 learned_addr learned my addr 172.21.15.153:0/3523741673 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:22.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.306+0000 7f2cadd9b700 1 --2- 172.21.15.153:0/3523741673 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2cb0159040 0x7f2cb0147ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.306+0000 7f2cae59c700 1 -- 172.21.15.153:0/3523741673 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2cb0159040 msgr2=0x7f2cb0147ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:22.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.306+0000 7f2cae59c700 1 --2- 172.21.15.153:0/3523741673 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2cb0159040 0x7f2cb0147ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.306+0000 7f2cae59c700 1 -- 172.21.15.153:0/3523741673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2cb015cea0 msgr2=0x7f2cb00a8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:22.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.306+0000 7f2caed9d700 1 --2- 172.21.15.153:0/3523741673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2cb015cea0 0x7f2cb00a8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.306+0000 7f2cae59c700 1 --2- 172.21.15.153:0/3523741673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2cb015cea0 0x7f2cb00a8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.306+0000 7f2cae59c700 1 -- 172.21.15.153:0/3523741673 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca0009420 con 0x7f2cb00d0010 2024-08-17T02:29:22.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.306+0000 7f2cadd9b700 1 --2- 172.21.15.153:0/3523741673 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2cb0159040 0x7f2cb0147ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:22.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.306+0000 7f2caed9d700 1 --2- 172.21.15.153:0/3523741673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2cb015cea0 0x7f2cb00a8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:22.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.306+0000 7f2cae59c700 1 --2- 172.21.15.153:0/3523741673 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2cb00d0010 0x7f2cb016ac10 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2ca400c590 tx=0x7f2ca4007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:22.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.310+0000 7f2c9e7fc700 1 -- 172.21.15.153:0/3523741673 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4011590 con 0x7f2cb00d0010 2024-08-17T02:29:22.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.310+0000 7f2c9e7fc700 1 -- 172.21.15.153:0/3523741673 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca4011730 con 0x7f2cb00d0010 2024-08-17T02:29:22.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.310+0000 7f2c9e7fc700 1 -- 172.21.15.153:0/3523741673 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4011af0 con 0x7f2cb00d0010 2024-08-17T02:29:22.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.310+0000 7f2caf59e700 1 -- 172.21.15.153:0/3523741673 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb0169ee0 con 0x7f2cb00d0010 2024-08-17T02:29:22.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.310+0000 7f2caf59e700 1 -- 172.21.15.153:0/3523741673 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb016a4a0 con 0x7f2cb00d0010 2024-08-17T02:29:22.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.310+0000 7f2c9e7fc700 1 -- 172.21.15.153:0/3523741673 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2ca4012420 con 0x7f2cb00d0010 2024-08-17T02:29:22.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.310+0000 7f2caf59e700 1 -- 172.21.15.153:0/3523741673 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cb00643a0 con 0x7f2cb00d0010 2024-08-17T02:29:22.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.310+0000 7f2c9e7fc700 1 --2- 172.21.15.153:0/3523741673 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2c90060860 0x7f2c90062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.314+0000 7f2cadd9b700 1 --2- 172.21.15.153:0/3523741673 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2c90060860 0x7f2c90062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.314+0000 7f2c9e7fc700 1 -- 172.21.15.153:0/3523741673 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f2ca407bf90 con 0x7f2cb00d0010 2024-08-17T02:29:22.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.314+0000 7f2cadd9b700 1 --2- 172.21.15.153:0/3523741673 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2c90060860 0x7f2c90062d10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2cb015bbd0 tx=0x7f2ca0017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:22.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.322+0000 7f2c9e7fc700 1 -- 172.21.15.153:0/3523741673 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f2ca404a480 con 0x7f2cb00d0010 2024-08-17T02:29:22.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.522+0000 7f2caf59e700 1 -- 172.21.15.153:0/3523741673 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "volume_0000000000118573"} v 0) v1 -- 0x7f2cb00cfdf0 con 0x7f2cb00d0010 2024-08-17T02:29:22.525 INFO:tasks.ceph.mon.a.smithi153.stderr:2024-08-17T02:29:22.522+0000 7ff8ba661700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:29:22.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.530+0000 7f2c9e7fc700 1 -- 172.21.15.153:0/3523741673 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "volume_0000000000118573"}]=0 volume_0000000000118573 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v21) v1 ==== 195+0+0 (secure 0 0 0) 0x7f2ca4017020 con 0x7f2cb00d0010 2024-08-17T02:29:22.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.534+0000 7f2caf59e700 1 -- 172.21.15.153:0/3523741673 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2c90060860 msgr2=0x7f2c90062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:22.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.534+0000 7f2caf59e700 1 --2- 172.21.15.153:0/3523741673 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2c90060860 0x7f2c90062d10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2cb015bbd0 tx=0x7f2ca0017000 comp rx=0 tx=0).stop 2024-08-17T02:29:22.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.534+0000 7f2caf59e700 1 -- 172.21.15.153:0/3523741673 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2cb00d0010 msgr2=0x7f2cb016ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:22.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.534+0000 7f2caf59e700 1 --2- 172.21.15.153:0/3523741673 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2cb00d0010 0x7f2cb016ac10 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2ca400c590 tx=0x7f2ca4007f30 comp rx=0 tx=0).stop 2024-08-17T02:29:22.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.534+0000 7f2caf59e700 1 -- 172.21.15.153:0/3523741673 shutdown_connections 2024-08-17T02:29:22.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.534+0000 7f2caf59e700 1 --2- 172.21.15.153:0/3523741673 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2c90060860 0x7f2c90062d10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.534+0000 7f2caf59e700 1 --2- 172.21.15.153:0/3523741673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2cb015cea0 0x7f2cb00a8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.534+0000 7f2caf59e700 1 --2- 172.21.15.153:0/3523741673 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2cb0159040 0x7f2cb0147ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.534+0000 7f2caf59e700 1 --2- 172.21.15.153:0/3523741673 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2cb00d0010 0x7f2cb016ac10 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.534+0000 7f2caf59e700 1 -- 172.21.15.153:0/3523741673 >> 172.21.15.153:0/3523741673 conn(0x7f2cb0068250 msgr2=0x7f2cb0154510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:22.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.534+0000 7f2caf59e700 1 -- 172.21.15.153:0/3523741673 shutdown_connections 2024-08-17T02:29:22.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.534+0000 7f2caf59e700 1 -- 172.21.15.153:0/3523741673 wait complete. 2024-08-17T02:29:22.536 INFO:teuthology.orchestra.run.smithi153.stderr:volume_0000000000118573 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:29:22.537 INFO:tasks.ceph.mds.a.smithi153.stderr: -3039> 2024-08-17T02:27:16.460+0000 7fe8be428700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:29:22.548 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm volume_0000000000118573 --yes-i-really-mean-it 2024-08-17T02:29:22.566 INFO:tasks.ceph.mds.a.smithi153.stdout:starting mds.a at 2024-08-17T02:29:22.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.658+0000 7f1e29f69700 1 Processor -- start 2024-08-17T02:29:22.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.658+0000 7f1e29f69700 1 -- start start 2024-08-17T02:29:22.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.658+0000 7f1e29f69700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e241505b0 0x7f1e240686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.658+0000 7f1e29f69700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1e24068be0 0x7f1e240af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.658+0000 7f1e29f69700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e24157160 con 0x7f1e241501e0 2024-08-17T02:29:22.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.658+0000 7f1e29f69700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e24069020 con 0x7f1e24068be0 2024-08-17T02:29:22.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.658+0000 7f1e29f69700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e24156550 con 0x7f1e241505b0 2024-08-17T02:29:22.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.658+0000 7f1e28f67700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f1e241501e0 0x7f1e240ab7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:49816/0 (socket says 172.21.15.153:49816) 2024-08-17T02:29:22.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.658+0000 7f1e28f67700 1 -- 172.21.15.153:0/1793758405 learned_addr learned my addr 172.21.15.153:0/1793758405 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:29:22.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.658+0000 7f1e1bfff700 1 --2- 172.21.15.153:0/1793758405 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e241505b0 0x7f1e240686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.658+0000 7f1e29768700 1 --2- 172.21.15.153:0/1793758405 >> v2:172.21.15.174:3300/0 conn(0x7f1e24068be0 0x7f1e240af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.658+0000 7f1e1b7fe700 1 -- 172.21.15.153:0/1793758405 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2798062103 0 0) 0x7f1e24157160 con 0x7f1e241501e0 2024-08-17T02:29:22.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.658+0000 7f1e1b7fe700 1 -- 172.21.15.153:0/1793758405 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e0c003570 con 0x7f1e241501e0 2024-08-17T02:29:22.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.662+0000 7f1e1b7fe700 1 -- 172.21.15.153:0/1793758405 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2532444492 0 0) 0x7f1e0c003570 con 0x7f1e241501e0 2024-08-17T02:29:22.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.662+0000 7f1e1b7fe700 1 -- 172.21.15.153:0/1793758405 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e241505b0 msgr2=0x7f1e240686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:22.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.662+0000 7f1e1b7fe700 1 --2- 172.21.15.153:0/1793758405 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e241505b0 0x7f1e240686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.662+0000 7f1e1b7fe700 1 -- 172.21.15.153:0/1793758405 >> v2:172.21.15.174:3300/0 conn(0x7f1e24068be0 msgr2=0x7f1e240af5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:22.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.662+0000 7f1e1b7fe700 1 --2- 172.21.15.153:0/1793758405 >> v2:172.21.15.174:3300/0 conn(0x7f1e24068be0 0x7f1e240af5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.662+0000 7f1e1b7fe700 1 -- 172.21.15.153:0/1793758405 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e24156830 con 0x7f1e241501e0 2024-08-17T02:29:22.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.662+0000 7f1e1b7fe700 1 -- 172.21.15.153:0/1793758405 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3701463666 0 0) 0x7f1e20001470 con 0x7f1e241501e0 2024-08-17T02:29:22.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.662+0000 7f1e1b7fe700 1 -- 172.21.15.153:0/1793758405 >> v1:172.21.15.153:6789/0 conn(0x7f1e241501e0 legacy=0x7f1e240ab7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:22.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.662+0000 7f1e1b7fe700 1 --2- 172.21.15.153:0/1793758405 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e241505b0 0x7f1e0c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.662+0000 7f1e1b7fe700 1 --2- 172.21.15.153:0/1793758405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e0c003fe0 0x7f1e0c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.662+0000 7f1e1b7fe700 1 --2- 172.21.15.153:0/1793758405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1e0c004d50 0x7f1e0c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.662+0000 7f1e1b7fe700 1 -- 172.21.15.153:0/1793758405 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e24069020 con 0x7f1e0c003fe0 2024-08-17T02:29:22.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.662+0000 7f1e1b7fe700 1 -- 172.21.15.153:0/1793758405 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e24156550 con 0x7f1e0c004d50 2024-08-17T02:29:22.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.662+0000 7f1e1b7fe700 1 -- 172.21.15.153:0/1793758405 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0c00dca0 con 0x7f1e241505b0 2024-08-17T02:29:22.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.662+0000 7f1e1bfff700 1 --2- 172.21.15.153:0/1793758405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e0c003fe0 0x7f1e0c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.662+0000 7f1e28f67700 1 --2- 172.21.15.153:0/1793758405 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e241505b0 0x7f1e0c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.662+0000 7f1e29768700 1 --2- 172.21.15.153:0/1793758405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1e0c004d50 0x7f1e0c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.662+0000 7f1e1bfff700 1 -- 172.21.15.153:0/1793758405 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e241505b0 msgr2=0x7f1e0c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:22.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.662+0000 7f1e1bfff700 1 --2- 172.21.15.153:0/1793758405 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e241505b0 0x7f1e0c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.662+0000 7f1e1bfff700 1 -- 172.21.15.153:0/1793758405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1e0c004d50 msgr2=0x7f1e0c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:22.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.662+0000 7f1e1bfff700 1 --2- 172.21.15.153:0/1793758405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1e0c004d50 0x7f1e0c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.662+0000 7f1e1bfff700 1 -- 172.21.15.153:0/1793758405 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e0c003570 con 0x7f1e0c003fe0 2024-08-17T02:29:22.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.662+0000 7f1e29768700 1 --2- 172.21.15.153:0/1793758405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1e0c004d50 0x7f1e0c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:22.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.662+0000 7f1e1bfff700 1 --2- 172.21.15.153:0/1793758405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e0c003fe0 0x7f1e0c004810 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1e14009c00 tx=0x7f1e140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2cd11fabf7dba37 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:22.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.662+0000 7f1e1b7fe700 1 -- 172.21.15.153:0/1793758405 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1400e6b0 con 0x7f1e0c003fe0 2024-08-17T02:29:22.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.662+0000 7f1e1b7fe700 1 -- 172.21.15.153:0/1793758405 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1400e810 con 0x7f1e0c003fe0 2024-08-17T02:29:22.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.662+0000 7f1e1b7fe700 1 -- 172.21.15.153:0/1793758405 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1400ebd0 con 0x7f1e0c003fe0 2024-08-17T02:29:22.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.662+0000 7f1e29f69700 1 -- 172.21.15.153:0/1793758405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e0c003fe0 msgr2=0x7f1e0c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:22.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.662+0000 7f1e29f69700 1 --2- 172.21.15.153:0/1793758405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e0c003fe0 0x7f1e0c004810 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1e14009c00 tx=0x7f1e140091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.662+0000 7f1e29768700 1 -- 172.21.15.153:0/1793758405 reap_dead start 2024-08-17T02:29:22.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.662+0000 7f1e29f69700 1 -- 172.21.15.153:0/1793758405 shutdown_connections 2024-08-17T02:29:22.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.662+0000 7f1e29f69700 1 -- 172.21.15.153:0/1793758405 >> 172.21.15.153:0/1793758405 conn(0x7f1e2406e310 msgr2=0x7f1e2406b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:22.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.662+0000 7f1e29f69700 1 -- 172.21.15.153:0/1793758405 shutdown_connections 2024-08-17T02:29:22.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.662+0000 7f1e29f69700 1 -- 172.21.15.153:0/1793758405 wait complete. 2024-08-17T02:29:22.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.666+0000 7f1e29f69700 1 Processor -- start 2024-08-17T02:29:22.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.666+0000 7f1e29f69700 1 -- start start 2024-08-17T02:29:22.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.666+0000 7f1e29f69700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e0c003fe0 0x7f1e2414a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.666+0000 7f1e29f69700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1e240a7db0 0x7f1e240a5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.666+0000 7f1e29f69700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e24151ca0 0x7f1e24152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.666+0000 7f1e29f69700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2414ae40 con 0x7f1e0c003fe0 2024-08-17T02:29:22.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.666+0000 7f1e29f69700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e241509b0 con 0x7f1e240a7db0 2024-08-17T02:29:22.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.666+0000 7f1e29f69700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e24151810 con 0x7f1e24151ca0 2024-08-17T02:29:22.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.666+0000 7f1e28f67700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e0c003fe0 0x7f1e2414a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.666+0000 7f1e28f67700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e0c003fe0 0x7f1e2414a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40532/0 (socket says 172.21.15.153:40532) 2024-08-17T02:29:22.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.666+0000 7f1e28f67700 1 -- 172.21.15.153:0/2707626092 learned_addr learned my addr 172.21.15.153:0/2707626092 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:22.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.666+0000 7f1e1bfff700 1 --2- 172.21.15.153:0/2707626092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1e240a7db0 0x7f1e240a5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.666+0000 7f1e29768700 1 --2- 172.21.15.153:0/2707626092 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e24151ca0 0x7f1e24152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.670+0000 7f1e28f67700 1 -- 172.21.15.153:0/2707626092 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e24151ca0 msgr2=0x7f1e24152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:22.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.670+0000 7f1e28f67700 1 --2- 172.21.15.153:0/2707626092 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e24151ca0 0x7f1e24152120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.670+0000 7f1e28f67700 1 -- 172.21.15.153:0/2707626092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1e240a7db0 msgr2=0x7f1e240a5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:22.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.670+0000 7f1e28f67700 1 --2- 172.21.15.153:0/2707626092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1e240a7db0 0x7f1e240a5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.670+0000 7f1e28f67700 1 -- 172.21.15.153:0/2707626092 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e24150c00 con 0x7f1e0c003fe0 2024-08-17T02:29:22.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.670+0000 7f1e28f67700 1 --2- 172.21.15.153:0/2707626092 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e0c003fe0 0x7f1e2414a900 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f1e2000eb90 tx=0x7f1e20000d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:22.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.670+0000 7f1e18ff9700 1 -- 172.21.15.153:0/2707626092 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2000c550 con 0x7f1e0c003fe0 2024-08-17T02:29:22.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.670+0000 7f1e18ff9700 1 -- 172.21.15.153:0/2707626092 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2000c6b0 con 0x7f1e0c003fe0 2024-08-17T02:29:22.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.670+0000 7f1e29f69700 1 -- 172.21.15.153:0/2707626092 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e24150ee0 con 0x7f1e0c003fe0 2024-08-17T02:29:22.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.670+0000 7f1e18ff9700 1 -- 172.21.15.153:0/2707626092 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2000ca50 con 0x7f1e0c003fe0 2024-08-17T02:29:22.673 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.670+0000 7f1e29f69700 1 -- 172.21.15.153:0/2707626092 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e241514a0 con 0x7f1e0c003fe0 2024-08-17T02:29:22.673 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.670+0000 7f1e29f69700 1 -- 172.21.15.153:0/2707626092 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e240638f0 con 0x7f1e0c003fe0 2024-08-17T02:29:22.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.670+0000 7f1e18ff9700 1 -- 172.21.15.153:0/2707626092 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1e2001d460 con 0x7f1e0c003fe0 2024-08-17T02:29:22.675 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.674+0000 7f1e18ff9700 1 --2- 172.21.15.153:0/2707626092 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1e10060860 0x7f1e10062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.675 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.674+0000 7f1e18ff9700 1 -- 172.21.15.153:0/2707626092 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5923+0+0 (secure 0 0 0) 0x7f1e2007cbe0 con 0x7f1e0c003fe0 2024-08-17T02:29:22.675 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.674+0000 7f1e1bfff700 1 --2- 172.21.15.153:0/2707626092 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1e10060860 0x7f1e10062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.675 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.674+0000 7f1e1bfff700 1 --2- 172.21.15.153:0/2707626092 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1e10060860 0x7f1e10062d10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1e140091e0 tx=0x7f1e1401a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:22.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.682+0000 7f1e18ff9700 1 -- 172.21.15.153:0/2707626092 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1e2004cf50 con 0x7f1e0c003fe0 2024-08-17T02:29:22.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:22.874+0000 7f1e29f69700 1 -- 172.21.15.153:0/2707626092 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "volume_0000000000118573", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1e240afde0 con 0x7f1e0c003fe0 2024-08-17T02:29:23.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.530+0000 7f1e18ff9700 1 -- 172.21.15.153:0/2707626092 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "volume_0000000000118573", "yes_i_really_mean_it": true}]=0 v22) v1 ==== 121+0+0 (secure 0 0 0) 0x7f1e20050570 con 0x7f1e0c003fe0 2024-08-17T02:29:23.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.538+0000 7f1e29f69700 1 -- 172.21.15.153:0/2707626092 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1e10060860 msgr2=0x7f1e10062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:23.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.538+0000 7f1e29f69700 1 --2- 172.21.15.153:0/2707626092 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1e10060860 0x7f1e10062d10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1e140091e0 tx=0x7f1e1401a000 comp rx=0 tx=0).stop 2024-08-17T02:29:23.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.538+0000 7f1e29f69700 1 -- 172.21.15.153:0/2707626092 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e0c003fe0 msgr2=0x7f1e2414a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:23.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.538+0000 7f1e29f69700 1 --2- 172.21.15.153:0/2707626092 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e0c003fe0 0x7f1e2414a900 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f1e2000eb90 tx=0x7f1e20000d00 comp rx=0 tx=0).stop 2024-08-17T02:29:23.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.538+0000 7f1e29f69700 1 -- 172.21.15.153:0/2707626092 shutdown_connections 2024-08-17T02:29:23.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.538+0000 7f1e29f69700 1 --2- 172.21.15.153:0/2707626092 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1e10060860 0x7f1e10062d10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.538+0000 7f1e29f69700 1 --2- 172.21.15.153:0/2707626092 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e24151ca0 0x7f1e24152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.538+0000 7f1e29f69700 1 --2- 172.21.15.153:0/2707626092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1e240a7db0 0x7f1e240a5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.538+0000 7f1e29f69700 1 --2- 172.21.15.153:0/2707626092 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e0c003fe0 0x7f1e2414a900 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.538+0000 7f1e29f69700 1 -- 172.21.15.153:0/2707626092 >> 172.21.15.153:0/2707626092 conn(0x7f1e2406e310 msgr2=0x7f1e240b08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:23.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.538+0000 7f1e29f69700 1 -- 172.21.15.153:0/2707626092 shutdown_connections 2024-08-17T02:29:23.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.538+0000 7f1e29f69700 1 -- 172.21.15.153:0/2707626092 wait complete. 2024-08-17T02:29:23.555 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000118573.meta cephfs.volume_0000000000118573.meta --yes-i-really-really-mean-it 2024-08-17T02:29:23.675 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.674+0000 7f8fc5f09700 1 Processor -- start 2024-08-17T02:29:23.675 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.674+0000 7f8fc5f09700 1 -- start start 2024-08-17T02:29:23.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.674+0000 7f8fc5f09700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8fc0159010 0x7f8fc0068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:23.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.674+0000 7f8fc5f09700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc00b2f40 con 0x7f8fc00add70 2024-08-17T02:29:23.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.674+0000 7f8fc5f09700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc0069790 con 0x7f8fc01593e0 2024-08-17T02:29:23.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.674+0000 7f8fc5f09700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc0069a50 con 0x7f8fc0159010 2024-08-17T02:29:23.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.674+0000 7f8fc5708700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f8fc00add70 0x7f8fc00b33d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:49828/0 (socket says 172.21.15.153:49828) 2024-08-17T02:29:23.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.674+0000 7f8fc5708700 1 -- 172.21.15.153:0/3418789105 learned_addr learned my addr 172.21.15.153:0/3418789105 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:29:23.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.674+0000 7f8fc4f07700 1 --2- 172.21.15.153:0/3418789105 >> v2:172.21.15.174:3300/0 conn(0x7f8fc0159010 0x7f8fc0068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:23.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.674+0000 7f8fbf7fe700 1 -- 172.21.15.153:0/3418789105 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1111112972 0 0) 0x7f8fc00b2f40 con 0x7f8fc00add70 2024-08-17T02:29:23.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.674+0000 7f8fbf7fe700 1 -- 172.21.15.153:0/3418789105 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fac003570 con 0x7f8fc00add70 2024-08-17T02:29:23.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.674+0000 7f8fbf7fe700 1 -- 172.21.15.153:0/3418789105 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1388859411 0 0) 0x7f8fc0069790 con 0x7f8fc01593e0 2024-08-17T02:29:23.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.674+0000 7f8fbf7fe700 1 -- 172.21.15.153:0/3418789105 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fc00b2f40 con 0x7f8fc01593e0 2024-08-17T02:29:23.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.674+0000 7f8fbf7fe700 1 -- 172.21.15.153:0/3418789105 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2626501504 0 0) 0x7f8fac003570 con 0x7f8fc00add70 2024-08-17T02:29:23.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.674+0000 7f8fbf7fe700 1 -- 172.21.15.153:0/3418789105 >> v2:172.21.15.174:3300/0 conn(0x7f8fc0159010 msgr2=0x7f8fc0068ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:23.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.674+0000 7f8fbf7fe700 1 --2- 172.21.15.153:0/3418789105 >> v2:172.21.15.174:3300/0 conn(0x7f8fc0159010 0x7f8fc0068ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.674+0000 7f8fbf7fe700 1 -- 172.21.15.153:0/3418789105 >> v1:172.21.15.174:6789/0 conn(0x7f8fc01593e0 legacy=0x7f8fc00ad660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:23.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.674+0000 7f8fbf7fe700 1 -- 172.21.15.153:0/3418789105 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc0069d30 con 0x7f8fc00add70 2024-08-17T02:29:23.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.674+0000 7f8fbf7fe700 1 -- 172.21.15.153:0/3418789105 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3701463666 0 0) 0x7f8fb80017f0 con 0x7f8fc00add70 2024-08-17T02:29:23.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.674+0000 7f8fbf7fe700 1 -- 172.21.15.153:0/3418789105 >> v1:172.21.15.153:6789/0 conn(0x7f8fc00add70 legacy=0x7f8fc00b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:23.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.674+0000 7f8fbf7fe700 1 --2- 172.21.15.153:0/3418789105 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fac003bf0 0x7f8fac003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:23.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.674+0000 7f8fbf7fe700 1 --2- 172.21.15.153:0/3418789105 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8fac004810 0x7f8fac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:23.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.674+0000 7f8fbf7fe700 1 --2- 172.21.15.153:0/3418789105 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8fac0051c0 0x7f8fac00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:23.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.674+0000 7f8fbf7fe700 1 -- 172.21.15.153:0/3418789105 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc0069a50 con 0x7f8fac003bf0 2024-08-17T02:29:23.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.674+0000 7f8fbf7fe700 1 -- 172.21.15.153:0/3418789105 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac00c0b0 con 0x7f8fac0051c0 2024-08-17T02:29:23.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.674+0000 7f8fbf7fe700 1 -- 172.21.15.153:0/3418789105 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac00c270 con 0x7f8fac004810 2024-08-17T02:29:23.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.674+0000 7f8fc4f07700 1 --2- 172.21.15.153:0/3418789105 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fac003bf0 0x7f8fac003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:23.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.674+0000 7f8fbffff700 1 --2- 172.21.15.153:0/3418789105 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8fac004810 0x7f8fac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:23.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.674+0000 7f8fc5708700 1 --2- 172.21.15.153:0/3418789105 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8fac0051c0 0x7f8fac00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:23.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.674+0000 7f8fc4f07700 1 -- 172.21.15.153:0/3418789105 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8fac004810 msgr2=0x7f8fac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:23.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.674+0000 7f8fc4f07700 1 --2- 172.21.15.153:0/3418789105 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8fac004810 0x7f8fac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.674+0000 7f8fc4f07700 1 -- 172.21.15.153:0/3418789105 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8fac0051c0 msgr2=0x7f8fac00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:23.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.674+0000 7f8fc4f07700 1 --2- 172.21.15.153:0/3418789105 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8fac0051c0 0x7f8fac00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.674+0000 7f8fc4f07700 1 -- 172.21.15.153:0/3418789105 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fac003570 con 0x7f8fac003bf0 2024-08-17T02:29:23.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.674+0000 7f8fbffff700 1 --2- 172.21.15.153:0/3418789105 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8fac004810 0x7f8fac004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:23.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.674+0000 7f8fc5708700 1 --2- 172.21.15.153:0/3418789105 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8fac0051c0 0x7f8fac00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:23.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.674+0000 7f8fc5708700 1 -- 172.21.15.153:0/3418789105 reap_dead start 2024-08-17T02:29:23.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.678+0000 7f8fc4f07700 1 --2- 172.21.15.153:0/3418789105 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fac003bf0 0x7f8fac003fe0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8009c00 tx=0x7f8fa80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b8ba05ba96d3591 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:23.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.678+0000 7f8fbf7fe700 1 -- 172.21.15.153:0/3418789105 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa800e710 con 0x7f8fac003bf0 2024-08-17T02:29:23.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.678+0000 7f8fbf7fe700 1 -- 172.21.15.153:0/3418789105 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa800e870 con 0x7f8fac003bf0 2024-08-17T02:29:23.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.678+0000 7f8fbf7fe700 1 -- 172.21.15.153:0/3418789105 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa800ec30 con 0x7f8fac003bf0 2024-08-17T02:29:23.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.678+0000 7f8fc5f09700 1 -- 172.21.15.153:0/3418789105 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fac003bf0 msgr2=0x7f8fac003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:23.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.678+0000 7f8fc5f09700 1 --2- 172.21.15.153:0/3418789105 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fac003bf0 0x7f8fac003fe0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8009c00 tx=0x7f8fa80091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.678+0000 7f8fc5f09700 1 -- 172.21.15.153:0/3418789105 shutdown_connections 2024-08-17T02:29:23.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.678+0000 7f8fc5f09700 1 --2- 172.21.15.153:0/3418789105 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fac003bf0 0x7f8fac003fe0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.678+0000 7f8fc5f09700 1 -- 172.21.15.153:0/3418789105 >> 172.21.15.153:0/3418789105 conn(0x7f8fc0099410 msgr2=0x7f8fc0067590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:23.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.678+0000 7f8fc5f09700 1 -- 172.21.15.153:0/3418789105 shutdown_connections 2024-08-17T02:29:23.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.678+0000 7f8fc5f09700 1 -- 172.21.15.153:0/3418789105 wait complete. 2024-08-17T02:29:23.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.682+0000 7f8fc5f09700 1 Processor -- start 2024-08-17T02:29:23.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.682+0000 7f8fc5f09700 1 -- start start 2024-08-17T02:29:23.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.682+0000 7f8fc5f09700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8fc014bca0 0x7f8fc014db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:23.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.682+0000 7f8fc5f09700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8fc015c910 0x7f8fc015b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:23.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.682+0000 7f8fc5f09700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fc00b46e0 0x7f8fc00b4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:23.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.682+0000 7f8fc5f09700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc00b50c0 con 0x7f8fc00b46e0 2024-08-17T02:29:23.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.682+0000 7f8fc5f09700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc015c480 con 0x7f8fc015c910 2024-08-17T02:29:23.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.682+0000 7f8fc5f09700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc015b5f0 con 0x7f8fc014bca0 2024-08-17T02:29:23.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.682+0000 7f8fc5708700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fc00b46e0 0x7f8fc00b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:23.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.682+0000 7f8fc5708700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fc00b46e0 0x7f8fc00b4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40558/0 (socket says 172.21.15.153:40558) 2024-08-17T02:29:23.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.682+0000 7f8fc5708700 1 -- 172.21.15.153:0/1943972894 learned_addr learned my addr 172.21.15.153:0/1943972894 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:23.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.682+0000 7f8fbffff700 1 --2- 172.21.15.153:0/1943972894 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8fc015c910 0x7f8fc015b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:23.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.682+0000 7f8fc4f07700 1 --2- 172.21.15.153:0/1943972894 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8fc014bca0 0x7f8fc014db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:23.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.682+0000 7f8fc5708700 1 -- 172.21.15.153:0/1943972894 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8fc014bca0 msgr2=0x7f8fc014db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:23.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.682+0000 7f8fc5708700 1 --2- 172.21.15.153:0/1943972894 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8fc014bca0 0x7f8fc014db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.682+0000 7f8fc5708700 1 -- 172.21.15.153:0/1943972894 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8fc015c910 msgr2=0x7f8fc015b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:23.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.682+0000 7f8fc5708700 1 --2- 172.21.15.153:0/1943972894 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8fc015c910 0x7f8fc015b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.682+0000 7f8fc5708700 1 -- 172.21.15.153:0/1943972894 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc015b870 con 0x7f8fc00b46e0 2024-08-17T02:29:23.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.682+0000 7f8fbffff700 1 --2- 172.21.15.153:0/1943972894 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8fc015c910 0x7f8fc015b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:23.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.682+0000 7f8fc5708700 1 --2- 172.21.15.153:0/1943972894 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fc00b46e0 0x7f8fc00b4b80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8fc00aebc0 tx=0x7f8fb8001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:23.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.682+0000 7f8fbcff9700 1 -- 172.21.15.153:0/1943972894 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb8017070 con 0x7f8fc00b46e0 2024-08-17T02:29:23.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.686+0000 7f8fbcff9700 1 -- 172.21.15.153:0/1943972894 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb800e9e0 con 0x7f8fc00b46e0 2024-08-17T02:29:23.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.686+0000 7f8fbcff9700 1 -- 172.21.15.153:0/1943972894 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb800edc0 con 0x7f8fc00b46e0 2024-08-17T02:29:23.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.686+0000 7f8fc5f09700 1 -- 172.21.15.153:0/1943972894 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc015bb50 con 0x7f8fc00b46e0 2024-08-17T02:29:23.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.686+0000 7f8fc5f09700 1 -- 172.21.15.153:0/1943972894 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc015c110 con 0x7f8fc00b46e0 2024-08-17T02:29:23.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.686+0000 7f8fc5f09700 1 -- 172.21.15.153:0/1943972894 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fc00644b0 con 0x7f8fc00b46e0 2024-08-17T02:29:23.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.686+0000 7f8fbcff9700 1 -- 172.21.15.153:0/1943972894 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8fb8013630 con 0x7f8fc00b46e0 2024-08-17T02:29:23.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.686+0000 7f8fbcff9700 1 --2- 172.21.15.153:0/1943972894 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8fa0060860 0x7f8fa0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:23.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.686+0000 7f8fbcff9700 1 -- 172.21.15.153:0/1943972894 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5923+0+0 (secure 0 0 0) 0x7f8fb807c940 con 0x7f8fc00b46e0 2024-08-17T02:29:23.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.686+0000 7f8fc4f07700 1 --2- 172.21.15.153:0/1943972894 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8fa0060860 0x7f8fa0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:23.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.686+0000 7f8fc4f07700 1 --2- 172.21.15.153:0/1943972894 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8fa0060860 0x7f8fa0062d10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0067d00 tx=0x7f8fa801a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:23.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.694+0000 7f8fbcff9700 1 -- 172.21.15.153:0/1943972894 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f8fb804ccb0 con 0x7f8fc00b46e0 2024-08-17T02:29:23.863 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:23.862+0000 7f8fc5f09700 1 -- 172.21.15.153:0/1943972894 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000118573.meta", "pool2": "cephfs.volume_0000000000118573.meta", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8fc0067f10 con 0x7f8fc00b46e0 2024-08-17T02:29:24.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.541+0000 7f8fbcff9700 1 -- 172.21.15.153:0/1943972894 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000118573.meta", "pool2": "cephfs.volume_0000000000118573.meta", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000118573.meta' removed v42) v1 ==== 241+0+0 (secure 0 0 0) 0x7f8fb80502d0 con 0x7f8fc00b46e0 2024-08-17T02:29:24.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.545+0000 7f8fc5f09700 1 -- 172.21.15.153:0/1943972894 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8fa0060860 msgr2=0x7f8fa0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:24.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.545+0000 7f8fc5f09700 1 --2- 172.21.15.153:0/1943972894 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8fa0060860 0x7f8fa0062d10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0067d00 tx=0x7f8fa801a000 comp rx=0 tx=0).stop 2024-08-17T02:29:24.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.545+0000 7f8fc5f09700 1 -- 172.21.15.153:0/1943972894 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fc00b46e0 msgr2=0x7f8fc00b4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:24.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.545+0000 7f8fc5f09700 1 --2- 172.21.15.153:0/1943972894 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fc00b46e0 0x7f8fc00b4b80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8fc00aebc0 tx=0x7f8fb8001250 comp rx=0 tx=0).stop 2024-08-17T02:29:24.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.545+0000 7f8fc5f09700 1 -- 172.21.15.153:0/1943972894 shutdown_connections 2024-08-17T02:29:24.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.545+0000 7f8fc5f09700 1 --2- 172.21.15.153:0/1943972894 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8fa0060860 0x7f8fa0062d10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.545+0000 7f8fc5f09700 1 --2- 172.21.15.153:0/1943972894 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fc00b46e0 0x7f8fc00b4b80 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.545+0000 7f8fc5f09700 1 --2- 172.21.15.153:0/1943972894 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8fc015c910 0x7f8fc015b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.545+0000 7f8fc5f09700 1 --2- 172.21.15.153:0/1943972894 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8fc014bca0 0x7f8fc014db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.545+0000 7f8fc5f09700 1 -- 172.21.15.153:0/1943972894 >> 172.21.15.153:0/1943972894 conn(0x7f8fc0099410 msgr2=0x7f8fc01582d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:24.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.545+0000 7f8fc5f09700 1 -- 172.21.15.153:0/1943972894 shutdown_connections 2024-08-17T02:29:24.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.545+0000 7f8fc5f09700 1 -- 172.21.15.153:0/1943972894 wait complete. 2024-08-17T02:29:24.552 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs.volume_0000000000118573.meta' removed 2024-08-17T02:29:24.564 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000118573.data cephfs.volume_0000000000118573.data --yes-i-really-really-mean-it 2024-08-17T02:29:24.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.673+0000 7f53c54e9700 1 Processor -- start 2024-08-17T02:29:24.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.673+0000 7f53c54e9700 1 -- start start 2024-08-17T02:29:24.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.673+0000 7f53c54e9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f53c00cd2b0 0x7f53c00cd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:24.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.673+0000 7f53c54e9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f53c00ceb70 0x7f53c0162ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:24.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.673+0000 7f53c54e9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53c00cc480 con 0x7f53c00caeb0 2024-08-17T02:29:24.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.673+0000 7f53c54e9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c0159720 con 0x7f53c00cd2b0 2024-08-17T02:29:24.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.673+0000 7f53c54e9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c00cb870 con 0x7f53c00ceb70 2024-08-17T02:29:24.679 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.673+0000 7f53beffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f53c00cd2b0 0x7f53c00cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:24.679 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.673+0000 7f53be7fc700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f53c00caeb0 0x7f53c00ce460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:49830/0 (socket says 172.21.15.153:49830) 2024-08-17T02:29:24.679 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.673+0000 7f53be7fc700 1 -- 172.21.15.153:0/145851866 learned_addr learned my addr 172.21.15.153:0/145851866 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:29:24.679 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.673+0000 7f53bf7fe700 1 --2- 172.21.15.153:0/145851866 >> v2:172.21.15.174:3300/0 conn(0x7f53c00ceb70 0x7f53c0162ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:24.679 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.673+0000 7f53bdffb700 1 -- 172.21.15.153:0/145851866 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 602301024 0 0) 0x7f53c00cc480 con 0x7f53c00caeb0 2024-08-17T02:29:24.679 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.673+0000 7f53bdffb700 1 -- 172.21.15.153:0/145851866 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53a8003570 con 0x7f53c00caeb0 2024-08-17T02:29:24.679 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.673+0000 7f53beffd700 1 -- 172.21.15.153:0/145851866 >> v2:172.21.15.174:3300/0 conn(0x7f53c00ceb70 msgr2=0x7f53c0162ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:24.679 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.673+0000 7f53beffd700 1 --2- 172.21.15.153:0/145851866 >> v2:172.21.15.174:3300/0 conn(0x7f53c00ceb70 0x7f53c0162ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.679 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.673+0000 7f53bdffb700 1 -- 172.21.15.153:0/145851866 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 579608630 0 0) 0x7f53a8003570 con 0x7f53c00caeb0 2024-08-17T02:29:24.679 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.673+0000 7f53beffd700 1 -- 172.21.15.153:0/145851866 >> v1:172.21.15.153:6789/0 conn(0x7f53c00caeb0 legacy=0x7f53c00ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:24.679 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.673+0000 7f53beffd700 1 -- 172.21.15.153:0/145851866 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c00cbb50 con 0x7f53c00cd2b0 2024-08-17T02:29:24.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.677+0000 7f53beffd700 1 --2- 172.21.15.153:0/145851866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53c00cd2b0 0x7f53c00cd680 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f53c0099c60 tx=0x7f53b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea4ae14a0af1bfda server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:24.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.677+0000 7f53bdffb700 1 -- 172.21.15.153:0/145851866 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b0001470 con 0x7f53c00cd2b0 2024-08-17T02:29:24.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.677+0000 7f53bdffb700 1 -- 172.21.15.153:0/145851866 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b4011420 con 0x7f53c00cd2b0 2024-08-17T02:29:24.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.677+0000 7f53bdffb700 1 -- 172.21.15.153:0/145851866 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b40117c0 con 0x7f53c00cd2b0 2024-08-17T02:29:24.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.677+0000 7f53c54e9700 1 -- 172.21.15.153:0/145851866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53c00cd2b0 msgr2=0x7f53c00cd680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:24.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.677+0000 7f53c54e9700 1 --2- 172.21.15.153:0/145851866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53c00cd2b0 0x7f53c00cd680 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f53c0099c60 tx=0x7f53b40091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.677+0000 7f53c54e9700 1 -- 172.21.15.153:0/145851866 shutdown_connections 2024-08-17T02:29:24.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.677+0000 7f53c54e9700 1 --2- 172.21.15.153:0/145851866 >> v2:172.21.15.174:3300/0 conn(0x7f53c00ceb70 0x7f53c0162ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.677+0000 7f53c54e9700 1 --2- 172.21.15.153:0/145851866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53c00cd2b0 0x7f53c00cd680 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.677+0000 7f53c54e9700 1 -- 172.21.15.153:0/145851866 >> 172.21.15.153:0/145851866 conn(0x7f53c0099550 msgr2=0x7f53c0067590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:24.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.677+0000 7f53c54e9700 1 -- 172.21.15.153:0/145851866 shutdown_connections 2024-08-17T02:29:24.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.677+0000 7f53c54e9700 1 -- 172.21.15.153:0/145851866 wait complete. 2024-08-17T02:29:24.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.677+0000 7f53c54e9700 1 Processor -- start 2024-08-17T02:29:24.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.677+0000 7f53c54e9700 1 -- start start 2024-08-17T02:29:24.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.681+0000 7f53c54e9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53c00caeb0 0x7f53c00afb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:24.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.681+0000 7f53c54e9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53c00cd2b0 0x7f53c00b3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:24.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.681+0000 7f53c54e9700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53c00ceb70 0x7f53c00c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:24.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.681+0000 7f53c54e9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c00b38a0 con 0x7f53c00caeb0 2024-08-17T02:29:24.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.681+0000 7f53c54e9700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c00b3b80 con 0x7f53c00ceb70 2024-08-17T02:29:24.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.681+0000 7f53c54e9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c00b3e60 con 0x7f53c00cd2b0 2024-08-17T02:29:24.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.681+0000 7f53beffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53c00caeb0 0x7f53c00afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:24.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.681+0000 7f53beffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53c00caeb0 0x7f53c00afb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40578/0 (socket says 172.21.15.153:40578) 2024-08-17T02:29:24.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.681+0000 7f53beffd700 1 -- 172.21.15.153:0/3057265534 learned_addr learned my addr 172.21.15.153:0/3057265534 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:24.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.681+0000 7f53bf7fe700 1 --2- 172.21.15.153:0/3057265534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53c00ceb70 0x7f53c00c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:24.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.681+0000 7f53be7fc700 1 --2- 172.21.15.153:0/3057265534 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53c00cd2b0 0x7f53c00b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:24.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.681+0000 7f53beffd700 1 -- 172.21.15.153:0/3057265534 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53c00cd2b0 msgr2=0x7f53c00b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:24.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.681+0000 7f53beffd700 1 --2- 172.21.15.153:0/3057265534 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53c00cd2b0 0x7f53c00b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.681+0000 7f53beffd700 1 -- 172.21.15.153:0/3057265534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53c00ceb70 msgr2=0x7f53c00c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:24.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.681+0000 7f53beffd700 1 --2- 172.21.15.153:0/3057265534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53c00ceb70 0x7f53c00c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.681+0000 7f53beffd700 1 -- 172.21.15.153:0/3057265534 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b4009420 con 0x7f53c00caeb0 2024-08-17T02:29:24.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.681+0000 7f53beffd700 1 --2- 172.21.15.153:0/3057265534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53c00caeb0 0x7f53c00afb70 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f53b4002000 tx=0x7f53b4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:24.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.681+0000 7f53a6ffd700 1 -- 172.21.15.153:0/3057265534 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b401cab0 con 0x7f53c00caeb0 2024-08-17T02:29:24.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.681+0000 7f53a6ffd700 1 -- 172.21.15.153:0/3057265534 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b401cc30 con 0x7f53c00caeb0 2024-08-17T02:29:24.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.681+0000 7f53c54e9700 1 -- 172.21.15.153:0/3057265534 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53c00b4140 con 0x7f53c00caeb0 2024-08-17T02:29:24.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.681+0000 7f53a6ffd700 1 -- 172.21.15.153:0/3057265534 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b401a450 con 0x7f53c00caeb0 2024-08-17T02:29:24.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.681+0000 7f53c54e9700 1 -- 172.21.15.153:0/3057265534 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53c00b00b0 con 0x7f53c00caeb0 2024-08-17T02:29:24.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.681+0000 7f53a6ffd700 1 -- 172.21.15.153:0/3057265534 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f53b401a7e0 con 0x7f53c00caeb0 2024-08-17T02:29:24.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.681+0000 7f53c54e9700 1 -- 172.21.15.153:0/3057265534 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53c00638f0 con 0x7f53c00caeb0 2024-08-17T02:29:24.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.685+0000 7f53a6ffd700 1 --2- 172.21.15.153:0/3057265534 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f53ac060860 0x7f53ac062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:24.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.685+0000 7f53a6ffd700 1 -- 172.21.15.153:0/3057265534 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5448+0+0 (secure 0 0 0) 0x7f53b407e3b0 con 0x7f53c00caeb0 2024-08-17T02:29:24.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.685+0000 7f53be7fc700 1 --2- 172.21.15.153:0/3057265534 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f53ac060860 0x7f53ac062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:24.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.685+0000 7f53be7fc700 1 --2- 172.21.15.153:0/3057265534 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f53ac060860 0x7f53ac062d10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f53c00c5240 tx=0x7f53b0001a00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:24.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.689+0000 7f53a6ffd700 1 -- 172.21.15.153:0/3057265534 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f53b404e900 con 0x7f53c00caeb0 2024-08-17T02:29:24.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:24.853+0000 7f53c54e9700 1 -- 172.21.15.153:0/3057265534 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000118573.data", "pool2": "cephfs.volume_0000000000118573.data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f53c0068020 con 0x7f53c00caeb0 2024-08-17T02:29:25.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.553+0000 7f53a6ffd700 1 -- 172.21.15.153:0/3057265534 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000118573.data", "pool2": "cephfs.volume_0000000000118573.data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000118573.data' removed v43) v1 ==== 241+0+0 (secure 0 0 0) 0x7f53b4051f20 con 0x7f53c00caeb0 2024-08-17T02:29:25.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.561+0000 7f53c54e9700 1 -- 172.21.15.153:0/3057265534 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f53ac060860 msgr2=0x7f53ac062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:25.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.561+0000 7f53c54e9700 1 --2- 172.21.15.153:0/3057265534 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f53ac060860 0x7f53ac062d10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f53c00c5240 tx=0x7f53b0001a00 comp rx=0 tx=0).stop 2024-08-17T02:29:25.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.561+0000 7f53c54e9700 1 -- 172.21.15.153:0/3057265534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53c00caeb0 msgr2=0x7f53c00afb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:25.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.561+0000 7f53c54e9700 1 --2- 172.21.15.153:0/3057265534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53c00caeb0 0x7f53c00afb70 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f53b4002000 tx=0x7f53b4016000 comp rx=0 tx=0).stop 2024-08-17T02:29:25.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.561+0000 7f53c54e9700 1 -- 172.21.15.153:0/3057265534 shutdown_connections 2024-08-17T02:29:25.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.561+0000 7f53c54e9700 1 --2- 172.21.15.153:0/3057265534 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f53ac060860 0x7f53ac062d10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:25.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.561+0000 7f53c54e9700 1 --2- 172.21.15.153:0/3057265534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53c00ceb70 0x7f53c00c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:25.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.561+0000 7f53c54e9700 1 --2- 172.21.15.153:0/3057265534 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53c00cd2b0 0x7f53c00b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:25.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.561+0000 7f53c54e9700 1 --2- 172.21.15.153:0/3057265534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53c00caeb0 0x7f53c00afb70 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:25.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.561+0000 7f53c54e9700 1 -- 172.21.15.153:0/3057265534 >> 172.21.15.153:0/3057265534 conn(0x7f53c0099550 msgr2=0x7f53c0069b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:25.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.561+0000 7f53c54e9700 1 -- 172.21.15.153:0/3057265534 shutdown_connections 2024-08-17T02:29:25.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.565+0000 7f53c54e9700 1 -- 172.21.15.153:0/3057265534 wait complete. 2024-08-17T02:29:25.568 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs.volume_0000000000118573.data' removed 2024-08-17T02:29:25.579 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-17T02:29:25.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.685+0000 7f62ca48f700 1 Processor -- start 2024-08-17T02:29:25.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.685+0000 7f62ca48f700 1 -- start start 2024-08-17T02:29:25.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.685+0000 7f62ca48f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f62c4159300 0x7f62c40b2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:25.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.685+0000 7f62ca48f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62c41596d0 0x7f62c4066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:25.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.685+0000 7f62ca48f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f62c415dbc0 0x7f62c4067340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:25.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.685+0000 7f62ca48f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c40b2b60 con 0x7f62c415dbc0 2024-08-17T02:29:25.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.685+0000 7f62ca48f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c40cba90 con 0x7f62c4159300 2024-08-17T02:29:25.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.685+0000 7f62ca48f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c40cb160 con 0x7f62c41596d0 2024-08-17T02:29:25.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.685+0000 7f62c8a2c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f62c415dbc0 0x7f62c4067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:25.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.689+0000 7f62c3fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f62c4159300 0x7f62c40b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:25.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.689+0000 7f62c8a2c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f62c415dbc0 0x7f62c4067340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40594/0 (socket says 172.21.15.153:40594) 2024-08-17T02:29:25.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.689+0000 7f62c8a2c700 1 -- 172.21.15.153:0/1963680104 learned_addr learned my addr 172.21.15.153:0/1963680104 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:25.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.689+0000 7f62c37fe700 1 --2- 172.21.15.153:0/1963680104 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62c41596d0 0x7f62c4066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:25.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.689+0000 7f62c8a2c700 1 -- 172.21.15.153:0/1963680104 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62c41596d0 msgr2=0x7f62c4066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:25.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.689+0000 7f62c8a2c700 1 --2- 172.21.15.153:0/1963680104 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62c41596d0 0x7f62c4066e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:25.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.689+0000 7f62c8a2c700 1 -- 172.21.15.153:0/1963680104 >> v2:172.21.15.174:3300/0 conn(0x7f62c4159300 msgr2=0x7f62c40b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:25.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.689+0000 7f62c8a2c700 1 --2- 172.21.15.153:0/1963680104 >> v2:172.21.15.174:3300/0 conn(0x7f62c4159300 0x7f62c40b2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:25.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.689+0000 7f62c8a2c700 1 -- 172.21.15.153:0/1963680104 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c40cb440 con 0x7f62c415dbc0 2024-08-17T02:29:25.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.689+0000 7f62c3fff700 1 --2- 172.21.15.153:0/1963680104 >> v2:172.21.15.174:3300/0 conn(0x7f62c4159300 0x7f62c40b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:25.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.689+0000 7f62c37fe700 1 --2- 172.21.15.153:0/1963680104 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62c41596d0 0x7f62c4066e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:25.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.689+0000 7f62c8a2c700 1 --2- 172.21.15.153:0/1963680104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62c415dbc0 0x7f62c4067340 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f62c4089460 tx=0x7f62bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71d75d4a1d015e0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:25.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.689+0000 7f62c2ffd700 1 -- 172.21.15.153:0/1963680104 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc00b640 con 0x7f62c415dbc0 2024-08-17T02:29:25.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.689+0000 7f62c2ffd700 1 -- 172.21.15.153:0/1963680104 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62bc00b7a0 con 0x7f62c415dbc0 2024-08-17T02:29:25.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.689+0000 7f62c2ffd700 1 -- 172.21.15.153:0/1963680104 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc00bb40 con 0x7f62c415dbc0 2024-08-17T02:29:25.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.689+0000 7f62ca48f700 1 -- 172.21.15.153:0/1963680104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62c415dbc0 msgr2=0x7f62c4067340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:25.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.689+0000 7f62ca48f700 1 --2- 172.21.15.153:0/1963680104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62c415dbc0 0x7f62c4067340 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f62c4089460 tx=0x7f62bc009250 comp rx=0 tx=0).stop 2024-08-17T02:29:25.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.689+0000 7f62ca48f700 1 -- 172.21.15.153:0/1963680104 shutdown_connections 2024-08-17T02:29:25.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.689+0000 7f62ca48f700 1 --2- 172.21.15.153:0/1963680104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62c415dbc0 0x7f62c4067340 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:25.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.689+0000 7f62ca48f700 1 --2- 172.21.15.153:0/1963680104 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62c41596d0 0x7f62c4066e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:25.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.689+0000 7f62ca48f700 1 --2- 172.21.15.153:0/1963680104 >> v2:172.21.15.174:3300/0 conn(0x7f62c4159300 0x7f62c40b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:25.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.689+0000 7f62ca48f700 1 -- 172.21.15.153:0/1963680104 >> 172.21.15.153:0/1963680104 conn(0x7f62c40682c0 msgr2=0x7f62c40686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:25.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.689+0000 7f62ca48f700 1 -- 172.21.15.153:0/1963680104 shutdown_connections 2024-08-17T02:29:25.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.689+0000 7f62ca48f700 1 -- 172.21.15.153:0/1963680104 wait complete. 2024-08-17T02:29:25.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.693+0000 7f62ca48f700 1 Processor -- start 2024-08-17T02:29:25.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.693+0000 7f62ca48f700 1 -- start start 2024-08-17T02:29:25.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.693+0000 7f62ca48f700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62c4159300 0x7f62c40c6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:25.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.693+0000 7f62ca48f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62c41596d0 0x7f62c40c7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:25.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.693+0000 7f62ca48f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62c415dbc0 0x7f62c40c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:25.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.693+0000 7f62ca48f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c40c6c60 con 0x7f62c41596d0 2024-08-17T02:29:25.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.693+0000 7f62ca48f700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c40c4590 con 0x7f62c4159300 2024-08-17T02:29:25.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.693+0000 7f62ca48f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c40c9e80 con 0x7f62c415dbc0 2024-08-17T02:29:25.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.693+0000 7f62c37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62c41596d0 0x7f62c40c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:25.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.693+0000 7f62c37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62c41596d0 0x7f62c40c7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40606/0 (socket says 172.21.15.153:40606) 2024-08-17T02:29:25.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.693+0000 7f62c37fe700 1 -- 172.21.15.153:0/3015239690 learned_addr learned my addr 172.21.15.153:0/3015239690 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:25.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.693+0000 7f62c3fff700 1 --2- 172.21.15.153:0/3015239690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62c4159300 0x7f62c40c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:25.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.693+0000 7f62c8a2c700 1 --2- 172.21.15.153:0/3015239690 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62c415dbc0 0x7f62c40c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:25.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.693+0000 7f62c37fe700 1 -- 172.21.15.153:0/3015239690 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62c415dbc0 msgr2=0x7f62c40c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:25.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.693+0000 7f62c37fe700 1 --2- 172.21.15.153:0/3015239690 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62c415dbc0 0x7f62c40c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:25.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.693+0000 7f62c37fe700 1 -- 172.21.15.153:0/3015239690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62c4159300 msgr2=0x7f62c40c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:25.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.693+0000 7f62c37fe700 1 --2- 172.21.15.153:0/3015239690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62c4159300 0x7f62c40c6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:25.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.693+0000 7f62c37fe700 1 -- 172.21.15.153:0/3015239690 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b4009a20 con 0x7f62c41596d0 2024-08-17T02:29:25.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.693+0000 7f62c37fe700 1 --2- 172.21.15.153:0/3015239690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62c41596d0 0x7f62c40c7260 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00ec80 tx=0x7f62ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:25.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.693+0000 7f62bbfff700 1 -- 172.21.15.153:0/3015239690 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac00c850 con 0x7f62c41596d0 2024-08-17T02:29:25.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.693+0000 7f62bbfff700 1 -- 172.21.15.153:0/3015239690 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ac00c9b0 con 0x7f62c41596d0 2024-08-17T02:29:25.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.693+0000 7f62bbfff700 1 -- 172.21.15.153:0/3015239690 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac00cd30 con 0x7f62c41596d0 2024-08-17T02:29:25.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.693+0000 7f62ca48f700 1 -- 172.21.15.153:0/3015239690 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62ac009420 con 0x7f62c41596d0 2024-08-17T02:29:25.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.693+0000 7f62ca48f700 1 -- 172.21.15.153:0/3015239690 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62bc0094f0 con 0x7f62c41596d0 2024-08-17T02:29:25.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.693+0000 7f62ca48f700 1 -- 172.21.15.153:0/3015239690 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c40ca590 con 0x7f62c41596d0 2024-08-17T02:29:25.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.697+0000 7f62bbfff700 1 -- 172.21.15.153:0/3015239690 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f62ac013680 con 0x7f62c41596d0 2024-08-17T02:29:25.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.697+0000 7f62bbfff700 1 --2- 172.21.15.153:0/3015239690 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f62a4060860 0x7f62a4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:25.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.697+0000 7f62bbfff700 1 -- 172.21.15.153:0/3015239690 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f62ac07cf60 con 0x7f62c41596d0 2024-08-17T02:29:25.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.697+0000 7f62c3fff700 1 --2- 172.21.15.153:0/3015239690 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f62a4060860 0x7f62a4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:25.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.697+0000 7f62c3fff700 1 --2- 172.21.15.153:0/3015239690 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f62a4060860 0x7f62a4062d10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f62b400f650 tx=0x7f62b400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:25.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.709+0000 7f62bbfff700 1 -- 172.21.15.153:0/3015239690 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f62ac051040 con 0x7f62c41596d0 2024-08-17T02:29:25.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.881+0000 7f62ca48f700 1 -- 172.21.15.153:0/3015239690 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f62c40645c0 con 0x7f62c41596d0 2024-08-17T02:29:25.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.885+0000 7f62bbfff700 1 -- 172.21.15.153:0/3015239690 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f62ac050bd0 con 0x7f62c41596d0 2024-08-17T02:29:25.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.889+0000 7f62ca48f700 1 -- 172.21.15.153:0/3015239690 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f62a4060860 msgr2=0x7f62a4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:25.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.889+0000 7f62ca48f700 1 --2- 172.21.15.153:0/3015239690 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f62a4060860 0x7f62a4062d10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f62b400f650 tx=0x7f62b400b040 comp rx=0 tx=0).stop 2024-08-17T02:29:25.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.889+0000 7f62ca48f700 1 -- 172.21.15.153:0/3015239690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62c41596d0 msgr2=0x7f62c40c7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:25.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.889+0000 7f62ca48f700 1 --2- 172.21.15.153:0/3015239690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62c41596d0 0x7f62c40c7260 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00ec80 tx=0x7f62ac0091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:25.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.889+0000 7f62ca48f700 1 -- 172.21.15.153:0/3015239690 shutdown_connections 2024-08-17T02:29:25.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.889+0000 7f62ca48f700 1 --2- 172.21.15.153:0/3015239690 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f62a4060860 0x7f62a4062d10 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:25.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.889+0000 7f62ca48f700 1 --2- 172.21.15.153:0/3015239690 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62c415dbc0 0x7f62c40c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:25.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.889+0000 7f62ca48f700 1 --2- 172.21.15.153:0/3015239690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62c41596d0 0x7f62c40c7260 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:25.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.889+0000 7f62ca48f700 1 --2- 172.21.15.153:0/3015239690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62c4159300 0x7f62c40c6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:25.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.889+0000 7f62ca48f700 1 -- 172.21.15.153:0/3015239690 >> 172.21.15.153:0/3015239690 conn(0x7f62c40682c0 msgr2=0x7f62c41506a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:25.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.889+0000 7f62ca48f700 1 -- 172.21.15.153:0/3015239690 shutdown_connections 2024-08-17T02:29:25.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:25.889+0000 7f62ca48f700 1 -- 172.21.15.153:0/3015239690 wait complete. 2024-08-17T02:29:25.907 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:29:26.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.009+0000 7f540d704700 1 Processor -- start 2024-08-17T02:29:26.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.009+0000 7f540d704700 1 -- start start 2024-08-17T02:29:26.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.009+0000 7f540d704700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f54080b0d20 0x7f540806df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:26.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.009+0000 7f540d704700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f54080b1800 0x7f5408141e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:26.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.009+0000 7f540d704700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5408141a00 con 0x7f540806e450 2024-08-17T02:29:26.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.009+0000 7f540d704700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f540806e8a0 con 0x7f54080b0d20 2024-08-17T02:29:26.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.009+0000 7f540d704700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5408140b10 con 0x7f54080b1800 2024-08-17T02:29:26.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.009+0000 7f5407fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f54080b0d20 0x7f540806df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:26.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.009+0000 7f5407fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f54080b0d20 0x7f540806df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40612/0 (socket says 172.21.15.153:40612) 2024-08-17T02:29:26.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.009+0000 7f5407fff700 1 -- 172.21.15.153:0/2765805284 learned_addr learned my addr 172.21.15.153:0/2765805284 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:26.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.009+0000 7f540cf03700 1 --2- 172.21.15.153:0/2765805284 >> v2:172.21.15.174:3300/0 conn(0x7f54080b1800 0x7f5408141e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:26.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.009+0000 7f5407fff700 1 -- 172.21.15.153:0/2765805284 >> v2:172.21.15.174:3300/0 conn(0x7f54080b1800 msgr2=0x7f5408141e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:26.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.009+0000 7f5407fff700 1 --2- 172.21.15.153:0/2765805284 >> v2:172.21.15.174:3300/0 conn(0x7f54080b1800 0x7f5408141e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.009+0000 7f5407fff700 1 -- 172.21.15.153:0/2765805284 >> v1:172.21.15.174:6789/0 conn(0x7f540806e450 legacy=0x7f54080b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:26.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.009+0000 7f5407fff700 1 -- 172.21.15.153:0/2765805284 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5408140df0 con 0x7f54080b0d20 2024-08-17T02:29:26.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.009+0000 7f540cf03700 1 --2- 172.21.15.153:0/2765805284 >> v2:172.21.15.174:3300/0 conn(0x7f54080b1800 0x7f5408141e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:26.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.009+0000 7f5407fff700 1 --2- 172.21.15.153:0/2765805284 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54080b0d20 0x7f540806df10 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f540806eb70 tx=0x7f53f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7edba658919f6b19 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:26.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.009+0000 7f54077fe700 1 -- 172.21.15.153:0/2765805284 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f800b860 con 0x7f54080b0d20 2024-08-17T02:29:26.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.009+0000 7f54077fe700 1 -- 172.21.15.153:0/2765805284 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f800b9c0 con 0x7f54080b0d20 2024-08-17T02:29:26.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.009+0000 7f54077fe700 1 -- 172.21.15.153:0/2765805284 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f800bd60 con 0x7f54080b0d20 2024-08-17T02:29:26.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.009+0000 7f540d704700 1 -- 172.21.15.153:0/2765805284 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54080b0d20 msgr2=0x7f540806df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:26.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.009+0000 7f540d704700 1 --2- 172.21.15.153:0/2765805284 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54080b0d20 0x7f540806df10 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f540806eb70 tx=0x7f53f8009250 comp rx=0 tx=0).stop 2024-08-17T02:29:26.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.009+0000 7f540d704700 1 -- 172.21.15.153:0/2765805284 shutdown_connections 2024-08-17T02:29:26.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.009+0000 7f540d704700 1 --2- 172.21.15.153:0/2765805284 >> v2:172.21.15.174:3300/0 conn(0x7f54080b1800 0x7f5408141e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.009+0000 7f540d704700 1 --2- 172.21.15.153:0/2765805284 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54080b0d20 0x7f540806df10 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.009+0000 7f540d704700 1 -- 172.21.15.153:0/2765805284 >> 172.21.15.153:0/2765805284 conn(0x7f54080678d0 msgr2=0x7f5408067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:26.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.009+0000 7f540d704700 1 -- 172.21.15.153:0/2765805284 shutdown_connections 2024-08-17T02:29:26.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.009+0000 7f540d704700 1 -- 172.21.15.153:0/2765805284 wait complete. 2024-08-17T02:29:26.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.013+0000 7f540d704700 1 Processor -- start 2024-08-17T02:29:26.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.013+0000 7f540d704700 1 -- start start 2024-08-17T02:29:26.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.013+0000 7f540d704700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f540806e450 0x7f54080ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:26.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.013+0000 7f540d704700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54080b0d20 0x7f540806a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:26.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.013+0000 7f540d704700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54080b1800 0x7f540816d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:26.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.013+0000 7f540d704700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54080ae5f0 con 0x7f54080b0d20 2024-08-17T02:29:26.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.013+0000 7f540d704700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5408171570 con 0x7f540806e450 2024-08-17T02:29:26.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.013+0000 7f540d704700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5408171850 con 0x7f54080b1800 2024-08-17T02:29:26.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.013+0000 7f5407fff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f540806e450 0x7f54080ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:26.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.013+0000 7f53ff7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54080b0d20 0x7f540806a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:26.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.013+0000 7f5407fff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f540806e450 0x7f54080ae0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.153:50934/0 (socket says 172.21.15.153:50934) 2024-08-17T02:29:26.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.013+0000 7f5407fff700 1 -- 172.21.15.153:0/358781966 learned_addr learned my addr 172.21.15.153:0/358781966 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:26.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.013+0000 7f540cf03700 1 --2- 172.21.15.153:0/358781966 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54080b1800 0x7f540816d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:26.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.017+0000 7f53ff7fe700 1 -- 172.21.15.153:0/358781966 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54080b1800 msgr2=0x7f540816d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:26.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.017+0000 7f53ff7fe700 1 --2- 172.21.15.153:0/358781966 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54080b1800 0x7f540816d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.017+0000 7f53ff7fe700 1 -- 172.21.15.153:0/358781966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f540806e450 msgr2=0x7f54080ae0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:26.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.017+0000 7f53ff7fe700 1 --2- 172.21.15.153:0/358781966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f540806e450 0x7f54080ae0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.017+0000 7f53ff7fe700 1 -- 172.21.15.153:0/358781966 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f80094f0 con 0x7f54080b0d20 2024-08-17T02:29:26.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.017+0000 7f53ff7fe700 1 --2- 172.21.15.153:0/358781966 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54080b0d20 0x7f540806a260 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f53f000c490 tx=0x7f53f0007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:26.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.017+0000 7f5404ff9700 1 -- 172.21.15.153:0/358781966 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f000ce40 con 0x7f54080b0d20 2024-08-17T02:29:26.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.017+0000 7f5404ff9700 1 -- 172.21.15.153:0/358781966 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f0011590 con 0x7f54080b0d20 2024-08-17T02:29:26.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.017+0000 7f540d704700 1 -- 172.21.15.153:0/358781966 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5408171b30 con 0x7f54080b0d20 2024-08-17T02:29:26.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.017+0000 7f5404ff9700 1 -- 172.21.15.153:0/358781966 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f0011950 con 0x7f54080b0d20 2024-08-17T02:29:26.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.017+0000 7f540d704700 1 -- 172.21.15.153:0/358781966 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54081720f0 con 0x7f54080b0d20 2024-08-17T02:29:26.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.017+0000 7f540d704700 1 -- 172.21.15.153:0/358781966 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54080a5450 con 0x7f54080b0d20 2024-08-17T02:29:26.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.017+0000 7f5404ff9700 1 -- 172.21.15.153:0/358781966 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f53f0011cc0 con 0x7f54080b0d20 2024-08-17T02:29:26.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.021+0000 7f5404ff9700 1 --2- 172.21.15.153:0/358781966 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f53e8060860 0x7f53e8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:26.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.021+0000 7f5404ff9700 1 -- 172.21.15.153:0/358781966 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f53f007bcf0 con 0x7f54080b0d20 2024-08-17T02:29:26.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.021+0000 7f5407fff700 1 --2- 172.21.15.153:0/358781966 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f53e8060860 0x7f53e8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:26.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.021+0000 7f5407fff700 1 --2- 172.21.15.153:0/358781966 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f53e8060860 0x7f53e8062d10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f53f8003080 tx=0x7f53f8017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:26.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.025+0000 7f5404ff9700 1 -- 172.21.15.153:0/358781966 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f54080a5450 con 0x7f54080b0d20 2024-08-17T02:29:26.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.245+0000 7f540d704700 1 -- 172.21.15.153:0/358781966 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7f54080a5450 con 0x7f54080b0d20 2024-08-17T02:29:26.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.557+0000 7f5404ff9700 1 -- 172.21.15.153:0/358781966 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v151) v1 ==== 135+0+0 (secure 0 0 0) 0x7f54080a5450 con 0x7f54080b0d20 2024-08-17T02:29:26.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.561+0000 7f540d704700 1 -- 172.21.15.153:0/358781966 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f53e8060860 msgr2=0x7f53e8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:26.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.561+0000 7f540d704700 1 --2- 172.21.15.153:0/358781966 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f53e8060860 0x7f53e8062d10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f53f8003080 tx=0x7f53f8017000 comp rx=0 tx=0).stop 2024-08-17T02:29:26.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.561+0000 7f540d704700 1 -- 172.21.15.153:0/358781966 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54080b0d20 msgr2=0x7f540806a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:26.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.561+0000 7f540d704700 1 --2- 172.21.15.153:0/358781966 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54080b0d20 0x7f540806a260 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f53f000c490 tx=0x7f53f0007ec0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.561+0000 7f540d704700 1 -- 172.21.15.153:0/358781966 shutdown_connections 2024-08-17T02:29:26.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.561+0000 7f540d704700 1 --2- 172.21.15.153:0/358781966 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f53e8060860 0x7f53e8062d10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.561+0000 7f540d704700 1 --2- 172.21.15.153:0/358781966 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54080b1800 0x7f540816d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.561+0000 7f540d704700 1 --2- 172.21.15.153:0/358781966 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54080b0d20 0x7f540806a260 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.561+0000 7f540d704700 1 --2- 172.21.15.153:0/358781966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f540806e450 0x7f54080ae0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.561+0000 7f540d704700 1 -- 172.21.15.153:0/358781966 >> 172.21.15.153:0/358781966 conn(0x7f54080678d0 msgr2=0x7f540815df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:26.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.561+0000 7f540d704700 1 -- 172.21.15.153:0/358781966 shutdown_connections 2024-08-17T02:29:26.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:26.561+0000 7f540d704700 1 -- 172.21.15.153:0/358781966 wait complete. 2024-08-17T02:29:26.584 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up ... ERROR 2024-08-17T02:29:26.584 INFO:tasks.cephfs_test_runner: 2024-08-17T02:29:26.585 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:29:26.585 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:29:26.585 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:29:26.585 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:29:26.585 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:29:26.585 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:29:26.585 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:29:26.585 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:29:26.585 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:29:26.585 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:29:26.585 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:29:26.585 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:29:26.585 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:29:26.585 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:29:26.586 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:29:26.586 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:29:26.586 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:29:26.586 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:29:26.586 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:29:26.586 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:29:26.586 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:29:26.586 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:29:26.586 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:29:26.586 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi153 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000118573 --yes-i-really-mean-it' 2024-08-17T02:29:26.586 INFO:tasks.cephfs_test_runner: 2024-08-17T02:29:26.586 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:29:26.586 INFO:tasks.cephfs_test_runner:Ran 1 test in 166.539s 2024-08-17T02:29:26.586 INFO:tasks.cephfs_test_runner: 2024-08-17T02:29:26.587 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-08-17T02:29:26.587 INFO:tasks.cephfs_test_runner: 2024-08-17T02:29:26.587 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:29:26.587 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:29:26.587 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:29:26.587 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:29:26.587 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:29:26.587 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:29:26.587 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:29:26.587 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:29:26.587 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:29:26.587 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:29:26.587 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:29:26.587 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:29:26.587 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:29:26.587 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:29:26.588 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:29:26.588 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:29:26.588 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:29:26.588 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:29:26.588 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:29:26.588 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:29:26.588 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:29:26.588 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:29:26.588 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:29:26.588 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi153 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000118573 --yes-i-really-mean-it' 2024-08-17T02:29:26.588 INFO:tasks.cephfs_test_runner: 2024-08-17T02:29:26.588 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:29:26.806 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=df6291ccf6e647f9b94ff813f8fe93cb Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:29:26.808 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-08-17T02:29:26.818 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-08-17T02:29:26.827 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-08-17T02:29:26.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:26.827 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2024-08-17T02:29:26.839 INFO:teuthology.orchestra.run.smithi174.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:29:26.840 INFO:teuthology.orchestra.run.smithi174.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:29:26.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:26.840 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:29:26.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:26.852 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:29:26.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:26.923 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link delete ceph-brx 2024-08-17T02:29:27.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:27.075 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-08-17T02:29:27.082 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:29:27.083 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:29:27.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:27.083 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:29:27.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:27.100 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:29:27.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:27.198 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link delete ceph-brx 2024-08-17T02:29:27.348 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-08-17T02:29:27.357 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2024-08-17T02:29:27.357 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:27.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.469+0000 7fb22e0eb700 1 Processor -- start 2024-08-17T02:29:27.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.469+0000 7fb22e0eb700 1 -- start start 2024-08-17T02:29:27.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.469+0000 7fb22e0eb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb228154900 0x7fb2280b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:27.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.469+0000 7fb22e0eb700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb2280b12d0 0x7fb2280cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:27.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.469+0000 7fb22e0eb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2280cbaa0 con 0x7fb2280cb390 2024-08-17T02:29:27.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.469+0000 7fb22e0eb700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb228068790 con 0x7fb2280b12d0 2024-08-17T02:29:27.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.469+0000 7fb22e0eb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2281583f0 con 0x7fb228154900 2024-08-17T02:29:27.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.473+0000 7fb22c8e8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb2280b12d0 0x7fb2280cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:27.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.473+0000 7fb22c8e8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb2280b12d0 0x7fb2280cae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40634/0 (socket says 172.21.15.153:40634) 2024-08-17T02:29:27.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.473+0000 7fb22c8e8700 1 -- 172.21.15.153:0/2785406648 learned_addr learned my addr 172.21.15.153:0/2785406648 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:27.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.473+0000 7fb22d0e9700 1 --2- 172.21.15.153:0/2785406648 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb228154900 0x7fb2280b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:27.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.473+0000 7fb22c8e8700 1 -- 172.21.15.153:0/2785406648 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb228154900 msgr2=0x7fb2280b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:27.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.473+0000 7fb22c8e8700 1 --2- 172.21.15.153:0/2785406648 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb228154900 0x7fb2280b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:27.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.473+0000 7fb22c8e8700 1 -- 172.21.15.153:0/2785406648 >> v1:172.21.15.174:6789/0 conn(0x7fb2280cb390 legacy=0x7fb22806df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:27.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.473+0000 7fb22c8e8700 1 -- 172.21.15.153:0/2785406648 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2280b1700 con 0x7fb2280b12d0 2024-08-17T02:29:27.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.473+0000 7fb22c8e8700 1 --2- 172.21.15.153:0/2785406648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2280b12d0 0x7fb2280cae50 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fb21c0099b0 tx=0x7fb21c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d108224d95eaf9ce server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:27.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.473+0000 7fb227fff700 1 -- 172.21.15.153:0/2785406648 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c009ea0 con 0x7fb2280b12d0 2024-08-17T02:29:27.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.473+0000 7fb227fff700 1 -- 172.21.15.153:0/2785406648 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21c00b860 con 0x7fb2280b12d0 2024-08-17T02:29:27.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.473+0000 7fb227fff700 1 -- 172.21.15.153:0/2785406648 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c00bc00 con 0x7fb2280b12d0 2024-08-17T02:29:27.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.473+0000 7fb22e0eb700 1 -- 172.21.15.153:0/2785406648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2280b12d0 msgr2=0x7fb2280cae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:27.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.473+0000 7fb22e0eb700 1 --2- 172.21.15.153:0/2785406648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2280b12d0 0x7fb2280cae50 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fb21c0099b0 tx=0x7fb21c009250 comp rx=0 tx=0).stop 2024-08-17T02:29:27.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.477+0000 7fb22e0eb700 1 -- 172.21.15.153:0/2785406648 shutdown_connections 2024-08-17T02:29:27.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.477+0000 7fb22e0eb700 1 --2- 172.21.15.153:0/2785406648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2280b12d0 0x7fb2280cae50 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:27.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.477+0000 7fb22e0eb700 1 --2- 172.21.15.153:0/2785406648 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb228154900 0x7fb2280b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:27.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.477+0000 7fb22e0eb700 1 -- 172.21.15.153:0/2785406648 >> 172.21.15.153:0/2785406648 conn(0x7fb2280678d0 msgr2=0x7fb228067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:27.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.477+0000 7fb22e0eb700 1 -- 172.21.15.153:0/2785406648 shutdown_connections 2024-08-17T02:29:27.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.477+0000 7fb22e0eb700 1 -- 172.21.15.153:0/2785406648 wait complete. 2024-08-17T02:29:27.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.477+0000 7fb22e0eb700 1 Processor -- start 2024-08-17T02:29:27.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.477+0000 7fb22e0eb700 1 -- start start 2024-08-17T02:29:27.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.477+0000 7fb22e0eb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2280b12d0 0x7fb2280ab080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:27.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.481+0000 7fb22e0eb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2280cb390 0x7fb228167170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:27.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.481+0000 7fb22e0eb700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb228154900 0x7fb2280a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:27.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.481+0000 7fb22e0eb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22816a7c0 con 0x7fb2280cb390 2024-08-17T02:29:27.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.481+0000 7fb22e0eb700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22816aa60 con 0x7fb228154900 2024-08-17T02:29:27.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.481+0000 7fb22e0eb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2281676b0 con 0x7fb2280b12d0 2024-08-17T02:29:27.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.481+0000 7fb22c8e8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2280cb390 0x7fb228167170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:27.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.481+0000 7fb22c8e8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2280cb390 0x7fb228167170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40644/0 (socket says 172.21.15.153:40644) 2024-08-17T02:29:27.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.481+0000 7fb22c8e8700 1 -- 172.21.15.153:0/917245972 learned_addr learned my addr 172.21.15.153:0/917245972 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:27.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.481+0000 7fb22d8ea700 1 --2- 172.21.15.153:0/917245972 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb228154900 0x7fb2280a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:27.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.481+0000 7fb22d0e9700 1 --2- 172.21.15.153:0/917245972 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2280b12d0 0x7fb2280ab080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:27.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.481+0000 7fb22c8e8700 1 -- 172.21.15.153:0/917245972 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2280b12d0 msgr2=0x7fb2280ab080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:27.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.481+0000 7fb22c8e8700 1 --2- 172.21.15.153:0/917245972 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2280b12d0 0x7fb2280ab080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:27.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.481+0000 7fb22c8e8700 1 -- 172.21.15.153:0/917245972 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb228154900 msgr2=0x7fb2280a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:27.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.481+0000 7fb22c8e8700 1 --2- 172.21.15.153:0/917245972 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb228154900 0x7fb2280a8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:27.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.481+0000 7fb22c8e8700 1 -- 172.21.15.153:0/917245972 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb21c0094f0 con 0x7fb2280cb390 2024-08-17T02:29:27.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.481+0000 7fb22c8e8700 1 --2- 172.21.15.153:0/917245972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2280cb390 0x7fb228167170 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb22806c2d0 tx=0x7fb21c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:27.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.481+0000 7fb2257fa700 1 -- 172.21.15.153:0/917245972 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c00bbe0 con 0x7fb2280cb390 2024-08-17T02:29:27.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.481+0000 7fb2257fa700 1 -- 172.21.15.153:0/917245972 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21c011420 con 0x7fb2280cb390 2024-08-17T02:29:27.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.481+0000 7fb22e0eb700 1 -- 172.21.15.153:0/917245972 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb228167980 con 0x7fb2280cb390 2024-08-17T02:29:27.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.481+0000 7fb2257fa700 1 -- 172.21.15.153:0/917245972 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c0117c0 con 0x7fb2280cb390 2024-08-17T02:29:27.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.481+0000 7fb22e0eb700 1 -- 172.21.15.153:0/917245972 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb228167f40 con 0x7fb2280cb390 2024-08-17T02:29:27.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.481+0000 7fb22e0eb700 1 -- 172.21.15.153:0/917245972 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2280643a0 con 0x7fb2280cb390 2024-08-17T02:29:27.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.481+0000 7fb2257fa700 1 -- 172.21.15.153:0/917245972 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb21c011bf0 con 0x7fb2280cb390 2024-08-17T02:29:27.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.481+0000 7fb2257fa700 1 --2- 172.21.15.153:0/917245972 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb214060860 0x7fb214062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:27.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.481+0000 7fb2257fa700 1 -- 172.21.15.153:0/917245972 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fb21c07e2d0 con 0x7fb2280cb390 2024-08-17T02:29:27.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.481+0000 7fb22d0e9700 1 --2- 172.21.15.153:0/917245972 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb214060860 0x7fb214062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:27.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.485+0000 7fb22d0e9700 1 --2- 172.21.15.153:0/917245972 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb214060860 0x7fb214062d10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb2280b1190 tx=0x7fb22000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:27.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.489+0000 7fb2257fa700 1 -- 172.21.15.153:0/917245972 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb21c04e9c0 con 0x7fb2280cb390 2024-08-17T02:29:27.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.653+0000 7fb22e0eb700 1 -- 172.21.15.153:0/917245972 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb22806f5f0 con 0x7fb2280cb390 2024-08-17T02:29:27.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.653+0000 7fb2257fa700 1 -- 172.21.15.153:0/917245972 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+12445 (secure 0 0 0) 0x7fb21c051fe0 con 0x7fb2280cb390 2024-08-17T02:29:27.658 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:29:27.658 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":43,"fsid":"56d41c33-b929-456d-96be-2aac4ecd299d","created":"2024-08-17T02:25:47.756085+0000","modified":"2024-08-17T02:29:25.539132+0000","last_up_change":"2024-08-17T02:25:58.643690+0000","last_in_change":"2024-08-17T02:25:49.809186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:58.093273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"0736f8e6-818e-42e6-a0dc-8aaf813315d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":24234},{"type":"v1","addr":"172.21.15.153:6817","nonce":24234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":24234},{"type":"v1","addr":"172.21.15.153:6819","nonce":24234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":24234},{"type":"v1","addr":"172.21.15.153:6823","nonce":24234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":24234},{"type":"v1","addr":"172.21.15.153:6821","nonce":24234}]},"public_addr":"172.21.15.153:6817/24234","cluster_addr":"172.21.15.153:6819/24234","heartbeat_back_addr":"172.21.15.153:6823/24234","heartbeat_front_addr":"172.21.15.153:6821/24234","state":["exists","up"]},{"osd":1,"uuid":"011762e9-6c2d-441a-aa56-68474639d72f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":24232},{"type":"v1","addr":"172.21.15.153:6801","nonce":24232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":24232},{"type":"v1","addr":"172.21.15.153:6803","nonce":24232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":24232},{"type":"v1","addr":"172.21.15.153:6809","nonce":24232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":24232},{"type":"v1","addr":"172.21.15.153:6806","nonce":24232}]},"public_addr":"172.21.15.153:6801/24232","cluster_addr":"172.21.15.153:6803/24232","heartbeat_back_addr":"172.21.15.153:6809/24232","heartbeat_front_addr":"172.21.15.153:6806/24232","state":["exists","up"]},{"osd":2,"uuid":"b562cd97-aa12-455e-b46a-e720a2ec9d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":24235},{"type":"v1","addr":"172.21.15.153:6808","nonce":24235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":24235},{"type":"v1","addr":"172.21.15.153:6811","nonce":24235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":24235},{"type":"v1","addr":"172.21.15.153:6815","nonce":24235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":24235},{"type":"v1","addr":"172.21.15.153:6813","nonce":24235}]},"public_addr":"172.21.15.153:6808/24235","cluster_addr":"172.21.15.153:6811/24235","heartbeat_back_addr":"172.21.15.153:6815/24235","heartbeat_front_addr":"172.21.15.153:6813/24235","state":["exists","up"]},{"osd":3,"uuid":"222da52f-90c2-4132-a5d2-6f6cf83d4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":24236},{"type":"v1","addr":"172.21.15.153:6825","nonce":24236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":24236},{"type":"v1","addr":"172.21.15.153:6827","nonce":24236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":24236},{"type":"v1","addr":"172.21.15.153:6831","nonce":24236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":24236},{"type":"v1","addr":"172.21.15.153:6829","nonce":24236}]},"public_addr":"172.21.15.153:6825/24236","cluster_addr":"172.21.15.153:6827/24236","heartbeat_back_addr":"172.21.15.153:6831/24236","heartbeat_front_addr":"172.21.15.153:6829/24236","state":["exists","up"]},{"osd":4,"uuid":"a38a04cd-032b-4977-a260-1ef3567d0c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24456},{"type":"v1","addr":"172.21.15.174:6809","nonce":24456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24456},{"type":"v1","addr":"172.21.15.174:6811","nonce":24456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24456},{"type":"v1","addr":"172.21.15.174:6815","nonce":24456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24456},{"type":"v1","addr":"172.21.15.174:6813","nonce":24456}]},"public_addr":"172.21.15.174:6809/24456","cluster_addr":"172.21.15.174:6811/24456","heartbeat_back_addr":"172.21.15.174:6815/24456","heartbeat_front_addr":"172.21.15.174:6813/24456","state":["exists","up"]},{"osd":5,"uuid":"c7778084-e751-48da-87a1-ab8bbe85aa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24457},{"type":"v1","addr":"172.21.15.174:6825","nonce":24457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24457},{"type":"v1","addr":"172.21.15.174:6827","nonce":24457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24457},{"type":"v1","addr":"172.21.15.174:6831","nonce":24457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24457},{"type":"v1","addr":"172.21.15.174:6829","nonce":24457}]},"public_addr":"172.21.15.174:6825/24457","cluster_addr":"172.21.15.174:6827/24457","heartbeat_back_addr":"172.21.15.174:6831/24457","heartbeat_front_addr":"172.21.15.174:6829/24457","state":["exists","up"]},{"osd":6,"uuid":"2d8e0715-254f-442c-9625-50721d0bc858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24477},{"type":"v1","addr":"172.21.15.174:6801","nonce":24477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24477},{"type":"v1","addr":"172.21.15.174:6803","nonce":24477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24477},{"type":"v1","addr":"172.21.15.174:6807","nonce":24477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24477},{"type":"v1","addr":"172.21.15.174:6805","nonce":24477}]},"public_addr":"172.21.15.174:6801/24477","cluster_addr":"172.21.15.174:6803/24477","heartbeat_back_addr":"172.21.15.174:6807/24477","heartbeat_front_addr":"172.21.15.174:6805/24477","state":["exists","up"]},{"osd":7,"uuid":"dffda25a-4601-4ddb-9a27-b0be1cadde27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24455},{"type":"v1","addr":"172.21.15.174:6817","nonce":24455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24455},{"type":"v1","addr":"172.21.15.174:6819","nonce":24455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24455},{"type":"v1","addr":"172.21.15.174:6823","nonce":24455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24455},{"type":"v1","addr":"172.21.15.174:6821","nonce":24455}]},"public_addr":"172.21.15.174:6817/24455","cluster_addr":"172.21.15.174:6819/24455","heartbeat_back_addr":"172.21.15.174:6823/24455","heartbeat_front_addr":"172.21.15.174:6821/24455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.990117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.033862+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.748087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.112877+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.070448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.360961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.110940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.226377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.153:6835/2569513399":"2024-08-18T02:29:22.524575+0000","172.21.15.153:6834/2569513399":"2024-08-18T02:29:22.524575+0000","172.21.15.153:6837/2567193475":"2024-08-18T02:29:16.167908+0000","172.21.15.153:6836/2567193475":"2024-08-18T02:29:16.167908+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:27.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.657+0000 7fb22e0eb700 1 -- 172.21.15.153:0/917245972 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb214060860 msgr2=0x7fb214062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:27.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.657+0000 7fb22e0eb700 1 --2- 172.21.15.153:0/917245972 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb214060860 0x7fb214062d10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb2280b1190 tx=0x7fb22000b040 comp rx=0 tx=0).stop 2024-08-17T02:29:27.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.657+0000 7fb22e0eb700 1 -- 172.21.15.153:0/917245972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2280cb390 msgr2=0x7fb228167170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:27.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.657+0000 7fb22e0eb700 1 --2- 172.21.15.153:0/917245972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2280cb390 0x7fb228167170 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb22806c2d0 tx=0x7fb21c017000 comp rx=0 tx=0).stop 2024-08-17T02:29:27.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.657+0000 7fb22e0eb700 1 -- 172.21.15.153:0/917245972 shutdown_connections 2024-08-17T02:29:27.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.657+0000 7fb22e0eb700 1 --2- 172.21.15.153:0/917245972 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb214060860 0x7fb214062d10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:27.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.657+0000 7fb22e0eb700 1 --2- 172.21.15.153:0/917245972 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb228154900 0x7fb2280a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:27.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.657+0000 7fb22e0eb700 1 --2- 172.21.15.153:0/917245972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2280cb390 0x7fb228167170 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:27.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.657+0000 7fb22e0eb700 1 --2- 172.21.15.153:0/917245972 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2280b12d0 0x7fb2280ab080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:27.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.657+0000 7fb22e0eb700 1 -- 172.21.15.153:0/917245972 >> 172.21.15.153:0/917245972 conn(0x7fb2280678d0 msgr2=0x7fb22806cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:27.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.657+0000 7fb22e0eb700 1 -- 172.21.15.153:0/917245972 shutdown_connections 2024-08-17T02:29:27.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.657+0000 7fb22e0eb700 1 -- 172.21.15.153:0/917245972 wait complete. 2024-08-17T02:29:27.671 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:29:27.672 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:29:27.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.777+0000 7fadb314b700 1 Processor -- start 2024-08-17T02:29:27.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.777+0000 7fadb314b700 1 -- start start 2024-08-17T02:29:27.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.777+0000 7fadb314b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fadac154900 0x7fadac0b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:27.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.777+0000 7fadb314b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadac0b12d0 0x7fadac0cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:27.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.777+0000 7fadb314b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadac0cbaa0 con 0x7fadac0cb390 2024-08-17T02:29:27.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.777+0000 7fadb314b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadac068790 con 0x7fadac154900 2024-08-17T02:29:27.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.777+0000 7fadb314b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadac1583f0 con 0x7fadac0b12d0 2024-08-17T02:29:27.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.777+0000 7fadb1948700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadac0b12d0 0x7fadac0cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:27.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.777+0000 7fadb2149700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fadac154900 0x7fadac0b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:27.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.777+0000 7fadb1948700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadac0b12d0 0x7fadac0cae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.153:50888/0 (socket says 172.21.15.153:50888) 2024-08-17T02:29:27.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.777+0000 7fadb1948700 1 -- 172.21.15.153:0/2803882796 learned_addr learned my addr 172.21.15.153:0/2803882796 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:27.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.777+0000 7fadb294a700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fadac0cb390 0x7fadac06df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.153:48230/0 (socket says 172.21.15.153:48230) 2024-08-17T02:29:27.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.777+0000 7fadb1948700 1 -- 172.21.15.153:0/2803882796 >> v2:172.21.15.174:3300/0 conn(0x7fadac154900 msgr2=0x7fadac0b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:27.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.777+0000 7fadb1948700 1 --2- 172.21.15.153:0/2803882796 >> v2:172.21.15.174:3300/0 conn(0x7fadac154900 0x7fadac0b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:27.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.777+0000 7fadb1948700 1 -- 172.21.15.153:0/2803882796 >> v1:172.21.15.174:6789/0 conn(0x7fadac0cb390 legacy=0x7fadac06df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:27.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.777+0000 7fadb1147700 1 -- 172.21.15.153:0/2803882796 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2960302806 0 0) 0x7fadac0cbaa0 con 0x7fadac0cb390 2024-08-17T02:29:27.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.777+0000 7fadb1948700 1 -- 172.21.15.153:0/2803882796 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadac0b1700 con 0x7fadac0b12d0 2024-08-17T02:29:27.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.777+0000 7fadb1948700 1 --2- 172.21.15.153:0/2803882796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadac0b12d0 0x7fadac0cae50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fada4009f20 tx=0x7fada4009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea1889a6398b7e3e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:27.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.781+0000 7fadb1147700 1 -- 172.21.15.153:0/2803882796 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada400e070 con 0x7fadac0b12d0 2024-08-17T02:29:27.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.781+0000 7fadb1147700 1 -- 172.21.15.153:0/2803882796 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada400b9d0 con 0x7fadac0b12d0 2024-08-17T02:29:27.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.781+0000 7fadb1147700 1 -- 172.21.15.153:0/2803882796 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada40092e0 con 0x7fadac0b12d0 2024-08-17T02:29:27.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.781+0000 7fadb314b700 1 -- 172.21.15.153:0/2803882796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadac0b12d0 msgr2=0x7fadac0cae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:27.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.781+0000 7fadb314b700 1 --2- 172.21.15.153:0/2803882796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadac0b12d0 0x7fadac0cae50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fada4009f20 tx=0x7fada4009840 comp rx=0 tx=0).stop 2024-08-17T02:29:27.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.781+0000 7fadb314b700 1 -- 172.21.15.153:0/2803882796 shutdown_connections 2024-08-17T02:29:27.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.781+0000 7fadb314b700 1 --2- 172.21.15.153:0/2803882796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadac0b12d0 0x7fadac0cae50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:27.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.781+0000 7fadb314b700 1 --2- 172.21.15.153:0/2803882796 >> v2:172.21.15.174:3300/0 conn(0x7fadac154900 0x7fadac0b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:27.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.781+0000 7fadb314b700 1 -- 172.21.15.153:0/2803882796 >> 172.21.15.153:0/2803882796 conn(0x7fadac0678d0 msgr2=0x7fadac067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:27.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.781+0000 7fadb314b700 1 -- 172.21.15.153:0/2803882796 shutdown_connections 2024-08-17T02:29:27.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.781+0000 7fadb314b700 1 -- 172.21.15.153:0/2803882796 wait complete. 2024-08-17T02:29:27.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.781+0000 7fadb314b700 1 Processor -- start 2024-08-17T02:29:27.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.781+0000 7fadb314b700 1 -- start start 2024-08-17T02:29:27.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.781+0000 7fadb314b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadac0b12d0 0x7fadac0a92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:27.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.781+0000 7fadb314b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fadac0cb390 0x7fadac150420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:27.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.781+0000 7fadb314b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadac154900 0x7fadac069f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:27.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.781+0000 7fadb314b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadac166d90 con 0x7fadac0cb390 2024-08-17T02:29:27.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.781+0000 7fadb314b700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadac150960 con 0x7fadac154900 2024-08-17T02:29:27.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.781+0000 7fadb314b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadac0a65d0 con 0x7fadac0b12d0 2024-08-17T02:29:27.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.785+0000 7fadb1948700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fadac0cb390 0x7fadac150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:27.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.785+0000 7fadb1948700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fadac0cb390 0x7fadac150420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40656/0 (socket says 172.21.15.153:40656) 2024-08-17T02:29:27.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.785+0000 7fadb1948700 1 -- 172.21.15.153:0/4155506895 learned_addr learned my addr 172.21.15.153:0/4155506895 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:27.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.785+0000 7fadb294a700 1 --2- 172.21.15.153:0/4155506895 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadac154900 0x7fadac069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:27.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.785+0000 7fadb2149700 1 --2- 172.21.15.153:0/4155506895 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadac0b12d0 0x7fadac0a92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:27.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.785+0000 7fadb1948700 1 -- 172.21.15.153:0/4155506895 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadac0b12d0 msgr2=0x7fadac0a92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:27.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.785+0000 7fadb1948700 1 --2- 172.21.15.153:0/4155506895 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadac0b12d0 0x7fadac0a92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:27.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.785+0000 7fadb1948700 1 -- 172.21.15.153:0/4155506895 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadac154900 msgr2=0x7fadac069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:27.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.785+0000 7fadb1948700 1 --2- 172.21.15.153:0/4155506895 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadac154900 0x7fadac069f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:27.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.785+0000 7fadb1948700 1 -- 172.21.15.153:0/4155506895 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada4009ae0 con 0x7fadac0cb390 2024-08-17T02:29:27.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.785+0000 7fadb1948700 1 --2- 172.21.15.153:0/4155506895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fadac0cb390 0x7fadac150420 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fada400b610 tx=0x7fada4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:27.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.785+0000 7fada27fc700 1 -- 172.21.15.153:0/4155506895 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada40088f0 con 0x7fadac0cb390 2024-08-17T02:29:27.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.785+0000 7fada27fc700 1 -- 172.21.15.153:0/4155506895 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada4008a50 con 0x7fadac0cb390 2024-08-17T02:29:27.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.785+0000 7fada27fc700 1 -- 172.21.15.153:0/4155506895 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada4008e10 con 0x7fadac0cb390 2024-08-17T02:29:27.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.785+0000 7fadb314b700 1 -- 172.21.15.153:0/4155506895 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadac0a59c0 con 0x7fadac0cb390 2024-08-17T02:29:27.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.785+0000 7fadb314b700 1 -- 172.21.15.153:0/4155506895 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadac0a5f80 con 0x7fadac0cb390 2024-08-17T02:29:27.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.785+0000 7fada27fc700 1 -- 172.21.15.153:0/4155506895 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fada4003040 con 0x7fadac0cb390 2024-08-17T02:29:27.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.785+0000 7fadb314b700 1 -- 172.21.15.153:0/4155506895 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadac0643a0 con 0x7fadac0cb390 2024-08-17T02:29:27.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.785+0000 7fada27fc700 1 --2- 172.21.15.153:0/4155506895 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fad98060860 0x7fad98062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:27.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.785+0000 7fada27fc700 1 -- 172.21.15.153:0/4155506895 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fada407df10 con 0x7fadac0cb390 2024-08-17T02:29:27.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.789+0000 7fadb2149700 1 --2- 172.21.15.153:0/4155506895 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fad98060860 0x7fad98062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:27.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.789+0000 7fadb2149700 1 --2- 172.21.15.153:0/4155506895 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fad98060860 0x7fad98062d10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fada8009d20 tx=0x7fada80091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:27.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.793+0000 7fada27fc700 1 -- 172.21.15.153:0/4155506895 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fada404e600 con 0x7fadac0cb390 2024-08-17T02:29:27.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.957+0000 7fadb314b700 1 -- 172.21.15.153:0/4155506895 --> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fadac0a6710 con 0x7fad98060860 2024-08-17T02:29:27.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.961+0000 7fada27fc700 1 -- 172.21.15.153:0/4155506895 <== mgr.4104 v2:172.21.15.153:6832/24147 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49232 (secure 0 0 0) 0x7fadac0a6710 con 0x7fad98060860 2024-08-17T02:29:27.966 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:29:27.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.965+0000 7fadb314b700 1 -- 172.21.15.153:0/4155506895 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fad98060860 msgr2=0x7fad98062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:27.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.965+0000 7fadb314b700 1 --2- 172.21.15.153:0/4155506895 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fad98060860 0x7fad98062d10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fada8009d20 tx=0x7fada80091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:27.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.965+0000 7fadb314b700 1 -- 172.21.15.153:0/4155506895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fadac0cb390 msgr2=0x7fadac150420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:27.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.965+0000 7fadb314b700 1 --2- 172.21.15.153:0/4155506895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fadac0cb390 0x7fadac150420 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fada400b610 tx=0x7fada4018000 comp rx=0 tx=0).stop 2024-08-17T02:29:27.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.965+0000 7fadb314b700 1 -- 172.21.15.153:0/4155506895 shutdown_connections 2024-08-17T02:29:27.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.965+0000 7fadb314b700 1 --2- 172.21.15.153:0/4155506895 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fad98060860 0x7fad98062d10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:27.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.965+0000 7fadb314b700 1 --2- 172.21.15.153:0/4155506895 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadac154900 0x7fadac069f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:27.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.965+0000 7fadb314b700 1 --2- 172.21.15.153:0/4155506895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fadac0cb390 0x7fadac150420 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:27.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.965+0000 7fadb314b700 1 --2- 172.21.15.153:0/4155506895 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadac0b12d0 0x7fadac0a92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:27.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.965+0000 7fadb314b700 1 -- 172.21.15.153:0/4155506895 >> 172.21.15.153:0/4155506895 conn(0x7fadac0678d0 msgr2=0x7fadac1522e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:27.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.965+0000 7fadb314b700 1 -- 172.21.15.153:0/4155506895 shutdown_connections 2024-08-17T02:29:27.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:27.965+0000 7fadb314b700 1 -- 172.21.15.153:0/4155506895 wait complete. 2024-08-17T02:29:27.970 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-08-17T02:29:27.979 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2024-08-17T02:29:26.112533+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":161,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2392056,"kb_used_data":4880,"kb_used_omap":13,"kb_used_meta":2387058,"kb_avail":752582664,"statfs":{"total":773094113280,"available":770644647936,"internally_reserved":0,"allocated":4997120,"data_stored":2749426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2444348096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001834"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":181,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-08-17T02:29:19.846760+0000","last_change":"2024-08-17T02:26:00.033569+0000","last_active":"2024-08-17T02:29:19.846760+0000","last_peered":"2024-08-17T02:29:19.846760+0000","last_clean":"2024-08-17T02:29:19.846760+0000","last_became_active":"2024-08-17T02:26:00.031512+0000","last_became_peered":"2024-08-17T02:26:00.031512+0000","last_unstale":"2024-08-17T02:29:19.846760+0000","last_undegraded":"2024-08-17T02:29:19.846760+0000","last_fullsized":"2024-08-17T02:29:19.846760+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:58.643690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:58.643690+0000","last_clean_scrub_stamp":"2024-08-17T02:25:58.643690+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:47:24.121981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509485,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298400,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073440,"statfs":{"total":96636764160,"available":96331202560,"internally_reserved":0,"allocated":1069056,"data_stored":787510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:03 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.92500000000000004,"15min":0.94799999999999995},"min":{"1min":0.61299999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.052,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.83499999999999996,"15min":0.80900000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1599999999999999,"5min":1.165,"15min":1.165},"last":0.60799999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:29:03 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.84499999999999997,"15min":0.83799999999999997},"min":{"1min":0.68600000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.012,"5min":1.268,"15min":1.268},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.90100000000000002,"15min":0.90500000000000003},"min":{"1min":0.64800000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.177,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.56799999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:29:03 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90100000000000002,"15min":0.90700000000000003},"min":{"1min":0.67900000000000005,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.103,"5min":1.357,"15min":1.357},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.94999999999999996,"15min":0.93999999999999995},"min":{"1min":0.72699999999999998,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.86299999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:29:03 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.878,"15min":0.873},"min":{"1min":0.67900000000000005,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.129,"5min":1.409,"15min":1.409},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.026,"5min":1.0840000000000001,"15min":1.1120000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.2410000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.96799999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:29:03 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.93899999999999995,"15min":0.95899999999999996},"min":{"1min":0.63900000000000001,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.147},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.05,"15min":1.0509999999999999},"min":{"1min":0.94399999999999995,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.262,"5min":1.522,"15min":1.522},"last":1.224}]},{"osd":5,"last update":"Sat Aug 17 02:29:03 2024","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.1220000000000001,"15min":1.1479999999999999},"min":{"1min":0.70999999999999996,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.294,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1020000000000001,"15min":1.0980000000000001},"min":{"1min":0.95599999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.998}]},{"osd":6,"last update":"Sat Aug 17 02:29:03 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1299999999999999,"15min":1.1339999999999999},"min":{"1min":0.84599999999999997,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.534,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.085},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.149,"15min":1.151},"min":{"1min":0.95099999999999996,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.3340000000000001,"5min":1.609,"15min":1.609},"last":1.1160000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509485,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297824,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074016,"statfs":{"total":96636764160,"available":96331792384,"internally_reserved":0,"allocated":479232,"data_stored":197712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.877,"15min":0.86599999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.93600000000000005,"15min":0.92600000000000005},"min":{"1min":0.67800000000000005,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.25,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.81699999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.89700000000000002,"15min":0.88400000000000001},"min":{"1min":0.65600000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.91800000000000004,"15min":0.93000000000000005},"min":{"1min":0.69199999999999995,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.288,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.70499999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.86899999999999999,"15min":0.86199999999999999},"min":{"1min":0.65900000000000003,"5min":0.623,"15min":0.623},"max":{"1min":0.998,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.999,"5min":0.96999999999999997,"15min":0.97599999999999998},"min":{"1min":0.77000000000000002,"5min":0.627,"15min":0.627},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":1.0229999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.91300000000000003,"15min":0.90100000000000002},"min":{"1min":0.77200000000000002,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.1379999999999999},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.97299999999999998,"15min":0.97999999999999998},"min":{"1min":0.79500000000000004,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.1890000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":1.181}]},{"osd":4,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.93400000000000005,"15min":0.93100000000000005},"min":{"1min":0.68200000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.3460000000000001,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.004,"5min":1.0680000000000001,"15min":1.0920000000000001},"min":{"1min":0.60099999999999998,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2749999999999999,"5min":1.472,"15min":1.472},"last":1.0580000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.99099999999999999,"15min":1.0069999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":1.292},{"interface":"front","average":{"1min":1.159,"5min":1.1439999999999999,"15min":1.1419999999999999},"min":{"1min":0.91200000000000003,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.4399999999999999,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.254}]},{"osd":7,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.163,"15min":1.1759999999999999},"min":{"1min":0.94699999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.3879999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":1.232},{"interface":"front","average":{"1min":1.115,"5min":1.194,"15min":1.2250000000000001},"min":{"1min":0.91000000000000003,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.367,"5min":1.766,"15min":1.766},"last":1.361}]}]},{"osd":5,"up_from":15,"seq":64424509484,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297820,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074020,"statfs":{"total":96636764160,"available":96331796480,"internally_reserved":0,"allocated":475136,"data_stored":197122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.85599999999999998,"15min":0.86599999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.88400000000000001,"15min":0.86099999999999999},"min":{"1min":0.69199999999999995,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1830000000000001,"5min":1.335,"15min":1.335},"last":0.61899999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.94099999999999995,"15min":0.97099999999999997},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.133,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.111,"5min":1.268,"15min":1.268},"last":0.98599999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.91400000000000003,"15min":0.91600000000000004},"min":{"1min":0.624,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.224,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.96299999999999997,"15min":0.98899999999999999},"min":{"1min":0.72199999999999998,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.083,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":1.0209999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.86799999999999999,"15min":0.83599999999999997},"min":{"1min":0.69399999999999995,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":1.073},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.018,"15min":1.008},"min":{"1min":0.78300000000000003,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.70499999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.92500000000000004,"15min":0.92700000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.131,"5min":1.335,"15min":1.335},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95299999999999996,"15min":0.95399999999999996},"min":{"1min":0.69499999999999995,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.252,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.73499999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.998,"15min":0.99199999999999999},"min":{"1min":0.80300000000000005,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.282,"5min":1.496,"15min":1.496},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1559999999999999,"15min":1.169},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.097}]},{"osd":7,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.0740000000000001,"15min":1.0780000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.4750000000000001,"5min":1.49,"15min":1.49},"last":0.875},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":1.427,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.95699999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509486,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297828,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074012,"statfs":{"total":96636764160,"available":96331788288,"internally_reserved":0,"allocated":483328,"data_stored":198604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:04 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.83799999999999997,"15min":0.81599999999999995},"min":{"1min":0.60799999999999998,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":1.1970000000000001},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.94599999999999995,"15min":0.93200000000000005},"min":{"1min":0.69199999999999995,"5min":0.625,"15min":0.625},"max":{"1min":1.1830000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.91500000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:29:04 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.94299999999999995,"15min":0.95599999999999996},"min":{"1min":0.68999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":1.286},{"interface":"front","average":{"1min":0.876,"5min":0.89100000000000001,"15min":0.88500000000000001},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1299999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.79000000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:29:04 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.83199999999999996,"15min":0.81499999999999995},"min":{"1min":0.66200000000000003,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96399999999999997,"15min":0.95999999999999996},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":1.4179999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:29:04 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.94399999999999995,"15min":0.92800000000000005},"min":{"1min":0.72799999999999998,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.2350000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.04},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.002,"15min":0.99399999999999999},"min":{"1min":0.80700000000000005,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2649999999999999,"5min":1.516,"15min":1.516},"last":1.1020000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:29:04 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.016,"15min":1.0329999999999999},"min":{"1min":0.70199999999999996,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.149},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0740000000000001,"15min":1.0960000000000001},"min":{"1min":0.66100000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.292,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.4530000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:29:04 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93500000000000005,"15min":0.94099999999999995},"min":{"1min":0.73699999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.139,"5min":1.1639999999999999,"15min":1.171},"min":{"1min":1.01,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.4590000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.5049999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:29:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1379999999999999,"15min":1.149},"min":{"1min":0.79000000000000004,"5min":0.629,"15min":0.629},"max":{"1min":1.3,"5min":1.758,"15min":1.758},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.099,"5min":1.105,"15min":1.107},"min":{"1min":0.84899999999999998,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.2729999999999999,"5min":1.28,"15min":1.28},"last":1.3899999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509485,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301988,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069852,"statfs":{"total":96636764160,"available":96327528448,"internally_reserved":0,"allocated":483328,"data_stored":197678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.69599999999999995,"15min":0.71599999999999997},"min":{"1min":0.48499999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.097,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.69699999999999995,"15min":0.68200000000000005},"min":{"1min":0.52200000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.006,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.60999999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.73199999999999998,"15min":0.73799999999999999},"min":{"1min":0.52300000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89400000000000002,"5min":1.798,"15min":1.798},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.59099999999999997,"5min":0.439,"15min":0.439},"max":{"1min":1.0249999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.64900000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.93999999999999995,"15min":1.002},"min":{"1min":0.63300000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0469999999999999,"5min":7.0899999999999999,"15min":7.0899999999999999},"last":0.748},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.89100000000000001,"15min":0.90700000000000003},"min":{"1min":0.68600000000000005,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.089,"5min":2.4409999999999998,"15min":2.4409999999999998},"last":0.80300000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.0369999999999999,"15min":1.0620000000000001},"min":{"1min":0.72999999999999998,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.2869999999999999,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.081,"5min":1.153,"15min":1.181},"min":{"1min":0.88400000000000001,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.3160000000000001,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.4359999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.044,"15min":1.0489999999999999},"min":{"1min":0.80600000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.171,"5min":1.929,"15min":1.929},"last":1.274},{"interface":"front","average":{"1min":1.087,"5min":1.101,"15min":1.107},"min":{"1min":0.76800000000000002,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.294,"5min":1.988,"15min":1.988},"last":1.1519999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0920000000000001,"15min":1.1240000000000001},"min":{"1min":0.83199999999999996,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.4259999999999999,"5min":2.04,"15min":2.04},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.083,"5min":1.1419999999999999,"15min":1.1639999999999999},"min":{"1min":0.90600000000000003,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.27,"5min":2.141,"15min":2.141},"last":1.379}]},{"osd":7,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.159,"15min":1.161},"min":{"1min":0.83599999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.52,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.145,"15min":1.1459999999999999},"min":{"1min":0.94399999999999995,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.48,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.0960000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509484,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301980,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069860,"statfs":{"total":96636764160,"available":96327536640,"internally_reserved":0,"allocated":475136,"data_stored":197122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.74099999999999999,"15min":0.77100000000000002},"min":{"1min":0.51400000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.94499999999999995,"5min":1.268,"15min":1.268},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.76200000000000001,"15min":0.76700000000000002},"min":{"1min":0.57199999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.98099999999999998,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.64800000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.73299999999999998,"15min":0.72499999999999998},"min":{"1min":0.57699999999999996,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.97399999999999998,"5min":1.01,"15min":1.01},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.82899999999999996,"15min":0.84099999999999997},"min":{"1min":0.60999999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.96099999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.86499999999999999,"15min":0.876},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.135,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.72299999999999998,"15min":0.70599999999999996},"min":{"1min":0.56799999999999995,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.69899999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":1.02,"15min":1.046},"min":{"1min":0.80000000000000004,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.1839999999999999,"5min":1.857,"15min":1.857},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.044,"5min":1.125,"15min":1.157},"min":{"1min":0.875,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.325,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":1.226}]},{"osd":5,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.97999999999999998,"15min":1.0009999999999999},"min":{"1min":0.753,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.254,"5min":1.339,"15min":1.339},"last":0.998},{"interface":"front","average":{"1min":1.105,"5min":1.1459999999999999,"15min":1.1759999999999999},"min":{"1min":0.88600000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.5449999999999999,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.0269999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.2130000000000001,"15min":1.256},"min":{"1min":0.83499999999999996,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3959999999999999,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.05,"5min":1.0900000000000001,"15min":1.1060000000000001},"min":{"1min":0.93000000000000005,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":1.351,"5min":1.427,"15min":1.427},"last":0.91000000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.1459999999999999,"15min":1.1659999999999999},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.3009999999999999,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.085},{"interface":"front","average":{"1min":1.202,"5min":1.222,"15min":1.244},"min":{"1min":0.996,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.6259999999999999,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.169}]}]},{"osd":2,"up_from":14,"seq":60129542189,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297824,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074016,"statfs":{"total":96636764160,"available":96331792384,"internally_reserved":0,"allocated":475136,"data_stored":192425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:07 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64000000000000001,"15min":0.63200000000000001},"min":{"1min":0.51600000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.71999999999999997,"15min":0.69599999999999995},"min":{"1min":0.57399999999999995,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.92700000000000005,"5min":1.129,"15min":1.129},"last":0.34599999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:29:12 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.71299999999999997,"15min":0.70499999999999996},"min":{"1min":0.51800000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.73799999999999999,"15min":0.70299999999999996},"min":{"1min":0.59899999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.171,"5min":1.21,"15min":1.21},"last":0.45700000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:29:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68000000000000005,"15min":0.65700000000000003},"min":{"1min":0.53400000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89900000000000002,"5min":1.25,"15min":1.25},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.86399999999999999,"15min":0.83999999999999997},"min":{"1min":0.63400000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.3120000000000001,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.72699999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:29:12 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.02,"15min":1.0149999999999999},"min":{"1min":0.75600000000000001,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.423,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.96099999999999997,"5min":1.0129999999999999,"15min":1.02},"min":{"1min":0.73499999999999999,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.254,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.63800000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:29:12 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.004,"15min":1.0089999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.2769999999999999,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.097,"5min":1.0880000000000001,"15min":1.0840000000000001},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.484,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.66500000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:29:12 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0880000000000001,"15min":1.1020000000000001},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.359,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.0840000000000001,"15min":1.0740000000000001},"min":{"1min":0.86099999999999999,"5min":0.749,"15min":0.749},"max":{"1min":1.377,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.006}]},{"osd":7,"last update":"Sat Aug 17 02:29:12 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.165,"15min":1.1739999999999999},"min":{"1min":0.86599999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.292,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.1559999999999999,"15min":1.1479999999999999},"min":{"1min":0.99199999999999999,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.94099999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542189,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298392,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073448,"statfs":{"total":96636764160,"available":96331210752,"internally_reserved":0,"allocated":1056768,"data_stored":781253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64600000000000002,"15min":0.64700000000000002},"min":{"1min":0.48399999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.74299999999999999,"15min":0.71499999999999997},"min":{"1min":0.65300000000000002,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.59299999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.65900000000000003,"15min":0.65200000000000002},"min":{"1min":0.504,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80000000000000004,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76400000000000001,"15min":0.75},"min":{"1min":0.56799999999999995,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.018,"5min":1.123,"15min":1.123},"last":0.83799999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.86099999999999999,"15min":0.82399999999999995},"min":{"1min":0.77900000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1819999999999999,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.79700000000000004,"15min":0.76700000000000002},"min":{"1min":0.60399999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.80100000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.96099999999999997,"15min":0.96699999999999997},"min":{"1min":0.69299999999999995,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0800000000000001,"5min":1.601,"15min":1.601},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.097,"15min":1.113},"min":{"1min":0.84099999999999997,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.4410000000000001,"5min":1.571,"15min":1.571},"last":1.03}]},{"osd":5,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.96299999999999997,"15min":0.97699999999999998},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.071,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.105},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.1040000000000001,"15min":1.117},"min":{"1min":0.76300000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.94199999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.0840000000000001,"15min":1.0740000000000001},"min":{"1min":0.89700000000000002,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.077,"15min":1.0880000000000001},"min":{"1min":0.82899999999999996,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.171,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.0589999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.1339999999999999,"15min":1.111},"min":{"1min":0.94999999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.103,"15min":1.0940000000000001},"min":{"1min":0.82999999999999996,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.2989999999999999,"5min":1.518,"15min":1.518},"last":0.96799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:29:27.982 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:29:28.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.081+0000 7f3106bae700 1 Processor -- start 2024-08-17T02:29:28.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.081+0000 7f3106bae700 1 -- start start 2024-08-17T02:29:28.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.085+0000 7f3106bae700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3100159040 0x7f31000cf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:28.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.085+0000 7f3106bae700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31000d0010 0x7f31000d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:28.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.085+0000 7f3106bae700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31000cf190 con 0x7f310015cea0 2024-08-17T02:29:28.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.085+0000 7f3106bae700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31000d09a0 con 0x7f3100159040 2024-08-17T02:29:28.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.085+0000 7f3106bae700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31000ce5e0 con 0x7f31000d0010 2024-08-17T02:29:28.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.085+0000 7f31063ad700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f310015cea0 0x7f310015d320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:49834/0 (socket says 172.21.15.153:49834) 2024-08-17T02:29:28.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.085+0000 7f31063ad700 1 -- 172.21.15.153:0/462104143 learned_addr learned my addr 172.21.15.153:0/462104143 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:29:28.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.085+0000 7f3105bac700 1 --2- 172.21.15.153:0/462104143 >> v2:172.21.15.174:3300/0 conn(0x7f3100159040 0x7f31000cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:28.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.085+0000 7f31053ab700 1 --2- 172.21.15.153:0/462104143 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31000d0010 0x7f31000d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:28.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.085+0000 7f3104baa700 1 -- 172.21.15.153:0/462104143 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4103138304 0 0) 0x7f31000cf190 con 0x7f310015cea0 2024-08-17T02:29:28.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.085+0000 7f3104baa700 1 -- 172.21.15.153:0/462104143 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30ec003570 con 0x7f310015cea0 2024-08-17T02:29:28.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.085+0000 7f3104baa700 1 -- 172.21.15.153:0/462104143 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1971982209 0 0) 0x7f30ec003570 con 0x7f310015cea0 2024-08-17T02:29:28.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.085+0000 7f31053ab700 1 -- 172.21.15.153:0/462104143 >> v2:172.21.15.174:3300/0 conn(0x7f3100159040 msgr2=0x7f31000cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:28.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.085+0000 7f31053ab700 1 --2- 172.21.15.153:0/462104143 >> v2:172.21.15.174:3300/0 conn(0x7f3100159040 0x7f31000cf620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.085+0000 7f31053ab700 1 -- 172.21.15.153:0/462104143 >> v1:172.21.15.153:6789/0 conn(0x7f310015cea0 legacy=0x7f310015d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:28.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.085+0000 7f31053ab700 1 -- 172.21.15.153:0/462104143 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31000ce860 con 0x7f31000d0010 2024-08-17T02:29:28.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.085+0000 7f31053ab700 1 --2- 172.21.15.153:0/462104143 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31000d0010 0x7f31000d0460 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f30fc0098e0 tx=0x7f30fc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87255798aca0b1c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:28.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.085+0000 7f3104baa700 1 -- 172.21.15.153:0/462104143 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f80017f0 con 0x7f31000d0010 2024-08-17T02:29:28.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.085+0000 7f3104baa700 1 -- 172.21.15.153:0/462104143 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30fc011420 con 0x7f31000d0010 2024-08-17T02:29:28.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.085+0000 7f3104baa700 1 -- 172.21.15.153:0/462104143 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30fc0117a0 con 0x7f31000d0010 2024-08-17T02:29:28.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.089+0000 7f3106bae700 1 -- 172.21.15.153:0/462104143 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31000d0010 msgr2=0x7f31000d0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:28.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.089+0000 7f3106bae700 1 --2- 172.21.15.153:0/462104143 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31000d0010 0x7f31000d0460 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f30fc0098e0 tx=0x7f30fc0091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.089+0000 7f3106bae700 1 -- 172.21.15.153:0/462104143 shutdown_connections 2024-08-17T02:29:28.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.089+0000 7f3106bae700 1 --2- 172.21.15.153:0/462104143 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31000d0010 0x7f31000d0460 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.089+0000 7f3106bae700 1 --2- 172.21.15.153:0/462104143 >> v2:172.21.15.174:3300/0 conn(0x7f3100159040 0x7f31000cf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.089+0000 7f3106bae700 1 -- 172.21.15.153:0/462104143 >> 172.21.15.153:0/462104143 conn(0x7f3100068250 msgr2=0x7f3100068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:28.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.089+0000 7f3106bae700 1 -- 172.21.15.153:0/462104143 shutdown_connections 2024-08-17T02:29:28.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.089+0000 7f3106bae700 1 -- 172.21.15.153:0/462104143 wait complete. 2024-08-17T02:29:28.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.089+0000 7f3106bae700 1 Processor -- start 2024-08-17T02:29:28.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.089+0000 7f3106bae700 1 -- start start 2024-08-17T02:29:28.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.089+0000 7f3106bae700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31000d0010 0x7f31000a69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:28.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.089+0000 7f3106bae700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3100159040 0x7f31000ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:28.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.089+0000 7f3106bae700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f310015cea0 0x7f3100151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:28.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.089+0000 7f3106bae700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310016d540 con 0x7f31000d0010 2024-08-17T02:29:28.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.089+0000 7f3106bae700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31000ae830 con 0x7f3100159040 2024-08-17T02:29:28.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.089+0000 7f3106bae700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31000a6f90 con 0x7f310015cea0 2024-08-17T02:29:28.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.089+0000 7f3105bac700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31000d0010 0x7f31000a69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:28.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.089+0000 7f3105bac700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31000d0010 0x7f31000a69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40664/0 (socket says 172.21.15.153:40664) 2024-08-17T02:29:28.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.089+0000 7f3105bac700 1 -- 172.21.15.153:0/174264221 learned_addr learned my addr 172.21.15.153:0/174264221 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:28.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.093+0000 7f31053ab700 1 --2- 172.21.15.153:0/174264221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3100159040 0x7f31000ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:28.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.093+0000 7f31063ad700 1 --2- 172.21.15.153:0/174264221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f310015cea0 0x7f3100151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:28.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.093+0000 7f3105bac700 1 -- 172.21.15.153:0/174264221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f310015cea0 msgr2=0x7f3100151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:28.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.093+0000 7f3105bac700 1 --2- 172.21.15.153:0/174264221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f310015cea0 0x7f3100151f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.093+0000 7f3105bac700 1 -- 172.21.15.153:0/174264221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3100159040 msgr2=0x7f31000ae2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:28.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.093+0000 7f3105bac700 1 --2- 172.21.15.153:0/174264221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3100159040 0x7f31000ae2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.093+0000 7f3105bac700 1 -- 172.21.15.153:0/174264221 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30fc009420 con 0x7f31000d0010 2024-08-17T02:29:28.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.093+0000 7f3105bac700 1 --2- 172.21.15.153:0/174264221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31000d0010 0x7f31000a69b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f30f000ec80 tx=0x7f30f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:28.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.093+0000 7f30f5ffb700 1 -- 172.21.15.153:0/174264221 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f000c850 con 0x7f31000d0010 2024-08-17T02:29:28.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.093+0000 7f30f5ffb700 1 -- 172.21.15.153:0/174264221 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f000c9b0 con 0x7f31000d0010 2024-08-17T02:29:28.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.093+0000 7f3106bae700 1 -- 172.21.15.153:0/174264221 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f310016cc10 con 0x7f31000d0010 2024-08-17T02:29:28.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.093+0000 7f30f5ffb700 1 -- 172.21.15.153:0/174264221 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f000cd50 con 0x7f31000d0010 2024-08-17T02:29:28.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.093+0000 7f3106bae700 1 -- 172.21.15.153:0/174264221 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f310016d1d0 con 0x7f31000d0010 2024-08-17T02:29:28.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.093+0000 7f30f5ffb700 1 -- 172.21.15.153:0/174264221 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f30f0013680 con 0x7f31000d0010 2024-08-17T02:29:28.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.093+0000 7f3106bae700 1 -- 172.21.15.153:0/174264221 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31000643a0 con 0x7f31000d0010 2024-08-17T02:29:28.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.093+0000 7f30f5ffb700 1 --2- 172.21.15.153:0/174264221 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f30e4060860 0x7f30e4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:28.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.093+0000 7f30f5ffb700 1 -- 172.21.15.153:0/174264221 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f30f007cea0 con 0x7f31000d0010 2024-08-17T02:29:28.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.093+0000 7f31053ab700 1 --2- 172.21.15.153:0/174264221 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f30e4060860 0x7f30e4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:28.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.097+0000 7f31053ab700 1 --2- 172.21.15.153:0/174264221 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f30e4060860 0x7f30e4062d10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f30fc0091e0 tx=0x7f30fc016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:28.104 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.101+0000 7f30f5ffb700 1 -- 172.21.15.153:0/174264221 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f30f004d570 con 0x7f31000d0010 2024-08-17T02:29:28.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.261+0000 7f3106bae700 1 -- 172.21.15.153:0/174264221 --> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f310016d680 con 0x7f30e4060860 2024-08-17T02:29:28.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.265+0000 7f30f5ffb700 1 -- 172.21.15.153:0/174264221 <== mgr.4104 v2:172.21.15.153:6832/24147 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49194 (secure 0 0 0) 0x7f30fc011710 con 0x7f30e4060860 2024-08-17T02:29:28.270 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:29:28.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.269+0000 7f3106bae700 1 -- 172.21.15.153:0/174264221 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f30e4060860 msgr2=0x7f30e4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:28.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.269+0000 7f3106bae700 1 --2- 172.21.15.153:0/174264221 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f30e4060860 0x7f30e4062d10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f30fc0091e0 tx=0x7f30fc016000 comp rx=0 tx=0).stop 2024-08-17T02:29:28.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.269+0000 7f3106bae700 1 -- 172.21.15.153:0/174264221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31000d0010 msgr2=0x7f31000a69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:28.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.269+0000 7f3106bae700 1 --2- 172.21.15.153:0/174264221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31000d0010 0x7f31000a69b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f30f000ec80 tx=0x7f30f00091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.269+0000 7f3106bae700 1 -- 172.21.15.153:0/174264221 shutdown_connections 2024-08-17T02:29:28.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.269+0000 7f3106bae700 1 --2- 172.21.15.153:0/174264221 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f30e4060860 0x7f30e4062d10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.269+0000 7f3106bae700 1 --2- 172.21.15.153:0/174264221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f310015cea0 0x7f3100151f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.269+0000 7f3106bae700 1 --2- 172.21.15.153:0/174264221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3100159040 0x7f31000ae2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.269+0000 7f3106bae700 1 --2- 172.21.15.153:0/174264221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31000d0010 0x7f31000a69b0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.269+0000 7f3106bae700 1 -- 172.21.15.153:0/174264221 >> 172.21.15.153:0/174264221 conn(0x7f3100068250 msgr2=0x7f3100158100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:28.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.269+0000 7f3106bae700 1 -- 172.21.15.153:0/174264221 shutdown_connections 2024-08-17T02:29:28.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.269+0000 7f3106bae700 1 -- 172.21.15.153:0/174264221 wait complete. 2024-08-17T02:29:28.274 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-08-17T02:29:28.284 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-08-17T02:29:28.112972+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2392124,"kb_used_data":4948,"kb_used_omap":13,"kb_used_meta":2387058,"kb_avail":752582596,"statfs":{"total":773094113280,"available":770644578304,"internally_reserved":0,"allocated":5066752,"data_stored":2783762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2444348096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001761"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":181,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-08-17T02:29:19.846760+0000","last_change":"2024-08-17T02:26:00.033569+0000","last_active":"2024-08-17T02:29:19.846760+0000","last_peered":"2024-08-17T02:29:19.846760+0000","last_clean":"2024-08-17T02:29:19.846760+0000","last_became_active":"2024-08-17T02:26:00.031512+0000","last_became_peered":"2024-08-17T02:26:00.031512+0000","last_unstale":"2024-08-17T02:29:19.846760+0000","last_undegraded":"2024-08-17T02:29:19.846760+0000","last_fullsized":"2024-08-17T02:29:19.846760+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:58.643690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:58.643690+0000","last_clean_scrub_stamp":"2024-08-17T02:25:58.643690+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:47:24.121981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509485,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298400,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073440,"statfs":{"total":96636764160,"available":96331202560,"internally_reserved":0,"allocated":1069056,"data_stored":787510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:03 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.92500000000000004,"15min":0.94799999999999995},"min":{"1min":0.61299999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.052,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.83499999999999996,"15min":0.80900000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1599999999999999,"5min":1.165,"15min":1.165},"last":0.60799999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:29:03 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.84499999999999997,"15min":0.83799999999999997},"min":{"1min":0.68600000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.012,"5min":1.268,"15min":1.268},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.90100000000000002,"15min":0.90500000000000003},"min":{"1min":0.64800000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.177,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.56799999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:29:03 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90100000000000002,"15min":0.90700000000000003},"min":{"1min":0.67900000000000005,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.103,"5min":1.357,"15min":1.357},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.94999999999999996,"15min":0.93999999999999995},"min":{"1min":0.72699999999999998,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.86299999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:29:03 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.878,"15min":0.873},"min":{"1min":0.67900000000000005,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.129,"5min":1.409,"15min":1.409},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.026,"5min":1.0840000000000001,"15min":1.1120000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.2410000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.96799999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:29:03 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.93899999999999995,"15min":0.95899999999999996},"min":{"1min":0.63900000000000001,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.147},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.05,"15min":1.0509999999999999},"min":{"1min":0.94399999999999995,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.262,"5min":1.522,"15min":1.522},"last":1.224}]},{"osd":5,"last update":"Sat Aug 17 02:29:03 2024","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.1220000000000001,"15min":1.1479999999999999},"min":{"1min":0.70999999999999996,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.294,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1020000000000001,"15min":1.0980000000000001},"min":{"1min":0.95599999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.998}]},{"osd":6,"last update":"Sat Aug 17 02:29:03 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1299999999999999,"15min":1.1339999999999999},"min":{"1min":0.84599999999999997,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.534,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.085},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.149,"15min":1.151},"min":{"1min":0.95099999999999996,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.3340000000000001,"5min":1.609,"15min":1.609},"last":1.1160000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509485,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297824,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074016,"statfs":{"total":96636764160,"available":96331792384,"internally_reserved":0,"allocated":479232,"data_stored":197712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.877,"15min":0.86599999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.93600000000000005,"15min":0.92600000000000005},"min":{"1min":0.67800000000000005,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.25,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.81699999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.89700000000000002,"15min":0.88400000000000001},"min":{"1min":0.65600000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.91800000000000004,"15min":0.93000000000000005},"min":{"1min":0.69199999999999995,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.288,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.70499999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.86899999999999999,"15min":0.86199999999999999},"min":{"1min":0.65900000000000003,"5min":0.623,"15min":0.623},"max":{"1min":0.998,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.999,"5min":0.96999999999999997,"15min":0.97599999999999998},"min":{"1min":0.77000000000000002,"5min":0.627,"15min":0.627},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":1.0229999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.91300000000000003,"15min":0.90100000000000002},"min":{"1min":0.77200000000000002,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.1379999999999999},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.97299999999999998,"15min":0.97999999999999998},"min":{"1min":0.79500000000000004,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.1890000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":1.181}]},{"osd":4,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.93400000000000005,"15min":0.93100000000000005},"min":{"1min":0.68200000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.3460000000000001,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.004,"5min":1.0680000000000001,"15min":1.0920000000000001},"min":{"1min":0.60099999999999998,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2749999999999999,"5min":1.472,"15min":1.472},"last":1.0580000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.99099999999999999,"15min":1.0069999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":1.292},{"interface":"front","average":{"1min":1.159,"5min":1.1439999999999999,"15min":1.1419999999999999},"min":{"1min":0.91200000000000003,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.4399999999999999,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.254}]},{"osd":7,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.163,"15min":1.1759999999999999},"min":{"1min":0.94699999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.3879999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":1.232},{"interface":"front","average":{"1min":1.115,"5min":1.194,"15min":1.2250000000000001},"min":{"1min":0.91000000000000003,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.367,"5min":1.766,"15min":1.766},"last":1.361}]}]},{"osd":5,"up_from":15,"seq":64424509484,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297820,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074020,"statfs":{"total":96636764160,"available":96331796480,"internally_reserved":0,"allocated":475136,"data_stored":197122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.85599999999999998,"15min":0.86599999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.88400000000000001,"15min":0.86099999999999999},"min":{"1min":0.69199999999999995,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1830000000000001,"5min":1.335,"15min":1.335},"last":0.61899999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.94099999999999995,"15min":0.97099999999999997},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.133,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.111,"5min":1.268,"15min":1.268},"last":0.98599999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.91400000000000003,"15min":0.91600000000000004},"min":{"1min":0.624,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.224,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.96299999999999997,"15min":0.98899999999999999},"min":{"1min":0.72199999999999998,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.083,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":1.0209999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.86799999999999999,"15min":0.83599999999999997},"min":{"1min":0.69399999999999995,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":1.073},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.018,"15min":1.008},"min":{"1min":0.78300000000000003,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.70499999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.92500000000000004,"15min":0.92700000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.131,"5min":1.335,"15min":1.335},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95299999999999996,"15min":0.95399999999999996},"min":{"1min":0.69499999999999995,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.252,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.73499999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.998,"15min":0.99199999999999999},"min":{"1min":0.80300000000000005,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.282,"5min":1.496,"15min":1.496},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1559999999999999,"15min":1.169},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.097}]},{"osd":7,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.0740000000000001,"15min":1.0780000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.4750000000000001,"5min":1.49,"15min":1.49},"last":0.875},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":1.427,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.95699999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509486,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297828,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074012,"statfs":{"total":96636764160,"available":96331788288,"internally_reserved":0,"allocated":483328,"data_stored":198604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:04 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.83799999999999997,"15min":0.81599999999999995},"min":{"1min":0.60799999999999998,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":1.1970000000000001},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.94599999999999995,"15min":0.93200000000000005},"min":{"1min":0.69199999999999995,"5min":0.625,"15min":0.625},"max":{"1min":1.1830000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.91500000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:29:04 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.94299999999999995,"15min":0.95599999999999996},"min":{"1min":0.68999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":1.286},{"interface":"front","average":{"1min":0.876,"5min":0.89100000000000001,"15min":0.88500000000000001},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1299999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.79000000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:29:04 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.83199999999999996,"15min":0.81499999999999995},"min":{"1min":0.66200000000000003,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96399999999999997,"15min":0.95999999999999996},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":1.4179999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:29:04 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.94399999999999995,"15min":0.92800000000000005},"min":{"1min":0.72799999999999998,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.2350000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.04},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.002,"15min":0.99399999999999999},"min":{"1min":0.80700000000000005,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2649999999999999,"5min":1.516,"15min":1.516},"last":1.1020000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:29:04 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.016,"15min":1.0329999999999999},"min":{"1min":0.70199999999999996,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.149},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0740000000000001,"15min":1.0960000000000001},"min":{"1min":0.66100000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.292,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.4530000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:29:04 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93500000000000005,"15min":0.94099999999999995},"min":{"1min":0.73699999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.139,"5min":1.1639999999999999,"15min":1.171},"min":{"1min":1.01,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.4590000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.5049999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:29:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1379999999999999,"15min":1.149},"min":{"1min":0.79000000000000004,"5min":0.629,"15min":0.629},"max":{"1min":1.3,"5min":1.758,"15min":1.758},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.099,"5min":1.105,"15min":1.107},"min":{"1min":0.84899999999999998,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.2729999999999999,"5min":1.28,"15min":1.28},"last":1.3899999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509485,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301988,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069852,"statfs":{"total":96636764160,"available":96327528448,"internally_reserved":0,"allocated":483328,"data_stored":197678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.69599999999999995,"15min":0.71599999999999997},"min":{"1min":0.48499999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.097,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.69699999999999995,"15min":0.68200000000000005},"min":{"1min":0.52200000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.006,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.60999999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.73199999999999998,"15min":0.73799999999999999},"min":{"1min":0.52300000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89400000000000002,"5min":1.798,"15min":1.798},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.59099999999999997,"5min":0.439,"15min":0.439},"max":{"1min":1.0249999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.64900000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.93999999999999995,"15min":1.002},"min":{"1min":0.63300000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0469999999999999,"5min":7.0899999999999999,"15min":7.0899999999999999},"last":0.748},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.89100000000000001,"15min":0.90700000000000003},"min":{"1min":0.68600000000000005,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.089,"5min":2.4409999999999998,"15min":2.4409999999999998},"last":0.80300000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.0369999999999999,"15min":1.0620000000000001},"min":{"1min":0.72999999999999998,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.2869999999999999,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.081,"5min":1.153,"15min":1.181},"min":{"1min":0.88400000000000001,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.3160000000000001,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.4359999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.044,"15min":1.0489999999999999},"min":{"1min":0.80600000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.171,"5min":1.929,"15min":1.929},"last":1.274},{"interface":"front","average":{"1min":1.087,"5min":1.101,"15min":1.107},"min":{"1min":0.76800000000000002,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.294,"5min":1.988,"15min":1.988},"last":1.1519999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0920000000000001,"15min":1.1240000000000001},"min":{"1min":0.83199999999999996,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.4259999999999999,"5min":2.04,"15min":2.04},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.083,"5min":1.1419999999999999,"15min":1.1639999999999999},"min":{"1min":0.90600000000000003,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.27,"5min":2.141,"15min":2.141},"last":1.379}]},{"osd":7,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.159,"15min":1.161},"min":{"1min":0.83599999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.52,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.145,"15min":1.1459999999999999},"min":{"1min":0.94399999999999995,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.48,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.0960000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509484,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301980,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069860,"statfs":{"total":96636764160,"available":96327536640,"internally_reserved":0,"allocated":475136,"data_stored":197122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.74099999999999999,"15min":0.77100000000000002},"min":{"1min":0.51400000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.94499999999999995,"5min":1.268,"15min":1.268},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.76200000000000001,"15min":0.76700000000000002},"min":{"1min":0.57199999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.98099999999999998,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.64800000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.73299999999999998,"15min":0.72499999999999998},"min":{"1min":0.57699999999999996,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.97399999999999998,"5min":1.01,"15min":1.01},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.82899999999999996,"15min":0.84099999999999997},"min":{"1min":0.60999999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.96099999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.86499999999999999,"15min":0.876},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.135,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.72299999999999998,"15min":0.70599999999999996},"min":{"1min":0.56799999999999995,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.69899999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":1.02,"15min":1.046},"min":{"1min":0.80000000000000004,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.1839999999999999,"5min":1.857,"15min":1.857},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.044,"5min":1.125,"15min":1.157},"min":{"1min":0.875,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.325,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":1.226}]},{"osd":5,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.97999999999999998,"15min":1.0009999999999999},"min":{"1min":0.753,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.254,"5min":1.339,"15min":1.339},"last":0.998},{"interface":"front","average":{"1min":1.105,"5min":1.1459999999999999,"15min":1.1759999999999999},"min":{"1min":0.88600000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.5449999999999999,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.0269999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.2130000000000001,"15min":1.256},"min":{"1min":0.83499999999999996,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3959999999999999,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.05,"5min":1.0900000000000001,"15min":1.1060000000000001},"min":{"1min":0.93000000000000005,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":1.351,"5min":1.427,"15min":1.427},"last":0.91000000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.1459999999999999,"15min":1.1659999999999999},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.3009999999999999,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.085},{"interface":"front","average":{"1min":1.202,"5min":1.222,"15min":1.244},"min":{"1min":0.996,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.6259999999999999,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.169}]}]},{"osd":2,"up_from":14,"seq":60129542190,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297852,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073988,"statfs":{"total":96636764160,"available":96331763712,"internally_reserved":0,"allocated":503808,"data_stored":208823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:07 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64000000000000001,"15min":0.63200000000000001},"min":{"1min":0.51600000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.71999999999999997,"15min":0.69599999999999995},"min":{"1min":0.57399999999999995,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.92700000000000005,"5min":1.129,"15min":1.129},"last":0.69299999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:29:12 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.71299999999999997,"15min":0.70499999999999996},"min":{"1min":0.51800000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.73799999999999999,"15min":0.70299999999999996},"min":{"1min":0.59899999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.171,"5min":1.21,"15min":1.21},"last":0.61099999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:29:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68000000000000005,"15min":0.65700000000000003},"min":{"1min":0.53400000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89900000000000002,"5min":1.25,"15min":1.25},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.86399999999999999,"15min":0.83999999999999997},"min":{"1min":0.63400000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.3120000000000001,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.92900000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:29:12 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.02,"15min":1.0149999999999999},"min":{"1min":0.75600000000000001,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.423,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.01},{"interface":"front","average":{"1min":0.96099999999999997,"5min":1.0129999999999999,"15min":1.02},"min":{"1min":0.73499999999999999,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.254,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.89800000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:29:12 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.004,"15min":1.0089999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.2769999999999999,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.294},{"interface":"front","average":{"1min":1.097,"5min":1.0880000000000001,"15min":1.0840000000000001},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.484,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.2629999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:29:12 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0880000000000001,"15min":1.1020000000000001},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.359,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.0840000000000001,"15min":1.0740000000000001},"min":{"1min":0.86099999999999999,"5min":0.749,"15min":0.749},"max":{"1min":1.377,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.2450000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:29:12 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.165,"15min":1.1739999999999999},"min":{"1min":0.86599999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.292,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.1559999999999999,"15min":1.1479999999999999},"min":{"1min":0.99199999999999999,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":1.177}]}]},{"osd":0,"up_from":14,"seq":60129542190,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298432,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073408,"statfs":{"total":96636764160,"available":96331169792,"internally_reserved":0,"allocated":1097728,"data_stored":799191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64600000000000002,"15min":0.64700000000000002},"min":{"1min":0.48399999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.74299999999999999,"15min":0.71499999999999997},"min":{"1min":0.65300000000000002,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.53200000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.65900000000000003,"15min":0.65200000000000002},"min":{"1min":0.504,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80000000000000004,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76400000000000001,"15min":0.75},"min":{"1min":0.56799999999999995,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.018,"5min":1.123,"15min":1.123},"last":0.628}]},{"osd":3,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.86099999999999999,"15min":0.82399999999999995},"min":{"1min":0.77900000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1819999999999999,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.79700000000000004,"15min":0.76700000000000002},"min":{"1min":0.60399999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.98499999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.96099999999999997,"15min":0.96699999999999997},"min":{"1min":0.69299999999999995,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0800000000000001,"5min":1.601,"15min":1.601},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.097,"15min":1.113},"min":{"1min":0.84099999999999997,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.4410000000000001,"5min":1.571,"15min":1.571},"last":1.0329999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.96299999999999997,"15min":0.97699999999999998},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.071,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.1040000000000001,"15min":1.117},"min":{"1min":0.76300000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.0529999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.0840000000000001,"15min":1.0740000000000001},"min":{"1min":0.89700000000000002,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.077,"15min":1.0880000000000001},"min":{"1min":0.82899999999999996,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.171,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.446}]},{"osd":7,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.1339999999999999,"15min":1.111},"min":{"1min":0.94999999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.103,"15min":1.0940000000000001},"min":{"1min":0.82999999999999996,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.2989999999999999,"5min":1.518,"15min":1.518},"last":1.3879999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:29:28.285 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:29:28.286 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:29:28.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.389+0000 7f453bfff700 1 Processor -- start 2024-08-17T02:29:28.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.389+0000 7f453bfff700 1 -- start start 2024-08-17T02:29:28.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.389+0000 7f453bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f453c140870 0x7f453c0b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:28.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.389+0000 7f453bfff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f453c140c40 0x7f453c0b3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:28.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.389+0000 7f453bfff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f453c0b2fd0 con 0x7f453c06ba60 2024-08-17T02:29:28.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.389+0000 7f453bfff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f453c0b23c0 con 0x7f453c140870 2024-08-17T02:29:28.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.389+0000 7f453bfff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f453c0b26a0 con 0x7f453c140c40 2024-08-17T02:29:28.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.389+0000 7f453affd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f453c140870 0x7f453c0b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:28.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.389+0000 7f453b7fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f453c06ba60 0x7f453c06cbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:49842/0 (socket says 172.21.15.153:49842) 2024-08-17T02:29:28.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.389+0000 7f453b7fe700 1 -- 172.21.15.153:0/1996524516 learned_addr learned my addr 172.21.15.153:0/1996524516 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:29:28.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.389+0000 7f453a7fc700 1 --2- 172.21.15.153:0/1996524516 >> v2:172.21.15.174:3300/0 conn(0x7f453c140c40 0x7f453c0b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:28.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.389+0000 7f4539ffb700 1 -- 172.21.15.153:0/1996524516 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1255309356 0 0) 0x7f453c0b2fd0 con 0x7f453c06ba60 2024-08-17T02:29:28.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.389+0000 7f4539ffb700 1 -- 172.21.15.153:0/1996524516 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4524003570 con 0x7f453c06ba60 2024-08-17T02:29:28.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.389+0000 7f453affd700 1 -- 172.21.15.153:0/1996524516 >> v2:172.21.15.174:3300/0 conn(0x7f453c140c40 msgr2=0x7f453c0b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:28.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.389+0000 7f453affd700 1 --2- 172.21.15.153:0/1996524516 >> v2:172.21.15.174:3300/0 conn(0x7f453c140c40 0x7f453c0b3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.389+0000 7f453affd700 1 -- 172.21.15.153:0/1996524516 >> v1:172.21.15.153:6789/0 conn(0x7f453c06ba60 legacy=0x7f453c06cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:28.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.389+0000 7f453affd700 1 -- 172.21.15.153:0/1996524516 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453c0b2980 con 0x7f453c140870 2024-08-17T02:29:28.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.389+0000 7f453affd700 1 --2- 172.21.15.153:0/1996524516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f453c140870 0x7f453c0b1de0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f453c0cde00 tx=0x7f45300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56e969a390889382 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:28.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.393+0000 7f4539ffb700 1 -- 172.21.15.153:0/1996524516 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4530011630 con 0x7f453c140870 2024-08-17T02:29:28.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.393+0000 7f4539ffb700 1 -- 172.21.15.153:0/1996524516 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45300117b0 con 0x7f453c140870 2024-08-17T02:29:28.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.393+0000 7f4539ffb700 1 -- 172.21.15.153:0/1996524516 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4530011b70 con 0x7f453c140870 2024-08-17T02:29:28.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.393+0000 7f453bfff700 1 -- 172.21.15.153:0/1996524516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f453c140870 msgr2=0x7f453c0b1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:28.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.393+0000 7f453bfff700 1 --2- 172.21.15.153:0/1996524516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f453c140870 0x7f453c0b1de0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f453c0cde00 tx=0x7f45300091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.393+0000 7f453bfff700 1 -- 172.21.15.153:0/1996524516 shutdown_connections 2024-08-17T02:29:28.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.393+0000 7f453bfff700 1 --2- 172.21.15.153:0/1996524516 >> v2:172.21.15.174:3300/0 conn(0x7f453c140c40 0x7f453c0b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.393+0000 7f453bfff700 1 --2- 172.21.15.153:0/1996524516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f453c140870 0x7f453c0b1de0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.393+0000 7f453bfff700 1 -- 172.21.15.153:0/1996524516 >> 172.21.15.153:0/1996524516 conn(0x7f453c0ad930 msgr2=0x7f453c0afd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:28.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.393+0000 7f453bfff700 1 -- 172.21.15.153:0/1996524516 shutdown_connections 2024-08-17T02:29:28.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.393+0000 7f453bfff700 1 -- 172.21.15.153:0/1996524516 wait complete. 2024-08-17T02:29:28.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.397+0000 7f453bfff700 1 Processor -- start 2024-08-17T02:29:28.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.397+0000 7f453bfff700 1 -- start start 2024-08-17T02:29:28.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.397+0000 7f453bfff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f453c06ba60 0x7f453c13c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:28.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.397+0000 7f453bfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f453c140870 0x7f453c13c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:28.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.397+0000 7f453bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f453c140c40 0x7f453c139740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:28.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.397+0000 7f453bfff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453c156310 con 0x7f453c140c40 2024-08-17T02:29:28.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.397+0000 7f453bfff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453c158970 con 0x7f453c06ba60 2024-08-17T02:29:28.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.397+0000 7f453bfff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f453c138f80 con 0x7f453c140870 2024-08-17T02:29:28.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.397+0000 7f453b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f453c140c40 0x7f453c139740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:28.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.397+0000 7f453b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f453c140c40 0x7f453c139740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40674/0 (socket says 172.21.15.153:40674) 2024-08-17T02:29:28.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.397+0000 7f453b7fe700 1 -- 172.21.15.153:0/2060313087 learned_addr learned my addr 172.21.15.153:0/2060313087 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:28.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.397+0000 7f453affd700 1 --2- 172.21.15.153:0/2060313087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f453c06ba60 0x7f453c13c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:28.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.397+0000 7f453a7fc700 1 --2- 172.21.15.153:0/2060313087 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f453c140870 0x7f453c13c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:28.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.397+0000 7f453b7fe700 1 -- 172.21.15.153:0/2060313087 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f453c140870 msgr2=0x7f453c13c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:28.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.397+0000 7f453b7fe700 1 --2- 172.21.15.153:0/2060313087 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f453c140870 0x7f453c13c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.397+0000 7f453b7fe700 1 -- 172.21.15.153:0/2060313087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f453c06ba60 msgr2=0x7f453c13c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:28.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.397+0000 7f453b7fe700 1 --2- 172.21.15.153:0/2060313087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f453c06ba60 0x7f453c13c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.397+0000 7f453b7fe700 1 -- 172.21.15.153:0/2060313087 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4530009420 con 0x7f453c140c40 2024-08-17T02:29:28.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.397+0000 7f453b7fe700 1 --2- 172.21.15.153:0/2060313087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f453c140c40 0x7f453c139740 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4534001460 tx=0x7f4534001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:28.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.401+0000 7f4522ffd700 1 -- 172.21.15.153:0/2060313087 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453400a870 con 0x7f453c140c40 2024-08-17T02:29:28.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.401+0000 7f4522ffd700 1 -- 172.21.15.153:0/2060313087 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453400a9d0 con 0x7f453c140c40 2024-08-17T02:29:28.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.401+0000 7f453bfff700 1 -- 172.21.15.153:0/2060313087 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f453c157da0 con 0x7f453c140c40 2024-08-17T02:29:28.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.401+0000 7f4522ffd700 1 -- 172.21.15.153:0/2060313087 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453400ad50 con 0x7f453c140c40 2024-08-17T02:29:28.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.401+0000 7f453bfff700 1 -- 172.21.15.153:0/2060313087 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f453c158320 con 0x7f453c140c40 2024-08-17T02:29:28.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.401+0000 7f4522ffd700 1 -- 172.21.15.153:0/2060313087 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4534007300 con 0x7f453c140c40 2024-08-17T02:29:28.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.401+0000 7f453bfff700 1 -- 172.21.15.153:0/2060313087 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f453c0aef70 con 0x7f453c140c40 2024-08-17T02:29:28.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.401+0000 7f4522ffd700 1 --2- 172.21.15.153:0/2060313087 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4528060860 0x7f4528062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:28.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.401+0000 7f4522ffd700 1 -- 172.21.15.153:0/2060313087 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f453407cc80 con 0x7f453c140c40 2024-08-17T02:29:28.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.401+0000 7f453affd700 1 --2- 172.21.15.153:0/2060313087 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4528060860 0x7f4528062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:28.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.401+0000 7f453affd700 1 --2- 172.21.15.153:0/2060313087 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4528060860 0x7f4528062d10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f453c0cde00 tx=0x7f4530017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:28.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.413+0000 7f4522ffd700 1 -- 172.21.15.153:0/2060313087 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f453c0aef70 con 0x7f453c140c40 2024-08-17T02:29:28.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.573+0000 7f453bfff700 1 -- 172.21.15.153:0/2060313087 --> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f453c0aef70 con 0x7f4528060860 2024-08-17T02:29:28.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.577+0000 7f4522ffd700 1 -- 172.21.15.153:0/2060313087 <== mgr.4104 v2:172.21.15.153:6832/24147 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49194 (secure 0 0 0) 0x7f453c0aef70 con 0x7f4528060860 2024-08-17T02:29:28.581 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:29:28.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.581+0000 7f453bfff700 1 -- 172.21.15.153:0/2060313087 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4528060860 msgr2=0x7f4528062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:28.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.581+0000 7f453bfff700 1 --2- 172.21.15.153:0/2060313087 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4528060860 0x7f4528062d10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f453c0cde00 tx=0x7f4530017000 comp rx=0 tx=0).stop 2024-08-17T02:29:28.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.581+0000 7f453bfff700 1 -- 172.21.15.153:0/2060313087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f453c140c40 msgr2=0x7f453c139740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:28.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.581+0000 7f453bfff700 1 --2- 172.21.15.153:0/2060313087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f453c140c40 0x7f453c139740 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4534001460 tx=0x7f4534001a40 comp rx=0 tx=0).stop 2024-08-17T02:29:28.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.581+0000 7f453bfff700 1 -- 172.21.15.153:0/2060313087 shutdown_connections 2024-08-17T02:29:28.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.581+0000 7f453bfff700 1 --2- 172.21.15.153:0/2060313087 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4528060860 0x7f4528062d10 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.581+0000 7f453bfff700 1 --2- 172.21.15.153:0/2060313087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f453c140c40 0x7f453c139740 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.581+0000 7f453bfff700 1 --2- 172.21.15.153:0/2060313087 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f453c140870 0x7f453c13c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.581+0000 7f453bfff700 1 --2- 172.21.15.153:0/2060313087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f453c06ba60 0x7f453c13c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.581+0000 7f453bfff700 1 -- 172.21.15.153:0/2060313087 >> 172.21.15.153:0/2060313087 conn(0x7f453c0ad930 msgr2=0x7f453c0adfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:28.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.581+0000 7f453bfff700 1 -- 172.21.15.153:0/2060313087 shutdown_connections 2024-08-17T02:29:28.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.581+0000 7f453bfff700 1 -- 172.21.15.153:0/2060313087 wait complete. 2024-08-17T02:29:28.585 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-08-17T02:29:28.598 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-08-17T02:29:28.112972+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2392124,"kb_used_data":4948,"kb_used_omap":13,"kb_used_meta":2387058,"kb_avail":752582596,"statfs":{"total":773094113280,"available":770644578304,"internally_reserved":0,"allocated":5066752,"data_stored":2783762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2444348096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001761"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":181,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-08-17T02:29:19.846760+0000","last_change":"2024-08-17T02:26:00.033569+0000","last_active":"2024-08-17T02:29:19.846760+0000","last_peered":"2024-08-17T02:29:19.846760+0000","last_clean":"2024-08-17T02:29:19.846760+0000","last_became_active":"2024-08-17T02:26:00.031512+0000","last_became_peered":"2024-08-17T02:26:00.031512+0000","last_unstale":"2024-08-17T02:29:19.846760+0000","last_undegraded":"2024-08-17T02:29:19.846760+0000","last_fullsized":"2024-08-17T02:29:19.846760+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:58.643690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:58.643690+0000","last_clean_scrub_stamp":"2024-08-17T02:25:58.643690+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:47:24.121981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509485,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298400,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073440,"statfs":{"total":96636764160,"available":96331202560,"internally_reserved":0,"allocated":1069056,"data_stored":787510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:03 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.92500000000000004,"15min":0.94799999999999995},"min":{"1min":0.61299999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.052,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.83499999999999996,"15min":0.80900000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1599999999999999,"5min":1.165,"15min":1.165},"last":0.60799999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:29:03 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.84499999999999997,"15min":0.83799999999999997},"min":{"1min":0.68600000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.012,"5min":1.268,"15min":1.268},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.90100000000000002,"15min":0.90500000000000003},"min":{"1min":0.64800000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.177,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.56799999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:29:03 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90100000000000002,"15min":0.90700000000000003},"min":{"1min":0.67900000000000005,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.103,"5min":1.357,"15min":1.357},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.94999999999999996,"15min":0.93999999999999995},"min":{"1min":0.72699999999999998,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.86299999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:29:03 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.878,"15min":0.873},"min":{"1min":0.67900000000000005,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.129,"5min":1.409,"15min":1.409},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.026,"5min":1.0840000000000001,"15min":1.1120000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.2410000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.96799999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:29:03 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.93899999999999995,"15min":0.95899999999999996},"min":{"1min":0.63900000000000001,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.147},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.05,"15min":1.0509999999999999},"min":{"1min":0.94399999999999995,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.262,"5min":1.522,"15min":1.522},"last":1.224}]},{"osd":5,"last update":"Sat Aug 17 02:29:03 2024","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.1220000000000001,"15min":1.1479999999999999},"min":{"1min":0.70999999999999996,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.294,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1020000000000001,"15min":1.0980000000000001},"min":{"1min":0.95599999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.998}]},{"osd":6,"last update":"Sat Aug 17 02:29:03 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1299999999999999,"15min":1.1339999999999999},"min":{"1min":0.84599999999999997,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.534,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.085},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.149,"15min":1.151},"min":{"1min":0.95099999999999996,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.3340000000000001,"5min":1.609,"15min":1.609},"last":1.1160000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509485,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297824,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074016,"statfs":{"total":96636764160,"available":96331792384,"internally_reserved":0,"allocated":479232,"data_stored":197712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.877,"15min":0.86599999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.93600000000000005,"15min":0.92600000000000005},"min":{"1min":0.67800000000000005,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.25,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.81699999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.89700000000000002,"15min":0.88400000000000001},"min":{"1min":0.65600000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.91800000000000004,"15min":0.93000000000000005},"min":{"1min":0.69199999999999995,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.288,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.70499999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.86899999999999999,"15min":0.86199999999999999},"min":{"1min":0.65900000000000003,"5min":0.623,"15min":0.623},"max":{"1min":0.998,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.999,"5min":0.96999999999999997,"15min":0.97599999999999998},"min":{"1min":0.77000000000000002,"5min":0.627,"15min":0.627},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":1.0229999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.91300000000000003,"15min":0.90100000000000002},"min":{"1min":0.77200000000000002,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.1379999999999999},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.97299999999999998,"15min":0.97999999999999998},"min":{"1min":0.79500000000000004,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.1890000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":1.181}]},{"osd":4,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.93400000000000005,"15min":0.93100000000000005},"min":{"1min":0.68200000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.3460000000000001,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.004,"5min":1.0680000000000001,"15min":1.0920000000000001},"min":{"1min":0.60099999999999998,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2749999999999999,"5min":1.472,"15min":1.472},"last":1.0580000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.99099999999999999,"15min":1.0069999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":1.292},{"interface":"front","average":{"1min":1.159,"5min":1.1439999999999999,"15min":1.1419999999999999},"min":{"1min":0.91200000000000003,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.4399999999999999,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.254}]},{"osd":7,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.163,"15min":1.1759999999999999},"min":{"1min":0.94699999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.3879999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":1.232},{"interface":"front","average":{"1min":1.115,"5min":1.194,"15min":1.2250000000000001},"min":{"1min":0.91000000000000003,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.367,"5min":1.766,"15min":1.766},"last":1.361}]}]},{"osd":5,"up_from":15,"seq":64424509484,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297820,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074020,"statfs":{"total":96636764160,"available":96331796480,"internally_reserved":0,"allocated":475136,"data_stored":197122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.85599999999999998,"15min":0.86599999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.88400000000000001,"15min":0.86099999999999999},"min":{"1min":0.69199999999999995,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1830000000000001,"5min":1.335,"15min":1.335},"last":0.61899999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.94099999999999995,"15min":0.97099999999999997},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.133,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.111,"5min":1.268,"15min":1.268},"last":0.98599999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.91400000000000003,"15min":0.91600000000000004},"min":{"1min":0.624,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.224,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.96299999999999997,"15min":0.98899999999999999},"min":{"1min":0.72199999999999998,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.083,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":1.0209999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.86799999999999999,"15min":0.83599999999999997},"min":{"1min":0.69399999999999995,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":1.073},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.018,"15min":1.008},"min":{"1min":0.78300000000000003,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.70499999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.92500000000000004,"15min":0.92700000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.131,"5min":1.335,"15min":1.335},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95299999999999996,"15min":0.95399999999999996},"min":{"1min":0.69499999999999995,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.252,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.73499999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.998,"15min":0.99199999999999999},"min":{"1min":0.80300000000000005,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.282,"5min":1.496,"15min":1.496},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1559999999999999,"15min":1.169},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.097}]},{"osd":7,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.0740000000000001,"15min":1.0780000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.4750000000000001,"5min":1.49,"15min":1.49},"last":0.875},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":1.427,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.95699999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509486,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297828,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074012,"statfs":{"total":96636764160,"available":96331788288,"internally_reserved":0,"allocated":483328,"data_stored":198604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:04 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.83799999999999997,"15min":0.81599999999999995},"min":{"1min":0.60799999999999998,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":1.1970000000000001},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.94599999999999995,"15min":0.93200000000000005},"min":{"1min":0.69199999999999995,"5min":0.625,"15min":0.625},"max":{"1min":1.1830000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.91500000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:29:04 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.94299999999999995,"15min":0.95599999999999996},"min":{"1min":0.68999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":1.286},{"interface":"front","average":{"1min":0.876,"5min":0.89100000000000001,"15min":0.88500000000000001},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1299999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.79000000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:29:04 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.83199999999999996,"15min":0.81499999999999995},"min":{"1min":0.66200000000000003,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96399999999999997,"15min":0.95999999999999996},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":1.4179999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:29:04 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.94399999999999995,"15min":0.92800000000000005},"min":{"1min":0.72799999999999998,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.2350000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.04},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.002,"15min":0.99399999999999999},"min":{"1min":0.80700000000000005,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2649999999999999,"5min":1.516,"15min":1.516},"last":1.1020000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:29:04 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.016,"15min":1.0329999999999999},"min":{"1min":0.70199999999999996,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.149},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0740000000000001,"15min":1.0960000000000001},"min":{"1min":0.66100000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.292,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.4530000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:29:04 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93500000000000005,"15min":0.94099999999999995},"min":{"1min":0.73699999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.139,"5min":1.1639999999999999,"15min":1.171},"min":{"1min":1.01,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.4590000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.5049999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:29:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1379999999999999,"15min":1.149},"min":{"1min":0.79000000000000004,"5min":0.629,"15min":0.629},"max":{"1min":1.3,"5min":1.758,"15min":1.758},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.099,"5min":1.105,"15min":1.107},"min":{"1min":0.84899999999999998,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.2729999999999999,"5min":1.28,"15min":1.28},"last":1.3899999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509485,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301988,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069852,"statfs":{"total":96636764160,"available":96327528448,"internally_reserved":0,"allocated":483328,"data_stored":197678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.69599999999999995,"15min":0.71599999999999997},"min":{"1min":0.48499999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.097,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.69699999999999995,"15min":0.68200000000000005},"min":{"1min":0.52200000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.006,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.60999999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.73199999999999998,"15min":0.73799999999999999},"min":{"1min":0.52300000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89400000000000002,"5min":1.798,"15min":1.798},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.59099999999999997,"5min":0.439,"15min":0.439},"max":{"1min":1.0249999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.64900000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.93999999999999995,"15min":1.002},"min":{"1min":0.63300000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0469999999999999,"5min":7.0899999999999999,"15min":7.0899999999999999},"last":0.748},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.89100000000000001,"15min":0.90700000000000003},"min":{"1min":0.68600000000000005,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.089,"5min":2.4409999999999998,"15min":2.4409999999999998},"last":0.80300000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.0369999999999999,"15min":1.0620000000000001},"min":{"1min":0.72999999999999998,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.2869999999999999,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.081,"5min":1.153,"15min":1.181},"min":{"1min":0.88400000000000001,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.3160000000000001,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.4359999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.044,"15min":1.0489999999999999},"min":{"1min":0.80600000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.171,"5min":1.929,"15min":1.929},"last":1.274},{"interface":"front","average":{"1min":1.087,"5min":1.101,"15min":1.107},"min":{"1min":0.76800000000000002,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.294,"5min":1.988,"15min":1.988},"last":1.1519999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0920000000000001,"15min":1.1240000000000001},"min":{"1min":0.83199999999999996,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.4259999999999999,"5min":2.04,"15min":2.04},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.083,"5min":1.1419999999999999,"15min":1.1639999999999999},"min":{"1min":0.90600000000000003,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.27,"5min":2.141,"15min":2.141},"last":1.379}]},{"osd":7,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.159,"15min":1.161},"min":{"1min":0.83599999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.52,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.145,"15min":1.1459999999999999},"min":{"1min":0.94399999999999995,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.48,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.0960000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509484,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301980,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069860,"statfs":{"total":96636764160,"available":96327536640,"internally_reserved":0,"allocated":475136,"data_stored":197122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.74099999999999999,"15min":0.77100000000000002},"min":{"1min":0.51400000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.94499999999999995,"5min":1.268,"15min":1.268},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.76200000000000001,"15min":0.76700000000000002},"min":{"1min":0.57199999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.98099999999999998,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.64800000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.73299999999999998,"15min":0.72499999999999998},"min":{"1min":0.57699999999999996,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.97399999999999998,"5min":1.01,"15min":1.01},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.82899999999999996,"15min":0.84099999999999997},"min":{"1min":0.60999999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.96099999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.86499999999999999,"15min":0.876},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.135,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.72299999999999998,"15min":0.70599999999999996},"min":{"1min":0.56799999999999995,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.69899999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":1.02,"15min":1.046},"min":{"1min":0.80000000000000004,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.1839999999999999,"5min":1.857,"15min":1.857},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.044,"5min":1.125,"15min":1.157},"min":{"1min":0.875,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.325,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":1.226}]},{"osd":5,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.97999999999999998,"15min":1.0009999999999999},"min":{"1min":0.753,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.254,"5min":1.339,"15min":1.339},"last":0.998},{"interface":"front","average":{"1min":1.105,"5min":1.1459999999999999,"15min":1.1759999999999999},"min":{"1min":0.88600000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.5449999999999999,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.0269999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.2130000000000001,"15min":1.256},"min":{"1min":0.83499999999999996,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3959999999999999,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.05,"5min":1.0900000000000001,"15min":1.1060000000000001},"min":{"1min":0.93000000000000005,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":1.351,"5min":1.427,"15min":1.427},"last":0.91000000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.1459999999999999,"15min":1.1659999999999999},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.3009999999999999,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.085},{"interface":"front","average":{"1min":1.202,"5min":1.222,"15min":1.244},"min":{"1min":0.996,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.6259999999999999,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.169}]}]},{"osd":2,"up_from":14,"seq":60129542190,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297852,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073988,"statfs":{"total":96636764160,"available":96331763712,"internally_reserved":0,"allocated":503808,"data_stored":208823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:07 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64000000000000001,"15min":0.63200000000000001},"min":{"1min":0.51600000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.71999999999999997,"15min":0.69599999999999995},"min":{"1min":0.57399999999999995,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.92700000000000005,"5min":1.129,"15min":1.129},"last":0.69299999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:29:12 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.71299999999999997,"15min":0.70499999999999996},"min":{"1min":0.51800000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.73799999999999999,"15min":0.70299999999999996},"min":{"1min":0.59899999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.171,"5min":1.21,"15min":1.21},"last":0.61099999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:29:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68000000000000005,"15min":0.65700000000000003},"min":{"1min":0.53400000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89900000000000002,"5min":1.25,"15min":1.25},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.86399999999999999,"15min":0.83999999999999997},"min":{"1min":0.63400000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.3120000000000001,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.92900000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:29:12 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.02,"15min":1.0149999999999999},"min":{"1min":0.75600000000000001,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.423,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.01},{"interface":"front","average":{"1min":0.96099999999999997,"5min":1.0129999999999999,"15min":1.02},"min":{"1min":0.73499999999999999,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.254,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.89800000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:29:12 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.004,"15min":1.0089999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.2769999999999999,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.294},{"interface":"front","average":{"1min":1.097,"5min":1.0880000000000001,"15min":1.0840000000000001},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.484,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.2629999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:29:12 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0880000000000001,"15min":1.1020000000000001},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.359,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.0840000000000001,"15min":1.0740000000000001},"min":{"1min":0.86099999999999999,"5min":0.749,"15min":0.749},"max":{"1min":1.377,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.2450000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:29:12 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.165,"15min":1.1739999999999999},"min":{"1min":0.86599999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.292,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.1559999999999999,"15min":1.1479999999999999},"min":{"1min":0.99199999999999999,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":1.177}]}]},{"osd":0,"up_from":14,"seq":60129542190,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298432,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073408,"statfs":{"total":96636764160,"available":96331169792,"internally_reserved":0,"allocated":1097728,"data_stored":799191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64600000000000002,"15min":0.64700000000000002},"min":{"1min":0.48399999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.74299999999999999,"15min":0.71499999999999997},"min":{"1min":0.65300000000000002,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.53200000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.65900000000000003,"15min":0.65200000000000002},"min":{"1min":0.504,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80000000000000004,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76400000000000001,"15min":0.75},"min":{"1min":0.56799999999999995,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.018,"5min":1.123,"15min":1.123},"last":0.628}]},{"osd":3,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.86099999999999999,"15min":0.82399999999999995},"min":{"1min":0.77900000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1819999999999999,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.79700000000000004,"15min":0.76700000000000002},"min":{"1min":0.60399999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.98499999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.96099999999999997,"15min":0.96699999999999997},"min":{"1min":0.69299999999999995,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0800000000000001,"5min":1.601,"15min":1.601},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.097,"15min":1.113},"min":{"1min":0.84099999999999997,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.4410000000000001,"5min":1.571,"15min":1.571},"last":1.0329999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.96299999999999997,"15min":0.97699999999999998},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.071,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.1040000000000001,"15min":1.117},"min":{"1min":0.76300000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.0529999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.0840000000000001,"15min":1.0740000000000001},"min":{"1min":0.89700000000000002,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.077,"15min":1.0880000000000001},"min":{"1min":0.82899999999999996,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.171,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.446}]},{"osd":7,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.1339999999999999,"15min":1.111},"min":{"1min":0.94999999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.103,"15min":1.0940000000000001},"min":{"1min":0.82999999999999996,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.2989999999999999,"5min":1.518,"15min":1.518},"last":1.3879999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:29:28.599 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:28.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.697+0000 7f3496268700 1 Processor -- start 2024-08-17T02:29:28.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.697+0000 7f3496268700 1 -- start start 2024-08-17T02:29:28.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.697+0000 7f3496268700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f34900aac50 0x7f349015aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:28.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.697+0000 7f3496268700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34900b3b30 0x7f34900b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:28.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.697+0000 7f3496268700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34900b4490 con 0x7f349015a2e0 2024-08-17T02:29:28.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.697+0000 7f3496268700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f349015bc90 con 0x7f34900aac50 2024-08-17T02:29:28.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.697+0000 7f3496268700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349015b010 con 0x7f34900b3b30 2024-08-17T02:29:28.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.697+0000 7f348ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f34900aac50 0x7f349015aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:28.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.697+0000 7f348ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f34900aac50 0x7f349015aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40678/0 (socket says 172.21.15.153:40678) 2024-08-17T02:29:28.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.697+0000 7f348ffff700 1 -- 172.21.15.153:0/2112573475 learned_addr learned my addr 172.21.15.153:0/2112573475 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:28.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.697+0000 7f3494805700 1 --2- 172.21.15.153:0/2112573475 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34900b3b30 0x7f34900b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:28.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.697+0000 7f348ffff700 1 -- 172.21.15.153:0/2112573475 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34900b3b30 msgr2=0x7f34900b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:28.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.697+0000 7f348ffff700 1 --2- 172.21.15.153:0/2112573475 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34900b3b30 0x7f34900b3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.697+0000 7f348ffff700 1 -- 172.21.15.153:0/2112573475 >> v1:172.21.15.174:6789/0 conn(0x7f349015a2e0 legacy=0x7f34901574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:28.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.697+0000 7f348ffff700 1 -- 172.21.15.153:0/2112573475 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349015b2f0 con 0x7f34900aac50 2024-08-17T02:29:28.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.697+0000 7f348ffff700 1 --2- 172.21.15.153:0/2112573475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34900aac50 0x7f349015aa30 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3480009990 tx=0x7f3480009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff46e67512742d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:28.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.701+0000 7f348effd700 1 -- 172.21.15.153:0/2112573475 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3480009e80 con 0x7f34900aac50 2024-08-17T02:29:28.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.701+0000 7f348effd700 1 -- 172.21.15.153:0/2112573475 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3480005c10 con 0x7f34900aac50 2024-08-17T02:29:28.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.701+0000 7f348effd700 1 -- 172.21.15.153:0/2112573475 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348000b650 con 0x7f34900aac50 2024-08-17T02:29:28.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.701+0000 7f3496268700 1 -- 172.21.15.153:0/2112573475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34900aac50 msgr2=0x7f349015aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:28.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.701+0000 7f3496268700 1 --2- 172.21.15.153:0/2112573475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34900aac50 0x7f349015aa30 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3480009990 tx=0x7f3480009220 comp rx=0 tx=0).stop 2024-08-17T02:29:28.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.701+0000 7f3496268700 1 -- 172.21.15.153:0/2112573475 shutdown_connections 2024-08-17T02:29:28.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.701+0000 7f3496268700 1 --2- 172.21.15.153:0/2112573475 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34900b3b30 0x7f34900b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.701+0000 7f3496268700 1 --2- 172.21.15.153:0/2112573475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34900aac50 0x7f349015aa30 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.701+0000 7f3496268700 1 -- 172.21.15.153:0/2112573475 >> 172.21.15.153:0/2112573475 conn(0x7f34900994d0 msgr2=0x7f34900675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:28.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.701+0000 7f3496268700 1 -- 172.21.15.153:0/2112573475 shutdown_connections 2024-08-17T02:29:28.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.701+0000 7f3496268700 1 -- 172.21.15.153:0/2112573475 wait complete. 2024-08-17T02:29:28.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.701+0000 7f3496268700 1 Processor -- start 2024-08-17T02:29:28.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.701+0000 7f3496268700 1 -- start start 2024-08-17T02:29:28.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.701+0000 7f3496268700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34900aac50 0x7f34900ab9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:28.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.701+0000 7f3496268700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34900b3b30 0x7f349015faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:28.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.701+0000 7f3496268700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f349015a2e0 0x7f3490152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:28.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.701+0000 7f3496268700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3490160030 con 0x7f34900b3b30 2024-08-17T02:29:28.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.701+0000 7f3496268700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34900ac0c0 con 0x7f34900aac50 2024-08-17T02:29:28.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.701+0000 7f3496268700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34900ac3a0 con 0x7f349015a2e0 2024-08-17T02:29:28.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.701+0000 7f348f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34900b3b30 0x7f349015faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:28.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.701+0000 7f348f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34900b3b30 0x7f349015faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40692/0 (socket says 172.21.15.153:40692) 2024-08-17T02:29:28.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.701+0000 7f348f7fe700 1 -- 172.21.15.153:0/1416440413 learned_addr learned my addr 172.21.15.153:0/1416440413 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:28.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.701+0000 7f348ffff700 1 --2- 172.21.15.153:0/1416440413 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34900aac50 0x7f34900ab9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:28.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.701+0000 7f3494805700 1 --2- 172.21.15.153:0/1416440413 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f349015a2e0 0x7f3490152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:28.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.701+0000 7f348f7fe700 1 -- 172.21.15.153:0/1416440413 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f349015a2e0 msgr2=0x7f3490152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:28.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.701+0000 7f348f7fe700 1 --2- 172.21.15.153:0/1416440413 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f349015a2e0 0x7f3490152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.701+0000 7f348f7fe700 1 -- 172.21.15.153:0/1416440413 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34900aac50 msgr2=0x7f34900ab9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:28.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.701+0000 7f348f7fe700 1 --2- 172.21.15.153:0/1416440413 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34900aac50 0x7f34900ab9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.701+0000 7f348f7fe700 1 -- 172.21.15.153:0/1416440413 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3480009480 con 0x7f34900b3b30 2024-08-17T02:29:28.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.705+0000 7f348f7fe700 1 --2- 172.21.15.153:0/1416440413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34900b3b30 0x7f349015faf0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f347800c910 tx=0x7f34780016b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:28.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.705+0000 7f3487fff700 1 -- 172.21.15.153:0/1416440413 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347800ce50 con 0x7f34900b3b30 2024-08-17T02:29:28.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.705+0000 7f3487fff700 1 -- 172.21.15.153:0/1416440413 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f347800a7e0 con 0x7f34900b3b30 2024-08-17T02:29:28.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.705+0000 7f3496268700 1 -- 172.21.15.153:0/1416440413 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34900ac680 con 0x7f34900b3b30 2024-08-17T02:29:28.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.705+0000 7f3487fff700 1 -- 172.21.15.153:0/1416440413 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347800aba0 con 0x7f34900b3b30 2024-08-17T02:29:28.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.705+0000 7f3496268700 1 -- 172.21.15.153:0/1416440413 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34900acc40 con 0x7f34900b3b30 2024-08-17T02:29:28.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.705+0000 7f3496268700 1 -- 172.21.15.153:0/1416440413 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34900645c0 con 0x7f34900b3b30 2024-08-17T02:29:28.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.705+0000 7f3487fff700 1 -- 172.21.15.153:0/1416440413 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f3478003030 con 0x7f34900b3b30 2024-08-17T02:29:28.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.705+0000 7f3487fff700 1 --2- 172.21.15.153:0/1416440413 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f34740608e0 0x7f3474062d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:28.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.705+0000 7f348ffff700 1 --2- 172.21.15.153:0/1416440413 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f34740608e0 0x7f3474062d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:28.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.709+0000 7f3487fff700 1 -- 172.21.15.153:0/1416440413 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f347807c990 con 0x7f34900b3b30 2024-08-17T02:29:28.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.709+0000 7f348ffff700 1 --2- 172.21.15.153:0/1416440413 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f34740608e0 0x7f3474062d90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f34900b1680 tx=0x7f3480016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:28.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.713+0000 7f3487fff700 1 -- 172.21.15.153:0/1416440413 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f347804cfe0 con 0x7f34900b3b30 2024-08-17T02:29:28.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.877+0000 7f3496268700 1 -- 172.21.15.153:0/1416440413 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f349009dae0 con 0x7f34900b3b30 2024-08-17T02:29:28.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.881+0000 7f3487fff700 1 -- 172.21.15.153:0/1416440413 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+12445 (secure 0 0 0) 0x7f3478050600 con 0x7f34900b3b30 2024-08-17T02:29:28.883 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:29:28.884 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":43,"fsid":"56d41c33-b929-456d-96be-2aac4ecd299d","created":"2024-08-17T02:25:47.756085+0000","modified":"2024-08-17T02:29:25.539132+0000","last_up_change":"2024-08-17T02:25:58.643690+0000","last_in_change":"2024-08-17T02:25:49.809186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:58.093273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"0736f8e6-818e-42e6-a0dc-8aaf813315d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":24234},{"type":"v1","addr":"172.21.15.153:6817","nonce":24234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":24234},{"type":"v1","addr":"172.21.15.153:6819","nonce":24234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":24234},{"type":"v1","addr":"172.21.15.153:6823","nonce":24234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":24234},{"type":"v1","addr":"172.21.15.153:6821","nonce":24234}]},"public_addr":"172.21.15.153:6817/24234","cluster_addr":"172.21.15.153:6819/24234","heartbeat_back_addr":"172.21.15.153:6823/24234","heartbeat_front_addr":"172.21.15.153:6821/24234","state":["exists","up"]},{"osd":1,"uuid":"011762e9-6c2d-441a-aa56-68474639d72f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":24232},{"type":"v1","addr":"172.21.15.153:6801","nonce":24232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":24232},{"type":"v1","addr":"172.21.15.153:6803","nonce":24232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":24232},{"type":"v1","addr":"172.21.15.153:6809","nonce":24232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":24232},{"type":"v1","addr":"172.21.15.153:6806","nonce":24232}]},"public_addr":"172.21.15.153:6801/24232","cluster_addr":"172.21.15.153:6803/24232","heartbeat_back_addr":"172.21.15.153:6809/24232","heartbeat_front_addr":"172.21.15.153:6806/24232","state":["exists","up"]},{"osd":2,"uuid":"b562cd97-aa12-455e-b46a-e720a2ec9d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":24235},{"type":"v1","addr":"172.21.15.153:6808","nonce":24235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":24235},{"type":"v1","addr":"172.21.15.153:6811","nonce":24235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":24235},{"type":"v1","addr":"172.21.15.153:6815","nonce":24235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":24235},{"type":"v1","addr":"172.21.15.153:6813","nonce":24235}]},"public_addr":"172.21.15.153:6808/24235","cluster_addr":"172.21.15.153:6811/24235","heartbeat_back_addr":"172.21.15.153:6815/24235","heartbeat_front_addr":"172.21.15.153:6813/24235","state":["exists","up"]},{"osd":3,"uuid":"222da52f-90c2-4132-a5d2-6f6cf83d4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":24236},{"type":"v1","addr":"172.21.15.153:6825","nonce":24236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":24236},{"type":"v1","addr":"172.21.15.153:6827","nonce":24236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":24236},{"type":"v1","addr":"172.21.15.153:6831","nonce":24236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":24236},{"type":"v1","addr":"172.21.15.153:6829","nonce":24236}]},"public_addr":"172.21.15.153:6825/24236","cluster_addr":"172.21.15.153:6827/24236","heartbeat_back_addr":"172.21.15.153:6831/24236","heartbeat_front_addr":"172.21.15.153:6829/24236","state":["exists","up"]},{"osd":4,"uuid":"a38a04cd-032b-4977-a260-1ef3567d0c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24456},{"type":"v1","addr":"172.21.15.174:6809","nonce":24456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24456},{"type":"v1","addr":"172.21.15.174:6811","nonce":24456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24456},{"type":"v1","addr":"172.21.15.174:6815","nonce":24456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24456},{"type":"v1","addr":"172.21.15.174:6813","nonce":24456}]},"public_addr":"172.21.15.174:6809/24456","cluster_addr":"172.21.15.174:6811/24456","heartbeat_back_addr":"172.21.15.174:6815/24456","heartbeat_front_addr":"172.21.15.174:6813/24456","state":["exists","up"]},{"osd":5,"uuid":"c7778084-e751-48da-87a1-ab8bbe85aa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24457},{"type":"v1","addr":"172.21.15.174:6825","nonce":24457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24457},{"type":"v1","addr":"172.21.15.174:6827","nonce":24457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24457},{"type":"v1","addr":"172.21.15.174:6831","nonce":24457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24457},{"type":"v1","addr":"172.21.15.174:6829","nonce":24457}]},"public_addr":"172.21.15.174:6825/24457","cluster_addr":"172.21.15.174:6827/24457","heartbeat_back_addr":"172.21.15.174:6831/24457","heartbeat_front_addr":"172.21.15.174:6829/24457","state":["exists","up"]},{"osd":6,"uuid":"2d8e0715-254f-442c-9625-50721d0bc858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24477},{"type":"v1","addr":"172.21.15.174:6801","nonce":24477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24477},{"type":"v1","addr":"172.21.15.174:6803","nonce":24477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24477},{"type":"v1","addr":"172.21.15.174:6807","nonce":24477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24477},{"type":"v1","addr":"172.21.15.174:6805","nonce":24477}]},"public_addr":"172.21.15.174:6801/24477","cluster_addr":"172.21.15.174:6803/24477","heartbeat_back_addr":"172.21.15.174:6807/24477","heartbeat_front_addr":"172.21.15.174:6805/24477","state":["exists","up"]},{"osd":7,"uuid":"dffda25a-4601-4ddb-9a27-b0be1cadde27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24455},{"type":"v1","addr":"172.21.15.174:6817","nonce":24455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24455},{"type":"v1","addr":"172.21.15.174:6819","nonce":24455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24455},{"type":"v1","addr":"172.21.15.174:6823","nonce":24455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24455},{"type":"v1","addr":"172.21.15.174:6821","nonce":24455}]},"public_addr":"172.21.15.174:6817/24455","cluster_addr":"172.21.15.174:6819/24455","heartbeat_back_addr":"172.21.15.174:6823/24455","heartbeat_front_addr":"172.21.15.174:6821/24455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.990117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.033862+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:54.748087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.112877+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.070448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.360961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.110940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:55.226377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.153:6835/2569513399":"2024-08-18T02:29:22.524575+0000","172.21.15.153:6834/2569513399":"2024-08-18T02:29:22.524575+0000","172.21.15.153:6837/2567193475":"2024-08-18T02:29:16.167908+0000","172.21.15.153:6836/2567193475":"2024-08-18T02:29:16.167908+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:28.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.881+0000 7f3496268700 1 -- 172.21.15.153:0/1416440413 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f34740608e0 msgr2=0x7f3474062d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:28.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.881+0000 7f3496268700 1 --2- 172.21.15.153:0/1416440413 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f34740608e0 0x7f3474062d90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f34900b1680 tx=0x7f3480016000 comp rx=0 tx=0).stop 2024-08-17T02:29:28.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.881+0000 7f3496268700 1 -- 172.21.15.153:0/1416440413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34900b3b30 msgr2=0x7f349015faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:28.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.881+0000 7f3496268700 1 --2- 172.21.15.153:0/1416440413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34900b3b30 0x7f349015faf0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f347800c910 tx=0x7f34780016b0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.881+0000 7f3496268700 1 -- 172.21.15.153:0/1416440413 shutdown_connections 2024-08-17T02:29:28.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.881+0000 7f3496268700 1 --2- 172.21.15.153:0/1416440413 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f34740608e0 0x7f3474062d90 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.881+0000 7f3496268700 1 --2- 172.21.15.153:0/1416440413 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f349015a2e0 0x7f3490152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.881+0000 7f3496268700 1 --2- 172.21.15.153:0/1416440413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34900b3b30 0x7f349015faf0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.881+0000 7f3496268700 1 --2- 172.21.15.153:0/1416440413 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34900aac50 0x7f34900ab9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.881+0000 7f3496268700 1 -- 172.21.15.153:0/1416440413 >> 172.21.15.153:0/1416440413 conn(0x7f34900994d0 msgr2=0x7f349015a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:28.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.881+0000 7f3496268700 1 -- 172.21.15.153:0/1416440413 shutdown_connections 2024-08-17T02:29:28.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:28.881+0000 7f3496268700 1 -- 172.21.15.153:0/1416440413 wait complete. 2024-08-17T02:29:29.642 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:29.645 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:29.898 INFO:tasks.ceph:Scrubbing osd.0 2024-08-17T02:29:29.899 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:29:30.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.017+0000 7f8d39c78700 1 Processor -- start 2024-08-17T02:29:30.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.017+0000 7f8d39c78700 1 -- start start 2024-08-17T02:29:30.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.017+0000 7f8d39c78700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8d34159430 0x7f8d340ae020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.017+0000 7f8d39c78700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8d34159880 0x7f8d340ae560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.017+0000 7f8d39c78700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d3415a640 con 0x7f8d34159060 2024-08-17T02:29:30.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.017+0000 7f8d39c78700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d34159da0 con 0x7f8d34159880 2024-08-17T02:29:30.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.017+0000 7f8d39c78700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3415a080 con 0x7f8d34159430 2024-08-17T02:29:30.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.017+0000 7f8d39477700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8d34159880 0x7f8d340ae560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.017+0000 7f8d38c76700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f8d34159060 0x7f8d340af280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:49848/0 (socket says 172.21.15.153:49848) 2024-08-17T02:29:30.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.017+0000 7f8d38c76700 1 -- 172.21.15.153:0/1409373656 learned_addr learned my addr 172.21.15.153:0/1409373656 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:29:30.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.017+0000 7f8d33fff700 1 --2- 172.21.15.153:0/1409373656 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8d34159430 0x7f8d340ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.017+0000 7f8d337fe700 1 -- 172.21.15.153:0/1409373656 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2515268481 0 0) 0x7f8d3415a640 con 0x7f8d34159060 2024-08-17T02:29:30.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.021+0000 7f8d337fe700 1 -- 172.21.15.153:0/1409373656 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d20003570 con 0x7f8d34159060 2024-08-17T02:29:30.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.021+0000 7f8d39477700 1 -- 172.21.15.153:0/1409373656 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8d34159430 msgr2=0x7f8d340ae020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:30.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.021+0000 7f8d39477700 1 --2- 172.21.15.153:0/1409373656 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8d34159430 0x7f8d340ae020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.021+0000 7f8d39477700 1 -- 172.21.15.153:0/1409373656 >> v1:172.21.15.153:6789/0 conn(0x7f8d34159060 legacy=0x7f8d340af280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.021+0000 7f8d39477700 1 -- 172.21.15.153:0/1409373656 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d3415a360 con 0x7f8d34159880 2024-08-17T02:29:30.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.021+0000 7f8d33fff700 1 --2- 172.21.15.153:0/1409373656 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8d34159430 0x7f8d340ae020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:30.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.021+0000 7f8d39477700 1 --2- 172.21.15.153:0/1409373656 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d34159880 0x7f8d340ae560 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c0098e0 tx=0x7f8d2c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8625d84624d443f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:30.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.021+0000 7f8d337fe700 1 -- 172.21.15.153:0/1409373656 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c00b640 con 0x7f8d34159880 2024-08-17T02:29:30.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.021+0000 7f8d337fe700 1 -- 172.21.15.153:0/1409373656 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d2c00b7a0 con 0x7f8d34159880 2024-08-17T02:29:30.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.021+0000 7f8d337fe700 1 -- 172.21.15.153:0/1409373656 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c00bb40 con 0x7f8d34159880 2024-08-17T02:29:30.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.021+0000 7f8d39c78700 1 -- 172.21.15.153:0/1409373656 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d34159880 msgr2=0x7f8d340ae560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.021+0000 7f8d39c78700 1 --2- 172.21.15.153:0/1409373656 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d34159880 0x7f8d340ae560 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c0098e0 tx=0x7f8d2c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.021+0000 7f8d39c78700 1 -- 172.21.15.153:0/1409373656 shutdown_connections 2024-08-17T02:29:30.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.021+0000 7f8d39c78700 1 --2- 172.21.15.153:0/1409373656 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d34159880 0x7f8d340ae560 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.021+0000 7f8d39c78700 1 --2- 172.21.15.153:0/1409373656 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8d34159430 0x7f8d340ae020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.021+0000 7f8d39c78700 1 -- 172.21.15.153:0/1409373656 >> 172.21.15.153:0/1409373656 conn(0x7f8d340a9d30 msgr2=0x7f8d340ac900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:30.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.021+0000 7f8d39c78700 1 -- 172.21.15.153:0/1409373656 shutdown_connections 2024-08-17T02:29:30.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.021+0000 7f8d39c78700 1 -- 172.21.15.153:0/1409373656 wait complete. 2024-08-17T02:29:30.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.021+0000 7f8d39c78700 1 Processor -- start 2024-08-17T02:29:30.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.021+0000 7f8d39c78700 1 -- start start 2024-08-17T02:29:30.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.021+0000 7f8d39c78700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d34159060 0x7f8d341539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.021+0000 7f8d39c78700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d34159430 0x7f8d3406b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.021+0000 7f8d39c78700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8d34159880 0x7f8d34155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.021+0000 7f8d39c78700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3406afd0 con 0x7f8d34159060 2024-08-17T02:29:30.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.021+0000 7f8d39c78700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3406a3c0 con 0x7f8d34159430 2024-08-17T02:29:30.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.021+0000 7f8d39c78700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3406a6a0 con 0x7f8d34159880 2024-08-17T02:29:30.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.021+0000 7f8d38c76700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d34159060 0x7f8d341539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.021+0000 7f8d38c76700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d34159060 0x7f8d341539e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40702/0 (socket says 172.21.15.153:40702) 2024-08-17T02:29:30.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.021+0000 7f8d38c76700 1 -- 172.21.15.153:0/2412511874 learned_addr learned my addr 172.21.15.153:0/2412511874 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:30.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.021+0000 7f8d39477700 1 --2- 172.21.15.153:0/2412511874 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8d34159880 0x7f8d34155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.021+0000 7f8d33fff700 1 --2- 172.21.15.153:0/2412511874 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d34159430 0x7f8d3406b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.025+0000 7f8d38c76700 1 -- 172.21.15.153:0/2412511874 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8d34159880 msgr2=0x7f8d34155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.025+0000 7f8d38c76700 1 --2- 172.21.15.153:0/2412511874 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8d34159880 0x7f8d34155ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.025+0000 7f8d38c76700 1 -- 172.21.15.153:0/2412511874 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d34159430 msgr2=0x7f8d3406b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.025+0000 7f8d38c76700 1 --2- 172.21.15.153:0/2412511874 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d34159430 0x7f8d3406b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.025+0000 7f8d38c76700 1 -- 172.21.15.153:0/2412511874 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d2c009420 con 0x7f8d34159060 2024-08-17T02:29:30.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.025+0000 7f8d39477700 1 --2- 172.21.15.153:0/2412511874 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8d34159880 0x7f8d34155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:30.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.025+0000 7f8d38c76700 1 --2- 172.21.15.153:0/2412511874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d34159060 0x7f8d341539e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8d2400cd30 tx=0x7f8d24001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:30.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.025+0000 7f8d30ff9700 1 -- 172.21.15.153:0/2412511874 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2400ab70 con 0x7f8d34159060 2024-08-17T02:29:30.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.025+0000 7f8d30ff9700 1 -- 172.21.15.153:0/2412511874 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d2400acf0 con 0x7f8d34159060 2024-08-17T02:29:30.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.025+0000 7f8d39c78700 1 -- 172.21.15.153:0/2412511874 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d3406a980 con 0x7f8d34159060 2024-08-17T02:29:30.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.025+0000 7f8d30ff9700 1 -- 172.21.15.153:0/2412511874 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d24007340 con 0x7f8d34159060 2024-08-17T02:29:30.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.025+0000 7f8d39c78700 1 -- 172.21.15.153:0/2412511874 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d34153f20 con 0x7f8d34159060 2024-08-17T02:29:30.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.025+0000 7f8d39c78700 1 -- 172.21.15.153:0/2412511874 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8d340644b0 con 0x7f8d34159060 2024-08-17T02:29:30.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.025+0000 7f8d30ff9700 1 -- 172.21.15.153:0/2412511874 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8d24007730 con 0x7f8d34159060 2024-08-17T02:29:30.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.025+0000 7f8d30ff9700 1 --2- 172.21.15.153:0/2412511874 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8d14060890 0x7f8d14062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.025+0000 7f8d30ff9700 1 -- 172.21.15.153:0/2412511874 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f8d2407d8a0 con 0x7f8d34159060 2024-08-17T02:29:30.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.025+0000 7f8d33fff700 1 --2- 172.21.15.153:0/2412511874 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8d14060890 0x7f8d14062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.025+0000 7f8d30ff9700 1 --2- 172.21.15.153:0/2412511874 >> [v2:172.21.15.153:6816/24234,v1:172.21.15.153:6817/24234] conn(0x7f8d14066780 0x7f8d14068b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.025+0000 7f8d30ff9700 1 -- 172.21.15.153:0/2412511874 --> [v2:172.21.15.153:6816/24234,v1:172.21.15.153:6817/24234] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8d14069240 con 0x7f8d14066780 2024-08-17T02:29:30.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.025+0000 7f8d30ff9700 1 -- 172.21.15.153:0/2412511874 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d2407dc70 con 0x7f8d34159060 2024-08-17T02:29:30.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.025+0000 7f8d39477700 1 --2- 172.21.15.153:0/2412511874 >> [v2:172.21.15.153:6816/24234,v1:172.21.15.153:6817/24234] conn(0x7f8d14066780 0x7f8d14068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.029+0000 7f8d33fff700 1 --2- 172.21.15.153:0/2412511874 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8d14060890 0x7f8d14062d40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c006f00 tx=0x7f8d1c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:30.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.029+0000 7f8d39477700 1 --2- 172.21.15.153:0/2412511874 >> [v2:172.21.15.153:6816/24234,v1:172.21.15.153:6817/24234] conn(0x7f8d14066780 0x7f8d14068b90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:30.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.029+0000 7f8d30ff9700 1 -- 172.21.15.153:0/2412511874 <== osd.0 v2:172.21.15.153:6816/24234 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f8d14069240 con 0x7f8d14066780 2024-08-17T02:29:30.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.045+0000 7f8d39c78700 1 -- 172.21.15.153:0/2412511874 --> [v2:172.21.15.153:6816/24234,v1:172.21.15.153:6817/24234] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8d340aec30 con 0x7f8d14066780 2024-08-17T02:29:30.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.049+0000 7f8d30ff9700 1 -- 172.21.15.153:0/2412511874 <== osd.0 v2:172.21.15.153:6816/24234 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f8d340aec30 con 0x7f8d14066780 2024-08-17T02:29:30.051 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-08-17T02:29:30.051 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:29:30.051 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-08-17T02:29:30.052 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.049+0000 7f8d39c78700 1 -- 172.21.15.153:0/2412511874 >> [v2:172.21.15.153:6816/24234,v1:172.21.15.153:6817/24234] conn(0x7f8d14066780 msgr2=0x7f8d14068b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.052 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.049+0000 7f8d39c78700 1 --2- 172.21.15.153:0/2412511874 >> [v2:172.21.15.153:6816/24234,v1:172.21.15.153:6817/24234] conn(0x7f8d14066780 0x7f8d14068b90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.052 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.049+0000 7f8d39c78700 1 -- 172.21.15.153:0/2412511874 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8d14060890 msgr2=0x7f8d14062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.052 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.049+0000 7f8d39c78700 1 --2- 172.21.15.153:0/2412511874 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f8d14060890 0x7f8d14062d40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c006f00 tx=0x7f8d1c008040 comp rx=0 tx=0).stop 2024-08-17T02:29:30.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.049+0000 7f8d39c78700 1 -- 172.21.15.153:0/2412511874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d34159060 msgr2=0x7f8d341539e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.049+0000 7f8d39c78700 1 --2- 172.21.15.153:0/2412511874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d34159060 0x7f8d341539e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8d2400cd30 tx=0x7f8d24001b10 comp rx=0 tx=0).stop 2024-08-17T02:29:30.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.049+0000 7f8d39477700 1 -- 172.21.15.153:0/2412511874 reap_dead start 2024-08-17T02:29:30.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.049+0000 7f8d39c78700 1 -- 172.21.15.153:0/2412511874 shutdown_connections 2024-08-17T02:29:30.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.049+0000 7f8d39c78700 1 -- 172.21.15.153:0/2412511874 >> 172.21.15.153:0/2412511874 conn(0x7f8d340a9d30 msgr2=0x7f8d34152580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:30.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.049+0000 7f8d39c78700 1 -- 172.21.15.153:0/2412511874 shutdown_connections 2024-08-17T02:29:30.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.049+0000 7f8d39c78700 1 -- 172.21.15.153:0/2412511874 wait complete. 2024-08-17T02:29:30.064 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-08-17T02:29:30.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.173+0000 7f9f66cd8700 1 Processor -- start 2024-08-17T02:29:30.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.173+0000 7f9f66cd8700 1 -- start start 2024-08-17T02:29:30.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.173+0000 7f9f66cd8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f60159040 0x7f9f600cf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.173+0000 7f9f66cd8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9f6015d5b0 0x7f9f600d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.173+0000 7f9f66cd8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f600cf190 con 0x7f9f600d0010 2024-08-17T02:29:30.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.173+0000 7f9f66cd8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f600d09a0 con 0x7f9f6015d5b0 2024-08-17T02:29:30.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.173+0000 7f9f66cd8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f600ce5e0 con 0x7f9f60159040 2024-08-17T02:29:30.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.177+0000 7f9f65cd6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f60159040 0x7f9f600cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.177+0000 7f9f664d7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9f6015d5b0 0x7f9f600d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.177+0000 7f9f654d5700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f9f600d0010 0x7f9f6015cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.153:48242/0 (socket says 172.21.15.153:48242) 2024-08-17T02:29:30.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.177+0000 7f9f654d5700 1 -- 172.21.15.153:0/1952586038 learned_addr learned my addr 172.21.15.153:0/1952586038 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:29:30.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.177+0000 7f9f664d7700 1 -- 172.21.15.153:0/1952586038 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f60159040 msgr2=0x7f9f600cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:30.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.177+0000 7f9f664d7700 1 --2- 172.21.15.153:0/1952586038 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f60159040 0x7f9f600cf620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.177+0000 7f9f664d7700 1 -- 172.21.15.153:0/1952586038 >> v1:172.21.15.174:6789/0 conn(0x7f9f600d0010 legacy=0x7f9f6015cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.177+0000 7f9f664d7700 1 -- 172.21.15.153:0/1952586038 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f600ce860 con 0x7f9f6015d5b0 2024-08-17T02:29:30.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.177+0000 7f9f65cd6700 1 --2- 172.21.15.153:0/1952586038 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f60159040 0x7f9f600cf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:30.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.177+0000 7f9f664d7700 1 --2- 172.21.15.153:0/1952586038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f6015d5b0 0x7f9f600d0460 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9f58009e60 tx=0x7f9f58009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f58c590acc262c30 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:30.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.177+0000 7f9f64cd4700 1 -- 172.21.15.153:0/1952586038 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5800e070 con 0x7f9f6015d5b0 2024-08-17T02:29:30.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.177+0000 7f9f64cd4700 1 -- 172.21.15.153:0/1952586038 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f5800bb60 con 0x7f9f6015d5b0 2024-08-17T02:29:30.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.177+0000 7f9f64cd4700 1 -- 172.21.15.153:0/1952586038 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f58012430 con 0x7f9f6015d5b0 2024-08-17T02:29:30.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.177+0000 7f9f66cd8700 1 -- 172.21.15.153:0/1952586038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f6015d5b0 msgr2=0x7f9f600d0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.177+0000 7f9f66cd8700 1 --2- 172.21.15.153:0/1952586038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f6015d5b0 0x7f9f600d0460 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9f58009e60 tx=0x7f9f58009780 comp rx=0 tx=0).stop 2024-08-17T02:29:30.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.177+0000 7f9f66cd8700 1 -- 172.21.15.153:0/1952586038 shutdown_connections 2024-08-17T02:29:30.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.177+0000 7f9f66cd8700 1 --2- 172.21.15.153:0/1952586038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f6015d5b0 0x7f9f600d0460 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.177+0000 7f9f66cd8700 1 --2- 172.21.15.153:0/1952586038 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f60159040 0x7f9f600cf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.177+0000 7f9f66cd8700 1 -- 172.21.15.153:0/1952586038 >> 172.21.15.153:0/1952586038 conn(0x7f9f60068250 msgr2=0x7f9f60068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:30.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.177+0000 7f9f66cd8700 1 -- 172.21.15.153:0/1952586038 shutdown_connections 2024-08-17T02:29:30.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.177+0000 7f9f66cd8700 1 -- 172.21.15.153:0/1952586038 wait complete. 2024-08-17T02:29:30.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.177+0000 7f9f66cd8700 1 Processor -- start 2024-08-17T02:29:30.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.177+0000 7f9f66cd8700 1 -- start start 2024-08-17T02:29:30.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.181+0000 7f9f66cd8700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f600d0010 0x7f9f60152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.181+0000 7f9f66cd8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f60159040 0x7f9f600b09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.181+0000 7f9f66cd8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f6015d5b0 0x7f9f600ae020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.181+0000 7f9f66cd8700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f60169490 con 0x7f9f60159040 2024-08-17T02:29:30.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.181+0000 7f9f66cd8700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f600b1f70 con 0x7f9f600d0010 2024-08-17T02:29:30.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.181+0000 7f9f66cd8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f600b2250 con 0x7f9f6015d5b0 2024-08-17T02:29:30.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.181+0000 7f9f654d5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f60159040 0x7f9f600b09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.181+0000 7f9f65cd6700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f600d0010 0x7f9f60152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.181+0000 7f9f654d5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f60159040 0x7f9f600b09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40712/0 (socket says 172.21.15.153:40712) 2024-08-17T02:29:30.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.181+0000 7f9f654d5700 1 -- 172.21.15.153:0/1718975140 learned_addr learned my addr 172.21.15.153:0/1718975140 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:30.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.181+0000 7f9f664d7700 1 --2- 172.21.15.153:0/1718975140 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f6015d5b0 0x7f9f600ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.181+0000 7f9f654d5700 1 -- 172.21.15.153:0/1718975140 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f6015d5b0 msgr2=0x7f9f600ae020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.181+0000 7f9f654d5700 1 --2- 172.21.15.153:0/1718975140 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f6015d5b0 0x7f9f600ae020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.181+0000 7f9f654d5700 1 -- 172.21.15.153:0/1718975140 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f600d0010 msgr2=0x7f9f60152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.181+0000 7f9f654d5700 1 --2- 172.21.15.153:0/1718975140 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f600d0010 0x7f9f60152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.181+0000 7f9f654d5700 1 -- 172.21.15.153:0/1718975140 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f54009420 con 0x7f9f60159040 2024-08-17T02:29:30.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.181+0000 7f9f664d7700 1 --2- 172.21.15.153:0/1718975140 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f6015d5b0 0x7f9f600ae020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:30.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.181+0000 7f9f654d5700 1 --2- 172.21.15.153:0/1718975140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f60159040 0x7f9f600b09f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c00c7c0 tx=0x7f9f5c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:30.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.181+0000 7f9f51ffb700 1 -- 172.21.15.153:0/1718975140 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c005b30 con 0x7f9f60159040 2024-08-17T02:29:30.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.181+0000 7f9f51ffb700 1 -- 172.21.15.153:0/1718975140 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f5c005c90 con 0x7f9f60159040 2024-08-17T02:29:30.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.181+0000 7f9f66cd8700 1 -- 172.21.15.153:0/1718975140 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f58009a20 con 0x7f9f60159040 2024-08-17T02:29:30.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.181+0000 7f9f51ffb700 1 -- 172.21.15.153:0/1718975140 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c004a80 con 0x7f9f60159040 2024-08-17T02:29:30.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.181+0000 7f9f66cd8700 1 -- 172.21.15.153:0/1718975140 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f600b2810 con 0x7f9f60159040 2024-08-17T02:29:30.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.185+0000 7f9f66cd8700 1 -- 172.21.15.153:0/1718975140 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f60169600 con 0x7f9f60159040 2024-08-17T02:29:30.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.185+0000 7f9f51ffb700 1 -- 172.21.15.153:0/1718975140 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9f5c0070d0 con 0x7f9f60159040 2024-08-17T02:29:30.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.185+0000 7f9f51ffb700 1 --2- 172.21.15.153:0/1718975140 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9f44060860 0x7f9f44062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.185+0000 7f9f51ffb700 1 -- 172.21.15.153:0/1718975140 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f9f5c07bbf0 con 0x7f9f60159040 2024-08-17T02:29:30.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.185+0000 7f9f65cd6700 1 --2- 172.21.15.153:0/1718975140 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9f44060860 0x7f9f44062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.185+0000 7f9f65cd6700 1 --2- 172.21.15.153:0/1718975140 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9f44060860 0x7f9f44062d10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9f601579f0 tx=0x7f9f540091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:30.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.193+0000 7f9f51ffb700 1 -- 172.21.15.153:0/1718975140 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f9f5c04a480 con 0x7f9f60159040 2024-08-17T02:29:30.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.357+0000 7f9f66cd8700 1 -- 172.21.15.153:0/1718975140 --> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f600643a0 con 0x7f9f44060860 2024-08-17T02:29:30.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.357+0000 7f9f51ffb700 1 -- 172.21.15.153:0/1718975140 <== mgr.4104 v2:172.21.15.153:6832/24147 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9f600643a0 con 0x7f9f44060860 2024-08-17T02:29:30.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.361+0000 7f9f66cd8700 1 -- 172.21.15.153:0/1718975140 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9f44060860 msgr2=0x7f9f44062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.361+0000 7f9f66cd8700 1 --2- 172.21.15.153:0/1718975140 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9f44060860 0x7f9f44062d10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9f601579f0 tx=0x7f9f540091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.361+0000 7f9f66cd8700 1 -- 172.21.15.153:0/1718975140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f60159040 msgr2=0x7f9f600b09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.361+0000 7f9f66cd8700 1 --2- 172.21.15.153:0/1718975140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f60159040 0x7f9f600b09f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c00c7c0 tx=0x7f9f5c007f70 comp rx=0 tx=0).stop 2024-08-17T02:29:30.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.361+0000 7f9f66cd8700 1 -- 172.21.15.153:0/1718975140 shutdown_connections 2024-08-17T02:29:30.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.361+0000 7f9f66cd8700 1 --2- 172.21.15.153:0/1718975140 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f9f44060860 0x7f9f44062d10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.361+0000 7f9f66cd8700 1 --2- 172.21.15.153:0/1718975140 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f6015d5b0 0x7f9f600ae020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.361+0000 7f9f66cd8700 1 --2- 172.21.15.153:0/1718975140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f60159040 0x7f9f600b09f0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.361+0000 7f9f66cd8700 1 --2- 172.21.15.153:0/1718975140 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f600d0010 0x7f9f60152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.361+0000 7f9f66cd8700 1 -- 172.21.15.153:0/1718975140 >> 172.21.15.153:0/1718975140 conn(0x7f9f60068250 msgr2=0x7f9f600b3910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:30.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.361+0000 7f9f66cd8700 1 -- 172.21.15.153:0/1718975140 shutdown_connections 2024-08-17T02:29:30.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.361+0000 7f9f66cd8700 1 -- 172.21.15.153:0/1718975140 wait complete. 2024-08-17T02:29:30.365 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 0 to deep-scrub 2024-08-17T02:29:30.375 INFO:tasks.ceph:Scrubbing osd.1 2024-08-17T02:29:30.375 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:29:30.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.485+0000 7f1d5c6b7700 1 Processor -- start 2024-08-17T02:29:30.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.485+0000 7f1d5c6b7700 1 -- start start 2024-08-17T02:29:30.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.489+0000 7f1d5c6b7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1d540cd2b0 0x7f1d540cd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.489+0000 7f1d5c6b7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d540ceb70 0x7f1d54162ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.489+0000 7f1d5c6b7700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d540cc480 con 0x7f1d540caeb0 2024-08-17T02:29:30.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.489+0000 7f1d5c6b7700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d54159720 con 0x7f1d540cd2b0 2024-08-17T02:29:30.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.489+0000 7f1d5c6b7700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d540cb870 con 0x7f1d540ceb70 2024-08-17T02:29:30.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.489+0000 7f1d5ac54700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d540ceb70 0x7f1d54162ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.489+0000 7f1d5ac54700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d540ceb70 0x7f1d54162ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.153:50986/0 (socket says 172.21.15.153:50986) 2024-08-17T02:29:30.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.489+0000 7f1d5ac54700 1 -- 172.21.15.153:0/1323578941 learned_addr learned my addr 172.21.15.153:0/1323578941 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:30.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.489+0000 7f1d5a453700 1 --2- 172.21.15.153:0/1323578941 >> v2:172.21.15.174:3300/0 conn(0x7f1d540cd2b0 0x7f1d540cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.489+0000 7f1d5ac54700 1 -- 172.21.15.153:0/1323578941 >> v2:172.21.15.174:3300/0 conn(0x7f1d540cd2b0 msgr2=0x7f1d540cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:30.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.489+0000 7f1d5ac54700 1 --2- 172.21.15.153:0/1323578941 >> v2:172.21.15.174:3300/0 conn(0x7f1d540cd2b0 0x7f1d540cd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.489+0000 7f1d5ac54700 1 -- 172.21.15.153:0/1323578941 >> v1:172.21.15.174:6789/0 conn(0x7f1d540caeb0 legacy=0x7f1d540ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.489+0000 7f1d59451700 1 -- 172.21.15.153:0/1323578941 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3681332871 0 0) 0x7f1d540cc480 con 0x7f1d540caeb0 2024-08-17T02:29:30.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.489+0000 7f1d5ac54700 1 -- 172.21.15.153:0/1323578941 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d540cbb50 con 0x7f1d540ceb70 2024-08-17T02:29:30.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.489+0000 7f1d5ac54700 1 --2- 172.21.15.153:0/1323578941 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d540ceb70 0x7f1d54162ea0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c009f20 tx=0x7f1d4c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b123ae6d7695370b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:30.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.489+0000 7f1d59451700 1 -- 172.21.15.153:0/1323578941 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c00e070 con 0x7f1d540ceb70 2024-08-17T02:29:30.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.489+0000 7f1d59451700 1 -- 172.21.15.153:0/1323578941 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d4c00b9d0 con 0x7f1d540ceb70 2024-08-17T02:29:30.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.489+0000 7f1d59451700 1 -- 172.21.15.153:0/1323578941 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c0092e0 con 0x7f1d540ceb70 2024-08-17T02:29:30.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.489+0000 7f1d5c6b7700 1 -- 172.21.15.153:0/1323578941 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d540ceb70 msgr2=0x7f1d54162ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.489+0000 7f1d5c6b7700 1 --2- 172.21.15.153:0/1323578941 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d540ceb70 0x7f1d54162ea0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c009f20 tx=0x7f1d4c009840 comp rx=0 tx=0).stop 2024-08-17T02:29:30.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.489+0000 7f1d5c6b7700 1 -- 172.21.15.153:0/1323578941 shutdown_connections 2024-08-17T02:29:30.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.489+0000 7f1d5c6b7700 1 --2- 172.21.15.153:0/1323578941 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d540ceb70 0x7f1d54162ea0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.489+0000 7f1d5c6b7700 1 --2- 172.21.15.153:0/1323578941 >> v2:172.21.15.174:3300/0 conn(0x7f1d540cd2b0 0x7f1d540cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.489+0000 7f1d5c6b7700 1 -- 172.21.15.153:0/1323578941 >> 172.21.15.153:0/1323578941 conn(0x7f1d54099550 msgr2=0x7f1d54067590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:30.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.489+0000 7f1d5c6b7700 1 -- 172.21.15.153:0/1323578941 shutdown_connections 2024-08-17T02:29:30.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.489+0000 7f1d5c6b7700 1 -- 172.21.15.153:0/1323578941 wait complete. 2024-08-17T02:29:30.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.493+0000 7f1d5c6b7700 1 Processor -- start 2024-08-17T02:29:30.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.493+0000 7f1d5c6b7700 1 -- start start 2024-08-17T02:29:30.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.493+0000 7f1d5c6b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d540caeb0 0x7f1d54150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.493+0000 7f1d5c6b7700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d540cd2b0 0x7f1d540b2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.493+0000 7f1d5c6b7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d540ceb70 0x7f1d54156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.493+0000 7f1d5c6b7700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d54151fd0 con 0x7f1d540caeb0 2024-08-17T02:29:30.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.493+0000 7f1d5c6b7700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d540b3050 con 0x7f1d540cd2b0 2024-08-17T02:29:30.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.493+0000 7f1d5c6b7700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5416d020 con 0x7f1d540ceb70 2024-08-17T02:29:30.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.493+0000 7f1d5a453700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d540caeb0 0x7f1d54150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.493+0000 7f1d5a453700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d540caeb0 0x7f1d54150fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40722/0 (socket says 172.21.15.153:40722) 2024-08-17T02:29:30.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.493+0000 7f1d5ac54700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d540ceb70 0x7f1d54156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.493+0000 7f1d5a453700 1 -- 172.21.15.153:0/1928547497 learned_addr learned my addr 172.21.15.153:0/1928547497 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:30.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.493+0000 7f1d59c52700 1 --2- 172.21.15.153:0/1928547497 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d540cd2b0 0x7f1d540b2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.493+0000 7f1d5ac54700 1 -- 172.21.15.153:0/1928547497 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d540cd2b0 msgr2=0x7f1d540b2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.493+0000 7f1d5ac54700 1 --2- 172.21.15.153:0/1928547497 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d540cd2b0 0x7f1d540b2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.493+0000 7f1d5ac54700 1 -- 172.21.15.153:0/1928547497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d540caeb0 msgr2=0x7f1d54150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.493+0000 7f1d5ac54700 1 --2- 172.21.15.153:0/1928547497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d540caeb0 0x7f1d54150fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.493+0000 7f1d5ac54700 1 -- 172.21.15.153:0/1928547497 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d4c009ae0 con 0x7f1d540ceb70 2024-08-17T02:29:30.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.493+0000 7f1d5a453700 1 --2- 172.21.15.153:0/1928547497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d540caeb0 0x7f1d54150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:30.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.493+0000 7f1d5ac54700 1 --2- 172.21.15.153:0/1928547497 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d540ceb70 0x7f1d54156590 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c015000 tx=0x7f1d4c018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:30.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.497+0000 7f1d4a7fc700 1 -- 172.21.15.153:0/1928547497 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c007b00 con 0x7f1d540ceb70 2024-08-17T02:29:30.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.497+0000 7f1d4a7fc700 1 -- 172.21.15.153:0/1928547497 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d4c007ca0 con 0x7f1d540ceb70 2024-08-17T02:29:30.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.497+0000 7f1d5c6b7700 1 -- 172.21.15.153:0/1928547497 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d5416d300 con 0x7f1d540ceb70 2024-08-17T02:29:30.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.497+0000 7f1d4a7fc700 1 -- 172.21.15.153:0/1928547497 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c01e680 con 0x7f1d540ceb70 2024-08-17T02:29:30.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.497+0000 7f1d5c6b7700 1 -- 172.21.15.153:0/1928547497 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d5416d8c0 con 0x7f1d540ceb70 2024-08-17T02:29:30.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.497+0000 7f1d5c6b7700 1 -- 172.21.15.153:0/1928547497 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1d540638f0 con 0x7f1d540ceb70 2024-08-17T02:29:30.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.497+0000 7f1d4a7fc700 1 -- 172.21.15.153:0/1928547497 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1d4c003040 con 0x7f1d540ceb70 2024-08-17T02:29:30.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.497+0000 7f1d4a7fc700 1 --2- 172.21.15.153:0/1928547497 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1d38060860 0x7f1d38062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.497+0000 7f1d5a453700 1 --2- 172.21.15.153:0/1928547497 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1d38060860 0x7f1d38062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.497+0000 7f1d4a7fc700 1 -- 172.21.15.153:0/1928547497 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f1d4c07ebb0 con 0x7f1d540ceb70 2024-08-17T02:29:30.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.501+0000 7f1d4a7fc700 1 --2- 172.21.15.153:0/1928547497 >> [v2:172.21.15.153:6800/24232,v1:172.21.15.153:6801/24232] conn(0x7f1d38066750 0x7f1d38068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.501+0000 7f1d4a7fc700 1 -- 172.21.15.153:0/1928547497 --> [v2:172.21.15.153:6800/24232,v1:172.21.15.153:6801/24232] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1d38069210 con 0x7f1d38066750 2024-08-17T02:29:30.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.501+0000 7f1d4a7fc700 1 -- 172.21.15.153:0/1928547497 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d4c07ef80 con 0x7f1d540ceb70 2024-08-17T02:29:30.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.501+0000 7f1d59c52700 1 --2- 172.21.15.153:0/1928547497 >> [v2:172.21.15.153:6800/24232,v1:172.21.15.153:6801/24232] conn(0x7f1d38066750 0x7f1d38068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.501+0000 7f1d5a453700 1 --2- 172.21.15.153:0/1928547497 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1d38060860 0x7f1d38062d10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1d44009fd0 tx=0x7f1d440091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:30.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.501+0000 7f1d59c52700 1 --2- 172.21.15.153:0/1928547497 >> [v2:172.21.15.153:6800/24232,v1:172.21.15.153:6801/24232] conn(0x7f1d38066750 0x7f1d38068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:30.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.501+0000 7f1d4a7fc700 1 -- 172.21.15.153:0/1928547497 <== osd.1 v2:172.21.15.153:6800/24232 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f1d38069210 con 0x7f1d38066750 2024-08-17T02:29:30.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.517+0000 7f1d5c6b7700 1 -- 172.21.15.153:0/1928547497 --> [v2:172.21.15.153:6800/24232,v1:172.21.15.153:6801/24232] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1d540cb350 con 0x7f1d38066750 2024-08-17T02:29:30.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.517+0000 7f1d4a7fc700 1 -- 172.21.15.153:0/1928547497 <== osd.1 v2:172.21.15.153:6800/24232 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f1d540cb350 con 0x7f1d38066750 2024-08-17T02:29:30.522 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-08-17T02:29:30.522 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:29:30.522 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-08-17T02:29:30.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.517+0000 7f1d5c6b7700 1 -- 172.21.15.153:0/1928547497 >> [v2:172.21.15.153:6800/24232,v1:172.21.15.153:6801/24232] conn(0x7f1d38066750 msgr2=0x7f1d38068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.517+0000 7f1d5c6b7700 1 --2- 172.21.15.153:0/1928547497 >> [v2:172.21.15.153:6800/24232,v1:172.21.15.153:6801/24232] conn(0x7f1d38066750 0x7f1d38068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.517+0000 7f1d5c6b7700 1 -- 172.21.15.153:0/1928547497 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1d38060860 msgr2=0x7f1d38062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.517+0000 7f1d5c6b7700 1 --2- 172.21.15.153:0/1928547497 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f1d38060860 0x7f1d38062d10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1d44009fd0 tx=0x7f1d440091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.517+0000 7f1d5c6b7700 1 -- 172.21.15.153:0/1928547497 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d540ceb70 msgr2=0x7f1d54156590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.517+0000 7f1d5c6b7700 1 --2- 172.21.15.153:0/1928547497 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d540ceb70 0x7f1d54156590 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c015000 tx=0x7f1d4c018000 comp rx=0 tx=0).stop 2024-08-17T02:29:30.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.517+0000 7f1d5ac54700 1 -- 172.21.15.153:0/1928547497 reap_dead start 2024-08-17T02:29:30.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.517+0000 7f1d5c6b7700 1 -- 172.21.15.153:0/1928547497 shutdown_connections 2024-08-17T02:29:30.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.517+0000 7f1d5c6b7700 1 -- 172.21.15.153:0/1928547497 >> 172.21.15.153:0/1928547497 conn(0x7f1d54099550 msgr2=0x7f1d540c5150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:30.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.517+0000 7f1d5c6b7700 1 -- 172.21.15.153:0/1928547497 shutdown_connections 2024-08-17T02:29:30.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.517+0000 7f1d5c6b7700 1 -- 172.21.15.153:0/1928547497 wait complete. 2024-08-17T02:29:30.533 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-08-17T02:29:30.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.641+0000 7f687d02c700 1 Processor -- start 2024-08-17T02:29:30.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.641+0000 7f687d02c700 1 -- start start 2024-08-17T02:29:30.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.641+0000 7f687d02c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f68780c4270 0x7f68780c8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.641+0000 7f687d02c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6878158240 0x7f68780ca1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.641+0000 7f687d02c700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68780ca930 con 0x7f6878157760 2024-08-17T02:29:30.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.641+0000 7f687d02c700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68780c8cd0 con 0x7f68780c4270 2024-08-17T02:29:30.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.641+0000 7f687d02c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68780c2e10 con 0x7f6878158240 2024-08-17T02:29:30.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.641+0000 7f687659c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f68780c4270 0x7f68780c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.641+0000 7f6876d9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f6878157760 0x7f6878157b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:49860/0 (socket says 172.21.15.153:49860) 2024-08-17T02:29:30.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.641+0000 7f6876d9d700 1 -- 172.21.15.153:0/1140770312 learned_addr learned my addr 172.21.15.153:0/1140770312 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:29:30.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.641+0000 7f687759e700 1 --2- 172.21.15.153:0/1140770312 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6878158240 0x7f68780ca1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.645+0000 7f687659c700 1 -- 172.21.15.153:0/1140770312 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6878158240 msgr2=0x7f68780ca1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:30.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.645+0000 7f687659c700 1 --2- 172.21.15.153:0/1140770312 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6878158240 0x7f68780ca1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.645+0000 7f687659c700 1 -- 172.21.15.153:0/1140770312 >> v1:172.21.15.153:6789/0 conn(0x7f6878157760 legacy=0x7f6878157b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.645+0000 7f687659c700 1 -- 172.21.15.153:0/1140770312 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68780ca6e0 con 0x7f68780c4270 2024-08-17T02:29:30.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.645+0000 7f6875d9b700 1 -- 172.21.15.153:0/1140770312 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3690430884 0 0) 0x7f68780ca930 con 0x7f6878157760 2024-08-17T02:29:30.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.645+0000 7f687659c700 1 --2- 172.21.15.153:0/1140770312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68780c4270 0x7f68780c8790 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f68600098e0 tx=0x7f68600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f00813c78491b81 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:30.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.645+0000 7f6875d9b700 1 -- 172.21.15.153:0/1140770312 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686000b640 con 0x7f68780c4270 2024-08-17T02:29:30.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.645+0000 7f6875d9b700 1 -- 172.21.15.153:0/1140770312 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686000b7a0 con 0x7f68780c4270 2024-08-17T02:29:30.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.645+0000 7f6875d9b700 1 -- 172.21.15.153:0/1140770312 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686000bb40 con 0x7f68780c4270 2024-08-17T02:29:30.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.645+0000 7f687d02c700 1 -- 172.21.15.153:0/1140770312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68780c4270 msgr2=0x7f68780c8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.645+0000 7f687d02c700 1 --2- 172.21.15.153:0/1140770312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68780c4270 0x7f68780c8790 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f68600098e0 tx=0x7f68600091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.645+0000 7f687d02c700 1 -- 172.21.15.153:0/1140770312 shutdown_connections 2024-08-17T02:29:30.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.645+0000 7f687d02c700 1 --2- 172.21.15.153:0/1140770312 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6878158240 0x7f68780ca1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.645+0000 7f687d02c700 1 --2- 172.21.15.153:0/1140770312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68780c4270 0x7f68780c8790 secure :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f68600098e0 tx=0x7f68600091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.645+0000 7f687d02c700 1 -- 172.21.15.153:0/1140770312 >> 172.21.15.153:0/1140770312 conn(0x7f68780caae0 msgr2=0x7f68780caee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:30.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.645+0000 7f687d02c700 1 -- 172.21.15.153:0/1140770312 shutdown_connections 2024-08-17T02:29:30.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.645+0000 7f687d02c700 1 -- 172.21.15.153:0/1140770312 wait complete. 2024-08-17T02:29:30.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.649+0000 7f687d02c700 1 Processor -- start 2024-08-17T02:29:30.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.649+0000 7f687d02c700 1 -- start start 2024-08-17T02:29:30.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.649+0000 7f687d02c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6878157760 0x7f687814d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.649+0000 7f687d02c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6878158240 0x7f68780b27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.649+0000 7f687d02c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6878156530 0x7f68781569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.649+0000 7f687d02c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68780ac080 con 0x7f6878156530 2024-08-17T02:29:30.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.649+0000 7f687d02c700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6878156f10 con 0x7f6878158240 2024-08-17T02:29:30.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.649+0000 7f687d02c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f687814d670 con 0x7f6878157760 2024-08-17T02:29:30.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.649+0000 7f687759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6878156530 0x7f68781569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.649+0000 7f687759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6878156530 0x7f68781569d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40750/0 (socket says 172.21.15.153:40750) 2024-08-17T02:29:30.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.649+0000 7f687759e700 1 -- 172.21.15.153:0/3421446887 learned_addr learned my addr 172.21.15.153:0/3421446887 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:30.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.649+0000 7f687659c700 1 --2- 172.21.15.153:0/3421446887 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6878158240 0x7f68780b27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.649+0000 7f6876d9d700 1 --2- 172.21.15.153:0/3421446887 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6878157760 0x7f687814d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.649+0000 7f687759e700 1 -- 172.21.15.153:0/3421446887 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6878157760 msgr2=0x7f687814d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.649+0000 7f687759e700 1 --2- 172.21.15.153:0/3421446887 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6878157760 0x7f687814d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.649+0000 7f687759e700 1 -- 172.21.15.153:0/3421446887 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6878158240 msgr2=0x7f68780b27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.649+0000 7f687759e700 1 --2- 172.21.15.153:0/3421446887 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6878158240 0x7f68780b27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.649+0000 7f687759e700 1 -- 172.21.15.153:0/3421446887 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6860009420 con 0x7f6878156530 2024-08-17T02:29:30.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.649+0000 7f687759e700 1 --2- 172.21.15.153:0/3421446887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6878156530 0x7f68781569d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f6870009e90 tx=0x7f687000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:30.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.649+0000 7f686effd700 1 -- 172.21.15.153:0/3421446887 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687000cb10 con 0x7f6878156530 2024-08-17T02:29:30.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.649+0000 7f687d02c700 1 -- 172.21.15.153:0/3421446887 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68780abbf0 con 0x7f6878156530 2024-08-17T02:29:30.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.649+0000 7f686effd700 1 -- 172.21.15.153:0/3421446887 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f687000f040 con 0x7f6878156530 2024-08-17T02:29:30.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.649+0000 7f686effd700 1 -- 172.21.15.153:0/3421446887 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687000cee0 con 0x7f6878156530 2024-08-17T02:29:30.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.649+0000 7f687d02c700 1 -- 172.21.15.153:0/3421446887 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68780aafe0 con 0x7f6878156530 2024-08-17T02:29:30.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.653+0000 7f686effd700 1 -- 172.21.15.153:0/3421446887 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6870014690 con 0x7f6878156530 2024-08-17T02:29:30.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.653+0000 7f687d02c700 1 -- 172.21.15.153:0/3421446887 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68780abd80 con 0x7f6878156530 2024-08-17T02:29:30.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.653+0000 7f686effd700 1 --2- 172.21.15.153:0/3421446887 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f685c060860 0x7f685c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.653+0000 7f686effd700 1 -- 172.21.15.153:0/3421446887 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f687007d3d0 con 0x7f6878156530 2024-08-17T02:29:30.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.653+0000 7f6876d9d700 1 --2- 172.21.15.153:0/3421446887 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f685c060860 0x7f685c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.653+0000 7f6876d9d700 1 --2- 172.21.15.153:0/3421446887 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f685c060860 0x7f685c062d10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6868007160 tx=0x7f6868007f50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:30.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.661+0000 7f686effd700 1 -- 172.21.15.153:0/3421446887 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f68700514b0 con 0x7f6878156530 2024-08-17T02:29:30.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.825+0000 7f687d02c700 1 -- 172.21.15.153:0/3421446887 --> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f68780645c0 con 0x7f685c060860 2024-08-17T02:29:30.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.825+0000 7f686effd700 1 -- 172.21.15.153:0/3421446887 <== mgr.4104 v2:172.21.15.153:6832/24147 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f68780645c0 con 0x7f685c060860 2024-08-17T02:29:30.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.829+0000 7f687d02c700 1 -- 172.21.15.153:0/3421446887 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f685c060860 msgr2=0x7f685c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.829+0000 7f687d02c700 1 --2- 172.21.15.153:0/3421446887 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f685c060860 0x7f685c062d10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6868007160 tx=0x7f6868007f50 comp rx=0 tx=0).stop 2024-08-17T02:29:30.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.829+0000 7f687d02c700 1 -- 172.21.15.153:0/3421446887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6878156530 msgr2=0x7f68781569d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.829+0000 7f687d02c700 1 --2- 172.21.15.153:0/3421446887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6878156530 0x7f68781569d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f6870009e90 tx=0x7f687000b040 comp rx=0 tx=0).stop 2024-08-17T02:29:30.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.829+0000 7f687d02c700 1 -- 172.21.15.153:0/3421446887 shutdown_connections 2024-08-17T02:29:30.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.829+0000 7f687d02c700 1 --2- 172.21.15.153:0/3421446887 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f685c060860 0x7f685c062d10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.829+0000 7f687d02c700 1 --2- 172.21.15.153:0/3421446887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6878156530 0x7f68781569d0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.829+0000 7f687d02c700 1 --2- 172.21.15.153:0/3421446887 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6878158240 0x7f68780b27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.829+0000 7f687d02c700 1 --2- 172.21.15.153:0/3421446887 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6878157760 0x7f687814d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.829+0000 7f687d02c700 1 -- 172.21.15.153:0/3421446887 >> 172.21.15.153:0/3421446887 conn(0x7f68780caae0 msgr2=0x7f68780acd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:30.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.829+0000 7f687d02c700 1 -- 172.21.15.153:0/3421446887 shutdown_connections 2024-08-17T02:29:30.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.829+0000 7f687d02c700 1 -- 172.21.15.153:0/3421446887 wait complete. 2024-08-17T02:29:30.834 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 1 to deep-scrub 2024-08-17T02:29:30.844 INFO:tasks.ceph:Scrubbing osd.2 2024-08-17T02:29:30.844 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:29:30.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.953+0000 7fcb6f59e700 1 Processor -- start 2024-08-17T02:29:30.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.953+0000 7fcb6f59e700 1 -- start start 2024-08-17T02:29:30.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.957+0000 7fcb6f59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcb7013f7f0 0x7fcb700ab6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.957+0000 7fcb6f59e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcb7013fbc0 0x7fcb700c8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.957+0000 7fcb6f59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb700b0660 con 0x7fcb7006eac0 2024-08-17T02:29:30.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.957+0000 7fcb6f59e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb700abdc0 con 0x7fcb7013f7f0 2024-08-17T02:29:30.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.957+0000 7fcb6f59e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb700b0af0 con 0x7fcb7013fbc0 2024-08-17T02:29:30.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.957+0000 7fcb6ed9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fcb7006eac0 0x7fcb700aeb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:49864/0 (socket says 172.21.15.153:49864) 2024-08-17T02:29:30.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.957+0000 7fcb6ed9d700 1 -- 172.21.15.153:0/1440319949 learned_addr learned my addr 172.21.15.153:0/1440319949 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:29:30.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.957+0000 7fcb6e59c700 1 --2- 172.21.15.153:0/1440319949 >> v2:172.21.15.153:3300/0 conn(0x7fcb7013f7f0 0x7fcb700ab6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.957+0000 7fcb6dd9b700 1 --2- 172.21.15.153:0/1440319949 >> v2:172.21.15.174:3300/0 conn(0x7fcb7013fbc0 0x7fcb700c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.957+0000 7fcb6d59a700 1 -- 172.21.15.153:0/1440319949 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1796188038 0 0) 0x7fcb700b0660 con 0x7fcb7006eac0 2024-08-17T02:29:30.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.957+0000 7fcb6d59a700 1 -- 172.21.15.153:0/1440319949 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb50003570 con 0x7fcb7006eac0 2024-08-17T02:29:30.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.957+0000 7fcb6dd9b700 1 -- 172.21.15.153:0/1440319949 >> v2:172.21.15.153:3300/0 conn(0x7fcb7013f7f0 msgr2=0x7fcb700ab6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:30.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.957+0000 7fcb6dd9b700 1 --2- 172.21.15.153:0/1440319949 >> v2:172.21.15.153:3300/0 conn(0x7fcb7013f7f0 0x7fcb700ab6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.957+0000 7fcb6dd9b700 1 -- 172.21.15.153:0/1440319949 >> v1:172.21.15.153:6789/0 conn(0x7fcb7006eac0 legacy=0x7fcb700aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.957+0000 7fcb6dd9b700 1 -- 172.21.15.153:0/1440319949 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb700afd30 con 0x7fcb7013fbc0 2024-08-17T02:29:30.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.957+0000 7fcb6e59c700 1 --2- 172.21.15.153:0/1440319949 >> v2:172.21.15.153:3300/0 conn(0x7fcb7013f7f0 0x7fcb700ab6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:30.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.957+0000 7fcb6dd9b700 1 --2- 172.21.15.153:0/1440319949 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb7013fbc0 0x7fcb700c8010 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcb7006d0b0 tx=0x7fcb580091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1bc25aac7ac79ff server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:30.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.957+0000 7fcb6d59a700 1 -- 172.21.15.153:0/1440319949 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb58011630 con 0x7fcb7013fbc0 2024-08-17T02:29:30.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.957+0000 7fcb6d59a700 1 -- 172.21.15.153:0/1440319949 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb580117b0 con 0x7fcb7013fbc0 2024-08-17T02:29:30.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.957+0000 7fcb6d59a700 1 -- 172.21.15.153:0/1440319949 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb58011b70 con 0x7fcb7013fbc0 2024-08-17T02:29:30.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.957+0000 7fcb6f59e700 1 -- 172.21.15.153:0/1440319949 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb7013fbc0 msgr2=0x7fcb700c8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.957+0000 7fcb6f59e700 1 --2- 172.21.15.153:0/1440319949 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb7013fbc0 0x7fcb700c8010 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcb7006d0b0 tx=0x7fcb580091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.957+0000 7fcb6f59e700 1 -- 172.21.15.153:0/1440319949 shutdown_connections 2024-08-17T02:29:30.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.957+0000 7fcb6f59e700 1 --2- 172.21.15.153:0/1440319949 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb7013fbc0 0x7fcb700c8010 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.957+0000 7fcb6f59e700 1 --2- 172.21.15.153:0/1440319949 >> v2:172.21.15.153:3300/0 conn(0x7fcb7013f7f0 0x7fcb700ab6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.957+0000 7fcb6f59e700 1 -- 172.21.15.153:0/1440319949 >> 172.21.15.153:0/1440319949 conn(0x7fcb70066e00 msgr2=0x7fcb70067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:30.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.957+0000 7fcb6f59e700 1 -- 172.21.15.153:0/1440319949 shutdown_connections 2024-08-17T02:29:30.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.957+0000 7fcb6f59e700 1 -- 172.21.15.153:0/1440319949 wait complete. 2024-08-17T02:29:30.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.961+0000 7fcb6f59e700 1 Processor -- start 2024-08-17T02:29:30.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.961+0000 7fcb6f59e700 1 -- start start 2024-08-17T02:29:30.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.961+0000 7fcb6f59e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb7006eac0 0x7fcb700c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.961+0000 7fcb6f59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb7013f7f0 0x7fcb70153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.961+0000 7fcb6f59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb7013fbc0 0x7fcb7013d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.961+0000 7fcb6f59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb701539a0 con 0x7fcb7013f7f0 2024-08-17T02:29:30.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.961+0000 7fcb6f59e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb700c9700 con 0x7fcb7006eac0 2024-08-17T02:29:30.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.961+0000 7fcb6f59e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb700c99e0 con 0x7fcb7013fbc0 2024-08-17T02:29:30.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.961+0000 7fcb6dd9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb7013f7f0 0x7fcb70153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.961+0000 7fcb6dd9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb7013f7f0 0x7fcb70153460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40776/0 (socket says 172.21.15.153:40776) 2024-08-17T02:29:30.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.961+0000 7fcb6dd9b700 1 -- 172.21.15.153:0/2851065710 learned_addr learned my addr 172.21.15.153:0/2851065710 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:30.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.961+0000 7fcb6e59c700 1 --2- 172.21.15.153:0/2851065710 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb7006eac0 0x7fcb700c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.961+0000 7fcb6ed9d700 1 --2- 172.21.15.153:0/2851065710 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb7013fbc0 0x7fcb7013d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.961+0000 7fcb6dd9b700 1 -- 172.21.15.153:0/2851065710 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb7013fbc0 msgr2=0x7fcb7013d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.961+0000 7fcb6dd9b700 1 --2- 172.21.15.153:0/2851065710 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb7013fbc0 0x7fcb7013d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.961+0000 7fcb6dd9b700 1 -- 172.21.15.153:0/2851065710 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb7006eac0 msgr2=0x7fcb700c9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.961+0000 7fcb6dd9b700 1 --2- 172.21.15.153:0/2851065710 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb7006eac0 0x7fcb700c9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.961+0000 7fcb6dd9b700 1 -- 172.21.15.153:0/2851065710 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb60009420 con 0x7fcb7013f7f0 2024-08-17T02:29:30.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.961+0000 7fcb6dd9b700 1 --2- 172.21.15.153:0/2851065710 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb7013f7f0 0x7fcb70153460 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fcb58009ea0 tx=0x7fcb58017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:30.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.961+0000 7fcb667fc700 1 -- 172.21.15.153:0/2851065710 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5801f070 con 0x7fcb7013f7f0 2024-08-17T02:29:30.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.961+0000 7fcb667fc700 1 -- 172.21.15.153:0/2851065710 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb58011920 con 0x7fcb7013f7f0 2024-08-17T02:29:30.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.961+0000 7fcb6f59e700 1 -- 172.21.15.153:0/2851065710 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb58009420 con 0x7fcb7013f7f0 2024-08-17T02:29:30.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.961+0000 7fcb667fc700 1 -- 172.21.15.153:0/2851065710 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb58023410 con 0x7fcb7013f7f0 2024-08-17T02:29:30.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.961+0000 7fcb6f59e700 1 -- 172.21.15.153:0/2851065710 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb700c9fa0 con 0x7fcb7013f7f0 2024-08-17T02:29:30.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.965+0000 7fcb6f59e700 1 -- 172.21.15.153:0/2851065710 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcb700644b0 con 0x7fcb7013f7f0 2024-08-17T02:29:30.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.965+0000 7fcb667fc700 1 -- 172.21.15.153:0/2851065710 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fcb58023780 con 0x7fcb7013f7f0 2024-08-17T02:29:30.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.965+0000 7fcb667fc700 1 --2- 172.21.15.153:0/2851065710 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fcb54060860 0x7fcb54062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.965+0000 7fcb667fc700 1 -- 172.21.15.153:0/2851065710 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fcb5807e5a0 con 0x7fcb7013f7f0 2024-08-17T02:29:30.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.965+0000 7fcb6e59c700 1 --2- 172.21.15.153:0/2851065710 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fcb54060860 0x7fcb54062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.965+0000 7fcb667fc700 1 --2- 172.21.15.153:0/2851065710 >> [v2:172.21.15.153:6805/24235,v1:172.21.15.153:6808/24235] conn(0x7fcb54066750 0x7fcb54068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.965+0000 7fcb667fc700 1 -- 172.21.15.153:0/2851065710 --> [v2:172.21.15.153:6805/24235,v1:172.21.15.153:6808/24235] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcb54069210 con 0x7fcb54066750 2024-08-17T02:29:30.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.965+0000 7fcb667fc700 1 -- 172.21.15.153:0/2851065710 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb5807e970 con 0x7fcb7013f7f0 2024-08-17T02:29:30.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.965+0000 7fcb6ed9d700 1 --2- 172.21.15.153:0/2851065710 >> [v2:172.21.15.153:6805/24235,v1:172.21.15.153:6808/24235] conn(0x7fcb54066750 0x7fcb54068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.965+0000 7fcb6e59c700 1 --2- 172.21.15.153:0/2851065710 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fcb54060860 0x7fcb54062d10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcb60009f40 tx=0x7fcb600091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:30.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.965+0000 7fcb6ed9d700 1 --2- 172.21.15.153:0/2851065710 >> [v2:172.21.15.153:6805/24235,v1:172.21.15.153:6808/24235] conn(0x7fcb54066750 0x7fcb54068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:30.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.965+0000 7fcb667fc700 1 -- 172.21.15.153:0/2851065710 <== osd.2 v2:172.21.15.153:6805/24235 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fcb54069210 con 0x7fcb54066750 2024-08-17T02:29:30.987 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.985+0000 7fcb6f59e700 1 -- 172.21.15.153:0/2851065710 --> [v2:172.21.15.153:6805/24235,v1:172.21.15.153:6808/24235] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcb7013f040 con 0x7fcb54066750 2024-08-17T02:29:30.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.985+0000 7fcb667fc700 1 -- 172.21.15.153:0/2851065710 <== osd.2 v2:172.21.15.153:6805/24235 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fcb7013f040 con 0x7fcb54066750 2024-08-17T02:29:30.988 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-08-17T02:29:30.989 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:29:30.989 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-08-17T02:29:30.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.985+0000 7fcb6f59e700 1 -- 172.21.15.153:0/2851065710 >> [v2:172.21.15.153:6805/24235,v1:172.21.15.153:6808/24235] conn(0x7fcb54066750 msgr2=0x7fcb54068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.985+0000 7fcb6f59e700 1 --2- 172.21.15.153:0/2851065710 >> [v2:172.21.15.153:6805/24235,v1:172.21.15.153:6808/24235] conn(0x7fcb54066750 0x7fcb54068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.985+0000 7fcb6f59e700 1 -- 172.21.15.153:0/2851065710 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fcb54060860 msgr2=0x7fcb54062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.985+0000 7fcb6f59e700 1 --2- 172.21.15.153:0/2851065710 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fcb54060860 0x7fcb54062d10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcb60009f40 tx=0x7fcb600091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.985+0000 7fcb6f59e700 1 -- 172.21.15.153:0/2851065710 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb7013f7f0 msgr2=0x7fcb70153460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.991 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.985+0000 7fcb6f59e700 1 --2- 172.21.15.153:0/2851065710 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb7013f7f0 0x7fcb70153460 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fcb58009ea0 tx=0x7fcb58017000 comp rx=0 tx=0).stop 2024-08-17T02:29:30.991 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.985+0000 7fcb6ed9d700 1 -- 172.21.15.153:0/2851065710 reap_dead start 2024-08-17T02:29:30.991 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.985+0000 7fcb6f59e700 1 -- 172.21.15.153:0/2851065710 shutdown_connections 2024-08-17T02:29:30.991 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.985+0000 7fcb6f59e700 1 -- 172.21.15.153:0/2851065710 >> 172.21.15.153:0/2851065710 conn(0x7fcb70066e00 msgr2=0x7fcb70067c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:30.991 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.985+0000 7fcb6f59e700 1 -- 172.21.15.153:0/2851065710 shutdown_connections 2024-08-17T02:29:30.991 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:30.985+0000 7fcb6f59e700 1 -- 172.21.15.153:0/2851065710 wait complete. 2024-08-17T02:29:31.001 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-08-17T02:29:31.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.113+0000 7ff393b6e700 1 Processor -- start 2024-08-17T02:29:31.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.113+0000 7ff393b6e700 1 -- start start 2024-08-17T02:29:31.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.113+0000 7ff393b6e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff38c0688d0 0x7ff38c068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.113+0000 7ff393b6e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff38c06e890 0x7ff38c0ab760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.113+0000 7ff393b6e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff38c15a270 0x7ff38c15a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.113+0000 7ff393b6e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff38c0af070 con 0x7ff38c06e890 2024-08-17T02:29:31.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.113+0000 7ff393b6e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff38c0abca0 con 0x7ff38c15a270 2024-08-17T02:29:31.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.113+0000 7ff393b6e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c0cac60 con 0x7ff38c0688d0 2024-08-17T02:29:31.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.113+0000 7ff391109700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff38c06e890 0x7ff38c0ab760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.113+0000 7ff39210b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff38c15a270 0x7ff38c15a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.113+0000 7ff391109700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff38c06e890 0x7ff38c0ab760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40792/0 (socket says 172.21.15.153:40792) 2024-08-17T02:29:31.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.113+0000 7ff391109700 1 -- 172.21.15.153:0/1512386555 learned_addr learned my addr 172.21.15.153:0/1512386555 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:31.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.113+0000 7ff39190a700 1 --2- 172.21.15.153:0/1512386555 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff38c0688d0 0x7ff38c068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.113+0000 7ff391109700 1 -- 172.21.15.153:0/1512386555 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff38c0688d0 msgr2=0x7ff38c068ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:31.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.113+0000 7ff391109700 1 --2- 172.21.15.153:0/1512386555 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff38c0688d0 0x7ff38c068ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.113+0000 7ff391109700 1 -- 172.21.15.153:0/1512386555 >> v2:172.21.15.174:3300/0 conn(0x7ff38c15a270 msgr2=0x7ff38c15a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:31.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.113+0000 7ff391109700 1 --2- 172.21.15.153:0/1512386555 >> v2:172.21.15.174:3300/0 conn(0x7ff38c15a270 0x7ff38c15a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.113+0000 7ff391109700 1 -- 172.21.15.153:0/1512386555 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff38c0abed0 con 0x7ff38c06e890 2024-08-17T02:29:31.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.113+0000 7ff391109700 1 --2- 172.21.15.153:0/1512386555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff38c06e890 0x7ff38c0ab760 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff38c15bff0 tx=0x7ff380009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcdec2dc962e21 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:31.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.113+0000 7ff390908700 1 -- 172.21.15.153:0/1512386555 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff380009e70 con 0x7ff38c06e890 2024-08-17T02:29:31.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.113+0000 7ff390908700 1 -- 172.21.15.153:0/1512386555 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38000b860 con 0x7ff38c06e890 2024-08-17T02:29:31.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.113+0000 7ff390908700 1 -- 172.21.15.153:0/1512386555 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38000bc00 con 0x7ff38c06e890 2024-08-17T02:29:31.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.117+0000 7ff393b6e700 1 -- 172.21.15.153:0/1512386555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff38c06e890 msgr2=0x7ff38c0ab760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.117+0000 7ff393b6e700 1 --2- 172.21.15.153:0/1512386555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff38c06e890 0x7ff38c0ab760 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff38c15bff0 tx=0x7ff380009250 comp rx=0 tx=0).stop 2024-08-17T02:29:31.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.117+0000 7ff393b6e700 1 -- 172.21.15.153:0/1512386555 shutdown_connections 2024-08-17T02:29:31.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.117+0000 7ff393b6e700 1 --2- 172.21.15.153:0/1512386555 >> v2:172.21.15.174:3300/0 conn(0x7ff38c15a270 0x7ff38c15a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.117+0000 7ff393b6e700 1 --2- 172.21.15.153:0/1512386555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff38c06e890 0x7ff38c0ab760 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.117+0000 7ff393b6e700 1 --2- 172.21.15.153:0/1512386555 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff38c0688d0 0x7ff38c068ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.117+0000 7ff393b6e700 1 -- 172.21.15.153:0/1512386555 >> 172.21.15.153:0/1512386555 conn(0x7ff38c0cd160 msgr2=0x7ff38c06d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:31.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.117+0000 7ff393b6e700 1 -- 172.21.15.153:0/1512386555 shutdown_connections 2024-08-17T02:29:31.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.117+0000 7ff393b6e700 1 -- 172.21.15.153:0/1512386555 wait complete. 2024-08-17T02:29:31.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.117+0000 7ff393b6e700 1 Processor -- start 2024-08-17T02:29:31.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.117+0000 7ff393b6e700 1 -- start start 2024-08-17T02:29:31.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.117+0000 7ff393b6e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff38c0688d0 0x7ff38c149b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.117+0000 7ff393b6e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff38c06e890 0x7ff38c0b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.117+0000 7ff393b6e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff38c15a270 0x7ff38c0b1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.117+0000 7ff393b6e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c0b1860 con 0x7ff38c06e890 2024-08-17T02:29:31.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.117+0000 7ff393b6e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c0a9c70 con 0x7ff38c15a270 2024-08-17T02:29:31.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.121+0000 7ff393b6e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c0ad9b0 con 0x7ff38c0688d0 2024-08-17T02:29:31.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.121+0000 7ff391109700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff38c06e890 0x7ff38c0b0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.121+0000 7ff391109700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff38c06e890 0x7ff38c0b0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40794/0 (socket says 172.21.15.153:40794) 2024-08-17T02:29:31.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.121+0000 7ff391109700 1 -- 172.21.15.153:0/4047951039 learned_addr learned my addr 172.21.15.153:0/4047951039 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:31.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.121+0000 7ff39190a700 1 --2- 172.21.15.153:0/4047951039 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff38c0688d0 0x7ff38c149b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.121+0000 7ff39210b700 1 --2- 172.21.15.153:0/4047951039 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff38c15a270 0x7ff38c0b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.121+0000 7ff391109700 1 -- 172.21.15.153:0/4047951039 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff38c0688d0 msgr2=0x7ff38c149b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.121+0000 7ff391109700 1 --2- 172.21.15.153:0/4047951039 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff38c0688d0 0x7ff38c149b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.121+0000 7ff391109700 1 -- 172.21.15.153:0/4047951039 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff38c15a270 msgr2=0x7ff38c0b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.121+0000 7ff391109700 1 --2- 172.21.15.153:0/4047951039 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff38c15a270 0x7ff38c0b1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.121+0000 7ff391109700 1 -- 172.21.15.153:0/4047951039 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3800094f0 con 0x7ff38c06e890 2024-08-17T02:29:31.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.121+0000 7ff39210b700 1 --2- 172.21.15.153:0/4047951039 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff38c15a270 0x7ff38c0b1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:31.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.121+0000 7ff391109700 1 --2- 172.21.15.153:0/4047951039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff38c06e890 0x7ff38c0b0b00 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ff38c070cc0 tx=0x7ff380017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:31.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.121+0000 7ff37dffb700 1 -- 172.21.15.153:0/4047951039 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38000bbe0 con 0x7ff38c06e890 2024-08-17T02:29:31.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.121+0000 7ff37dffb700 1 -- 172.21.15.153:0/4047951039 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff380011420 con 0x7ff38c06e890 2024-08-17T02:29:31.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.121+0000 7ff393b6e700 1 -- 172.21.15.153:0/4047951039 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff38c0ad3f0 con 0x7ff38c06e890 2024-08-17T02:29:31.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.121+0000 7ff37dffb700 1 -- 172.21.15.153:0/4047951039 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3800117e0 con 0x7ff38c06e890 2024-08-17T02:29:31.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.121+0000 7ff393b6e700 1 -- 172.21.15.153:0/4047951039 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff38c0a9900 con 0x7ff38c06e890 2024-08-17T02:29:31.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.121+0000 7ff393b6e700 1 -- 172.21.15.153:0/4047951039 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff38c0645c0 con 0x7ff38c06e890 2024-08-17T02:29:31.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.125+0000 7ff37dffb700 1 -- 172.21.15.153:0/4047951039 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff380011b90 con 0x7ff38c06e890 2024-08-17T02:29:31.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.125+0000 7ff37dffb700 1 --2- 172.21.15.153:0/4047951039 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff370060860 0x7ff370062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.125+0000 7ff37dffb700 1 -- 172.21.15.153:0/4047951039 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7ff38007e130 con 0x7ff38c06e890 2024-08-17T02:29:31.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.125+0000 7ff39190a700 1 --2- 172.21.15.153:0/4047951039 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff370060860 0x7ff370062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.125+0000 7ff39190a700 1 --2- 172.21.15.153:0/4047951039 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff370060860 0x7ff370062d10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff388006fd0 tx=0x7ff388008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:31.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.133+0000 7ff37dffb700 1 -- 172.21.15.153:0/4047951039 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff38004e820 con 0x7ff38c06e890 2024-08-17T02:29:31.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.297+0000 7ff393b6e700 1 -- 172.21.15.153:0/4047951039 --> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7ff38c0adb70 con 0x7ff370060860 2024-08-17T02:29:31.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.297+0000 7ff37dffb700 1 -- 172.21.15.153:0/4047951039 <== mgr.4104 v2:172.21.15.153:6832/24147 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff38c0adb70 con 0x7ff370060860 2024-08-17T02:29:31.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.297+0000 7ff393b6e700 1 -- 172.21.15.153:0/4047951039 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff370060860 msgr2=0x7ff370062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.297+0000 7ff393b6e700 1 --2- 172.21.15.153:0/4047951039 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff370060860 0x7ff370062d10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff388006fd0 tx=0x7ff388008040 comp rx=0 tx=0).stop 2024-08-17T02:29:31.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.297+0000 7ff393b6e700 1 -- 172.21.15.153:0/4047951039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff38c06e890 msgr2=0x7ff38c0b0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.297+0000 7ff393b6e700 1 --2- 172.21.15.153:0/4047951039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff38c06e890 0x7ff38c0b0b00 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ff38c070cc0 tx=0x7ff380017000 comp rx=0 tx=0).stop 2024-08-17T02:29:31.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.297+0000 7ff393b6e700 1 -- 172.21.15.153:0/4047951039 shutdown_connections 2024-08-17T02:29:31.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.297+0000 7ff393b6e700 1 --2- 172.21.15.153:0/4047951039 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff370060860 0x7ff370062d10 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.297+0000 7ff393b6e700 1 --2- 172.21.15.153:0/4047951039 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff38c15a270 0x7ff38c0b1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.297+0000 7ff393b6e700 1 --2- 172.21.15.153:0/4047951039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff38c06e890 0x7ff38c0b0b00 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.297+0000 7ff393b6e700 1 --2- 172.21.15.153:0/4047951039 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff38c0688d0 0x7ff38c149b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.297+0000 7ff393b6e700 1 -- 172.21.15.153:0/4047951039 >> 172.21.15.153:0/4047951039 conn(0x7ff38c0cd160 msgr2=0x7ff38c068ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:31.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.301+0000 7ff393b6e700 1 -- 172.21.15.153:0/4047951039 shutdown_connections 2024-08-17T02:29:31.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.301+0000 7ff393b6e700 1 -- 172.21.15.153:0/4047951039 wait complete. 2024-08-17T02:29:31.304 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 2 to deep-scrub 2024-08-17T02:29:31.314 INFO:tasks.ceph:Scrubbing osd.3 2024-08-17T02:29:31.315 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:29:31.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.429+0000 7f05066f1700 1 Processor -- start 2024-08-17T02:29:31.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.429+0000 7f05066f1700 1 -- start start 2024-08-17T02:29:31.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.429+0000 7f05066f1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f050013e430 0x7f050013e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.429+0000 7f05066f1700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f050006ddd0 con 0x7f05000abff0 2024-08-17T02:29:31.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.429+0000 7f05066f1700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f050006d1c0 con 0x7f05000abc20 2024-08-17T02:29:31.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.429+0000 7f05066f1700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f050006d4a0 con 0x7f050013e430 2024-08-17T02:29:31.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.433+0000 7f0505ef0700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f050013e430 0x7f050013e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.433+0000 7f0504eee700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f05000abff0 0x7f05000aef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:49866/0 (socket says 172.21.15.153:49866) 2024-08-17T02:29:31.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.433+0000 7f0505ef0700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f050013e430 0x7f050013e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40810/0 (socket says 172.21.15.153:40810) 2024-08-17T02:29:31.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.433+0000 7f0504eee700 1 -- 172.21.15.153:0/3066683889 learned_addr learned my addr 172.21.15.153:0/3066683889 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:29:31.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.433+0000 7f0505ef0700 1 -- 172.21.15.153:0/3066683889 >> v1:172.21.15.174:6789/0 conn(0x7f05000abc20 legacy=0x7f050006e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.433+0000 7f0505ef0700 1 -- 172.21.15.153:0/3066683889 >> v1:172.21.15.153:6789/0 conn(0x7f05000abff0 legacy=0x7f05000aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.433+0000 7f04fffff700 1 -- 172.21.15.153:0/3066683889 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1377867185 0 0) 0x7f050006ddd0 con 0x7f05000abff0 2024-08-17T02:29:31.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.433+0000 7f0505ef0700 1 -- 172.21.15.153:0/3066683889 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f050006d780 con 0x7f050013e430 2024-08-17T02:29:31.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.433+0000 7f0505ef0700 1 --2- 172.21.15.153:0/3066683889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f050013e430 0x7f050013e870 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f04e8009910 tx=0x7f04e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=537997e059df249e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:31.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.433+0000 7f04fffff700 1 -- 172.21.15.153:0/3066683889 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e800b820 con 0x7f050013e430 2024-08-17T02:29:31.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.433+0000 7f04fffff700 1 -- 172.21.15.153:0/3066683889 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e800b980 con 0x7f050013e430 2024-08-17T02:29:31.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.433+0000 7f04fffff700 1 -- 172.21.15.153:0/3066683889 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e800bd20 con 0x7f050013e430 2024-08-17T02:29:31.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.433+0000 7f05066f1700 1 -- 172.21.15.153:0/3066683889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f050013e430 msgr2=0x7f050013e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.433+0000 7f05066f1700 1 --2- 172.21.15.153:0/3066683889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f050013e430 0x7f050013e870 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f04e8009910 tx=0x7f04e80091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.433+0000 7f05066f1700 1 -- 172.21.15.153:0/3066683889 shutdown_connections 2024-08-17T02:29:31.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.433+0000 7f05066f1700 1 --2- 172.21.15.153:0/3066683889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f050013e430 0x7f050013e870 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.433+0000 7f05066f1700 1 -- 172.21.15.153:0/3066683889 >> 172.21.15.153:0/3066683889 conn(0x7f0500066e00 msgr2=0x7f0500067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:31.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.433+0000 7f05066f1700 1 -- 172.21.15.153:0/3066683889 shutdown_connections 2024-08-17T02:29:31.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.433+0000 7f05066f1700 1 -- 172.21.15.153:0/3066683889 wait complete. 2024-08-17T02:29:31.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.437+0000 7f05066f1700 1 Processor -- start 2024-08-17T02:29:31.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.437+0000 7f05066f1700 1 -- start start 2024-08-17T02:29:31.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.437+0000 7f05066f1700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05000abc20 0x7f0500163270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.437+0000 7f05066f1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05000abff0 0x7f05001514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.437+0000 7f05066f1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f050013e430 0x7f0500147bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.437+0000 7f05066f1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0500152b60 con 0x7f050013e430 2024-08-17T02:29:31.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.437+0000 7f05066f1700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0500152ff0 con 0x7f05000abc20 2024-08-17T02:29:31.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.437+0000 7f05066f1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0500151f50 con 0x7f05000abff0 2024-08-17T02:29:31.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.437+0000 7f0505ef0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f050013e430 0x7f0500147bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.437+0000 7f0505ef0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f050013e430 0x7f0500147bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40816/0 (socket says 172.21.15.153:40816) 2024-08-17T02:29:31.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.437+0000 7f0505ef0700 1 -- 172.21.15.153:0/4237672308 learned_addr learned my addr 172.21.15.153:0/4237672308 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:31.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.437+0000 7f05056ef700 1 --2- 172.21.15.153:0/4237672308 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05000abc20 0x7f0500163270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.437+0000 7f0504eee700 1 --2- 172.21.15.153:0/4237672308 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05000abff0 0x7f05001514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.437+0000 7f0505ef0700 1 -- 172.21.15.153:0/4237672308 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05000abff0 msgr2=0x7f05001514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.437+0000 7f0505ef0700 1 --2- 172.21.15.153:0/4237672308 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05000abff0 0x7f05001514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.437+0000 7f0505ef0700 1 -- 172.21.15.153:0/4237672308 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05000abc20 msgr2=0x7f0500163270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.437+0000 7f0505ef0700 1 --2- 172.21.15.153:0/4237672308 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05000abc20 0x7f0500163270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.437+0000 7f0505ef0700 1 -- 172.21.15.153:0/4237672308 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e8009420 con 0x7f050013e430 2024-08-17T02:29:31.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.437+0000 7f0505ef0700 1 --2- 172.21.15.153:0/4237672308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f050013e430 0x7f0500147bf0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f04e80091e0 tx=0x7f04e8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:31.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.437+0000 7f04fd7fa700 1 -- 172.21.15.153:0/4237672308 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e801f070 con 0x7f050013e430 2024-08-17T02:29:31.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.437+0000 7f04fd7fa700 1 -- 172.21.15.153:0/4237672308 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e8002f70 con 0x7f050013e430 2024-08-17T02:29:31.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.437+0000 7f04fd7fa700 1 -- 172.21.15.153:0/4237672308 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e8025650 con 0x7f050013e430 2024-08-17T02:29:31.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.437+0000 7f05066f1700 1 -- 172.21.15.153:0/4237672308 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0500152230 con 0x7f050013e430 2024-08-17T02:29:31.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.437+0000 7f05066f1700 1 -- 172.21.15.153:0/4237672308 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05001527f0 con 0x7f050013e430 2024-08-17T02:29:31.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.441+0000 7f05066f1700 1 -- 172.21.15.153:0/4237672308 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f05000644b0 con 0x7f050013e430 2024-08-17T02:29:31.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.441+0000 7f04fd7fa700 1 -- 172.21.15.153:0/4237672308 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f04e8023070 con 0x7f050013e430 2024-08-17T02:29:31.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.441+0000 7f04fd7fa700 1 --2- 172.21.15.153:0/4237672308 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f04e0060860 0x7f04e0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.441+0000 7f04fd7fa700 1 -- 172.21.15.153:0/4237672308 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f04e807e340 con 0x7f050013e430 2024-08-17T02:29:31.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.441+0000 7f05056ef700 1 --2- 172.21.15.153:0/4237672308 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f04e0060860 0x7f04e0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.441+0000 7f04fd7fa700 1 --2- 172.21.15.153:0/4237672308 >> [v2:172.21.15.153:6824/24236,v1:172.21.15.153:6825/24236] conn(0x7f04e0066750 0x7f04e0068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.441+0000 7f04fd7fa700 1 -- 172.21.15.153:0/4237672308 --> [v2:172.21.15.153:6824/24236,v1:172.21.15.153:6825/24236] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f04e0069210 con 0x7f04e0066750 2024-08-17T02:29:31.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.441+0000 7f04fd7fa700 1 -- 172.21.15.153:0/4237672308 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04e807e710 con 0x7f050013e430 2024-08-17T02:29:31.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.441+0000 7f0504eee700 1 --2- 172.21.15.153:0/4237672308 >> [v2:172.21.15.153:6824/24236,v1:172.21.15.153:6825/24236] conn(0x7f04e0066750 0x7f04e0068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.441+0000 7f05056ef700 1 --2- 172.21.15.153:0/4237672308 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f04e0060860 0x7f04e0062d10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f04f8007fd0 tx=0x7f04f8001650 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:31.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.441+0000 7f0504eee700 1 --2- 172.21.15.153:0/4237672308 >> [v2:172.21.15.153:6824/24236,v1:172.21.15.153:6825/24236] conn(0x7f04e0066750 0x7f04e0068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:31.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.445+0000 7f04fd7fa700 1 -- 172.21.15.153:0/4237672308 <== osd.3 v2:172.21.15.153:6824/24236 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f04e0069210 con 0x7f04e0066750 2024-08-17T02:29:31.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.461+0000 7f05066f1700 1 -- 172.21.15.153:0/4237672308 --> [v2:172.21.15.153:6824/24236,v1:172.21.15.153:6825/24236] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f05001532c0 con 0x7f04e0066750 2024-08-17T02:29:31.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.461+0000 7f04fd7fa700 1 -- 172.21.15.153:0/4237672308 <== osd.3 v2:172.21.15.153:6824/24236 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f05001532c0 con 0x7f04e0066750 2024-08-17T02:29:31.466 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-08-17T02:29:31.466 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:29:31.466 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-08-17T02:29:31.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.461+0000 7f05066f1700 1 -- 172.21.15.153:0/4237672308 >> [v2:172.21.15.153:6824/24236,v1:172.21.15.153:6825/24236] conn(0x7f04e0066750 msgr2=0x7f04e0068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.461+0000 7f05066f1700 1 --2- 172.21.15.153:0/4237672308 >> [v2:172.21.15.153:6824/24236,v1:172.21.15.153:6825/24236] conn(0x7f04e0066750 0x7f04e0068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.461+0000 7f05066f1700 1 -- 172.21.15.153:0/4237672308 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f04e0060860 msgr2=0x7f04e0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.461+0000 7f05066f1700 1 --2- 172.21.15.153:0/4237672308 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f04e0060860 0x7f04e0062d10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f04f8007fd0 tx=0x7f04f8001650 comp rx=0 tx=0).stop 2024-08-17T02:29:31.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.465+0000 7f05066f1700 1 -- 172.21.15.153:0/4237672308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f050013e430 msgr2=0x7f0500147bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.465+0000 7f05066f1700 1 --2- 172.21.15.153:0/4237672308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f050013e430 0x7f0500147bf0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f04e80091e0 tx=0x7f04e8017000 comp rx=0 tx=0).stop 2024-08-17T02:29:31.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.465+0000 7f0505ef0700 1 -- 172.21.15.153:0/4237672308 reap_dead start 2024-08-17T02:29:31.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.465+0000 7f05066f1700 1 -- 172.21.15.153:0/4237672308 shutdown_connections 2024-08-17T02:29:31.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.465+0000 7f05066f1700 1 -- 172.21.15.153:0/4237672308 >> 172.21.15.153:0/4237672308 conn(0x7f0500066e00 msgr2=0x7f05000af640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:31.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.465+0000 7f05066f1700 1 -- 172.21.15.153:0/4237672308 shutdown_connections 2024-08-17T02:29:31.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.465+0000 7f05066f1700 1 -- 172.21.15.153:0/4237672308 wait complete. 2024-08-17T02:29:31.479 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-08-17T02:29:31.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.585+0000 7f94fee4f700 1 Processor -- start 2024-08-17T02:29:31.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.585+0000 7f94fee4f700 1 -- start start 2024-08-17T02:29:31.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.585+0000 7f94fee4f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f94f8159340 0x7f94f8159710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.585+0000 7f94fee4f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94f8159c50 0x7f94f80b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.585+0000 7f94fee4f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94f80b1cf0 con 0x7f94f80b4160 2024-08-17T02:29:31.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.585+0000 7f94fee4f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94f80b45e0 con 0x7f94f8159340 2024-08-17T02:29:31.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.585+0000 7f94fee4f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f80b60d0 con 0x7f94f8159c50 2024-08-17T02:29:31.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.585+0000 7f94fcbeb700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f94f8159340 0x7f94f8159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.585+0000 7f94fcbeb700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f94f8159340 0x7f94f8159710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40832/0 (socket says 172.21.15.153:40832) 2024-08-17T02:29:31.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.585+0000 7f94fcbeb700 1 -- 172.21.15.153:0/2957907576 learned_addr learned my addr 172.21.15.153:0/2957907576 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:31.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.585+0000 7f94f7fff700 1 --2- 172.21.15.153:0/2957907576 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94f8159c50 0x7f94f80b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.585+0000 7f94fcbeb700 1 -- 172.21.15.153:0/2957907576 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94f8159c50 msgr2=0x7f94f80b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:31.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.585+0000 7f94fcbeb700 1 --2- 172.21.15.153:0/2957907576 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94f8159c50 0x7f94f80b3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.585+0000 7f94fcbeb700 1 -- 172.21.15.153:0/2957907576 >> v1:172.21.15.174:6789/0 conn(0x7f94f80b4160 legacy=0x7f94f80b04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.585+0000 7f94fcbeb700 1 -- 172.21.15.153:0/2957907576 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f80b10e0 con 0x7f94f8159340 2024-08-17T02:29:31.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.585+0000 7f94fcbeb700 1 --2- 172.21.15.153:0/2957907576 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94f8159340 0x7f94f8159710 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f94e80099b0 tx=0x7f94e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5531dab6a355fa3d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:31.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.589+0000 7f94f77fe700 1 -- 172.21.15.153:0/2957907576 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e800b860 con 0x7f94f8159340 2024-08-17T02:29:31.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.589+0000 7f94f77fe700 1 -- 172.21.15.153:0/2957907576 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e800b9c0 con 0x7f94f8159340 2024-08-17T02:29:31.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.589+0000 7f94f77fe700 1 -- 172.21.15.153:0/2957907576 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e800bd60 con 0x7f94f8159340 2024-08-17T02:29:31.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.589+0000 7f94fee4f700 1 -- 172.21.15.153:0/2957907576 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94f8159340 msgr2=0x7f94f8159710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.589+0000 7f94fee4f700 1 --2- 172.21.15.153:0/2957907576 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94f8159340 0x7f94f8159710 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f94e80099b0 tx=0x7f94e8009250 comp rx=0 tx=0).stop 2024-08-17T02:29:31.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.589+0000 7f94fee4f700 1 -- 172.21.15.153:0/2957907576 shutdown_connections 2024-08-17T02:29:31.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.589+0000 7f94fee4f700 1 --2- 172.21.15.153:0/2957907576 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94f8159c50 0x7f94f80b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.589+0000 7f94fee4f700 1 --2- 172.21.15.153:0/2957907576 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94f8159340 0x7f94f8159710 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.589+0000 7f94fee4f700 1 -- 172.21.15.153:0/2957907576 >> 172.21.15.153:0/2957907576 conn(0x7f94f80994f0 msgr2=0x7f94f80675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:31.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.589+0000 7f94fee4f700 1 -- 172.21.15.153:0/2957907576 shutdown_connections 2024-08-17T02:29:31.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.589+0000 7f94fee4f700 1 -- 172.21.15.153:0/2957907576 wait complete. 2024-08-17T02:29:31.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.589+0000 7f94fee4f700 1 Processor -- start 2024-08-17T02:29:31.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.589+0000 7f94fee4f700 1 -- start start 2024-08-17T02:29:31.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.593+0000 7f94fee4f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94f80b4160 0x7f94f814e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.593+0000 7f94fee4f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94f8159340 0x7f94f816a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.593+0000 7f94fee4f700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94f8159c50 0x7f94f81546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.593+0000 7f94fee4f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f814edd0 con 0x7f94f8159340 2024-08-17T02:29:31.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.593+0000 7f94fee4f700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f816afa0 con 0x7f94f8159c50 2024-08-17T02:29:31.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.593+0000 7f94fee4f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f816a9e0 con 0x7f94f80b4160 2024-08-17T02:29:31.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.593+0000 7f94f7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94f8159340 0x7f94f816a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.593+0000 7f94f7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94f8159340 0x7f94f816a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40836/0 (socket says 172.21.15.153:40836) 2024-08-17T02:29:31.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.593+0000 7f94f7fff700 1 -- 172.21.15.153:0/1401297298 learned_addr learned my addr 172.21.15.153:0/1401297298 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:31.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.593+0000 7f94fcbeb700 1 --2- 172.21.15.153:0/1401297298 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94f80b4160 0x7f94f814e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.593+0000 7f94fd3ec700 1 --2- 172.21.15.153:0/1401297298 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94f8159c50 0x7f94f81546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.593+0000 7f94f7fff700 1 -- 172.21.15.153:0/1401297298 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94f80b4160 msgr2=0x7f94f814e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.593+0000 7f94f7fff700 1 --2- 172.21.15.153:0/1401297298 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94f80b4160 0x7f94f814e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.593+0000 7f94f7fff700 1 -- 172.21.15.153:0/1401297298 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94f8159c50 msgr2=0x7f94f81546e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.593+0000 7f94f7fff700 1 --2- 172.21.15.153:0/1401297298 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94f8159c50 0x7f94f81546e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.593+0000 7f94f7fff700 1 -- 172.21.15.153:0/1401297298 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e80094f0 con 0x7f94f8159340 2024-08-17T02:29:31.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.593+0000 7f94f7fff700 1 --2- 172.21.15.153:0/1401297298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94f8159340 0x7f94f816a000 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f94ec00d860 tx=0x7f94ec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:31.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.593+0000 7f94f4ff9700 1 -- 172.21.15.153:0/1401297298 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec0125f0 con 0x7f94f8159340 2024-08-17T02:29:31.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.593+0000 7f94f4ff9700 1 -- 172.21.15.153:0/1401297298 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ec012770 con 0x7f94f8159340 2024-08-17T02:29:31.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.593+0000 7f94fee4f700 1 -- 172.21.15.153:0/1401297298 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94f816acc0 con 0x7f94f8159340 2024-08-17T02:29:31.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.593+0000 7f94f4ff9700 1 -- 172.21.15.153:0/1401297298 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec012b30 con 0x7f94f8159340 2024-08-17T02:29:31.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.593+0000 7f94fee4f700 1 -- 172.21.15.153:0/1401297298 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94f8150d10 con 0x7f94f8159340 2024-08-17T02:29:31.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.593+0000 7f94fee4f700 1 -- 172.21.15.153:0/1401297298 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94f8150f30 con 0x7f94f8159340 2024-08-17T02:29:31.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.597+0000 7f94f4ff9700 1 -- 172.21.15.153:0/1401297298 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f94ec013480 con 0x7f94f8159340 2024-08-17T02:29:31.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.597+0000 7f94f4ff9700 1 --2- 172.21.15.153:0/1401297298 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f94e4060860 0x7f94e4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.597+0000 7f94fcbeb700 1 --2- 172.21.15.153:0/1401297298 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f94e4060860 0x7f94e4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.597+0000 7f94f4ff9700 1 -- 172.21.15.153:0/1401297298 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f94ec07cd40 con 0x7f94f8159340 2024-08-17T02:29:31.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.597+0000 7f94fcbeb700 1 --2- 172.21.15.153:0/1401297298 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f94e4060860 0x7f94e4062d10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f94e80099b0 tx=0x7f94e8017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:31.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.605+0000 7f94f4ff9700 1 -- 172.21.15.153:0/1401297298 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f94ec04d390 con 0x7f94f8159340 2024-08-17T02:29:31.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.773+0000 7f94fee4f700 1 -- 172.21.15.153:0/1401297298 --> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f94f80645c0 con 0x7f94e4060860 2024-08-17T02:29:31.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.773+0000 7f94f4ff9700 1 -- 172.21.15.153:0/1401297298 <== mgr.4104 v2:172.21.15.153:6832/24147 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f94f80645c0 con 0x7f94e4060860 2024-08-17T02:29:31.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.777+0000 7f94fee4f700 1 -- 172.21.15.153:0/1401297298 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f94e4060860 msgr2=0x7f94e4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.777+0000 7f94fee4f700 1 --2- 172.21.15.153:0/1401297298 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f94e4060860 0x7f94e4062d10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f94e80099b0 tx=0x7f94e8017000 comp rx=0 tx=0).stop 2024-08-17T02:29:31.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.777+0000 7f94fee4f700 1 -- 172.21.15.153:0/1401297298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94f8159340 msgr2=0x7f94f816a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.777+0000 7f94fee4f700 1 --2- 172.21.15.153:0/1401297298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94f8159340 0x7f94f816a000 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f94ec00d860 tx=0x7f94ec008040 comp rx=0 tx=0).stop 2024-08-17T02:29:31.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.777+0000 7f94fee4f700 1 -- 172.21.15.153:0/1401297298 shutdown_connections 2024-08-17T02:29:31.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.777+0000 7f94fee4f700 1 --2- 172.21.15.153:0/1401297298 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f94e4060860 0x7f94e4062d10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.777+0000 7f94fee4f700 1 --2- 172.21.15.153:0/1401297298 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94f8159c50 0x7f94f81546e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.777+0000 7f94fee4f700 1 --2- 172.21.15.153:0/1401297298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94f8159340 0x7f94f816a000 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.777+0000 7f94fee4f700 1 --2- 172.21.15.153:0/1401297298 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94f80b4160 0x7f94f814e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.777+0000 7f94fee4f700 1 -- 172.21.15.153:0/1401297298 >> 172.21.15.153:0/1401297298 conn(0x7f94f80994f0 msgr2=0x7f94f80aa760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:31.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.777+0000 7f94fee4f700 1 -- 172.21.15.153:0/1401297298 shutdown_connections 2024-08-17T02:29:31.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.777+0000 7f94fee4f700 1 -- 172.21.15.153:0/1401297298 wait complete. 2024-08-17T02:29:31.781 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 3 to deep-scrub 2024-08-17T02:29:31.796 INFO:tasks.ceph:Scrubbing osd.4 2024-08-17T02:29:31.796 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:29:31.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.909+0000 7fc232b4f700 1 Processor -- start 2024-08-17T02:29:31.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.909+0000 7fc232b4f700 1 -- start start 2024-08-17T02:29:31.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.913+0000 7fc232b4f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc22c1593e0 0x7fc22c0ad660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.913+0000 7fc232b4f700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc22c0b2f40 con 0x7fc22c0adba0 2024-08-17T02:29:31.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.913+0000 7fc232b4f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc22c0adfb0 con 0x7fc22c159010 2024-08-17T02:29:31.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.913+0000 7fc232b4f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc22c069790 con 0x7fc22c1593e0 2024-08-17T02:29:31.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.913+0000 7fc23134c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc22c1593e0 0x7fc22c0ad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.913+0000 7fc23134c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc22c1593e0 0x7fc22c0ad660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40842/0 (socket says 172.21.15.153:40842) 2024-08-17T02:29:31.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.913+0000 7fc23234e700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc22c0adba0 0x7fc22c0b33d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:49868/0 (socket says 172.21.15.153:49868) 2024-08-17T02:29:31.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.913+0000 7fc23134c700 1 -- 172.21.15.153:0/4199343360 learned_addr learned my addr 172.21.15.153:0/4199343360 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:31.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.913+0000 7fc23134c700 1 -- 172.21.15.153:0/4199343360 >> v1:172.21.15.174:6789/0 conn(0x7fc22c159010 legacy=0x7fc22c068ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:31.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.913+0000 7fc23134c700 1 -- 172.21.15.153:0/4199343360 >> v1:172.21.15.153:6789/0 conn(0x7fc22c0adba0 legacy=0x7fc22c0b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.913+0000 7fc23134c700 1 -- 172.21.15.153:0/4199343360 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc22c069a50 con 0x7fc22c1593e0 2024-08-17T02:29:31.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.913+0000 7fc23134c700 1 --2- 172.21.15.153:0/4199343360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc22c1593e0 0x7fc22c0ad660 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc2280099b0 tx=0x7fc228009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f7ce5bf83ac0b74 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:31.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.913+0000 7fc230b4b700 1 -- 172.21.15.153:0/4199343360 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22800b860 con 0x7fc22c1593e0 2024-08-17T02:29:31.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.913+0000 7fc230b4b700 1 -- 172.21.15.153:0/4199343360 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22800b9c0 con 0x7fc22c1593e0 2024-08-17T02:29:31.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.913+0000 7fc230b4b700 1 -- 172.21.15.153:0/4199343360 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22800bd60 con 0x7fc22c1593e0 2024-08-17T02:29:31.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.913+0000 7fc232b4f700 1 -- 172.21.15.153:0/4199343360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc22c1593e0 msgr2=0x7fc22c0ad660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.913+0000 7fc232b4f700 1 --2- 172.21.15.153:0/4199343360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc22c1593e0 0x7fc22c0ad660 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc2280099b0 tx=0x7fc228009250 comp rx=0 tx=0).stop 2024-08-17T02:29:31.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.913+0000 7fc232b4f700 1 -- 172.21.15.153:0/4199343360 shutdown_connections 2024-08-17T02:29:31.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.913+0000 7fc232b4f700 1 --2- 172.21.15.153:0/4199343360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc22c1593e0 0x7fc22c0ad660 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.913+0000 7fc232b4f700 1 -- 172.21.15.153:0/4199343360 >> 172.21.15.153:0/4199343360 conn(0x7fc22c099410 msgr2=0x7fc22c067590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:31.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.913+0000 7fc232b4f700 1 -- 172.21.15.153:0/4199343360 shutdown_connections 2024-08-17T02:29:31.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.913+0000 7fc232b4f700 1 -- 172.21.15.153:0/4199343360 wait complete. 2024-08-17T02:29:31.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.913+0000 7fc232b4f700 1 Processor -- start 2024-08-17T02:29:31.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.913+0000 7fc232b4f700 1 -- start start 2024-08-17T02:29:31.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.917+0000 7fc232b4f700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc22c0adba0 0x7fc22c0b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.917+0000 7fc232b4f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc22c159010 0x7fc22c15ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.917+0000 7fc232b4f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc22c1593e0 0x7fc22c154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.917+0000 7fc232b4f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c1546c0 con 0x7fc22c1593e0 2024-08-17T02:29:31.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.917+0000 7fc232b4f700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c15a230 con 0x7fc22c0adba0 2024-08-17T02:29:31.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.917+0000 7fc232b4f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c15b510 con 0x7fc22c159010 2024-08-17T02:29:31.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.917+0000 7fc23234e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc22c1593e0 0x7fc22c154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.917+0000 7fc23234e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc22c1593e0 0x7fc22c154180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40858/0 (socket says 172.21.15.153:40858) 2024-08-17T02:29:31.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.917+0000 7fc23234e700 1 -- 172.21.15.153:0/491161434 learned_addr learned my addr 172.21.15.153:0/491161434 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:31.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.917+0000 7fc231b4d700 1 --2- 172.21.15.153:0/491161434 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc22c0adba0 0x7fc22c0b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.917+0000 7fc23134c700 1 --2- 172.21.15.153:0/491161434 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc22c159010 0x7fc22c15ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.917+0000 7fc23234e700 1 -- 172.21.15.153:0/491161434 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc22c159010 msgr2=0x7fc22c15ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.917+0000 7fc23234e700 1 --2- 172.21.15.153:0/491161434 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc22c159010 0x7fc22c15ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.917+0000 7fc23234e700 1 -- 172.21.15.153:0/491161434 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc22c0adba0 msgr2=0x7fc22c0b21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.917+0000 7fc23234e700 1 --2- 172.21.15.153:0/491161434 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc22c0adba0 0x7fc22c0b21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.917+0000 7fc23234e700 1 -- 172.21.15.153:0/491161434 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2280094f0 con 0x7fc22c1593e0 2024-08-17T02:29:31.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.917+0000 7fc23134c700 1 --2- 172.21.15.153:0/491161434 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc22c159010 0x7fc22c15ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:31.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.917+0000 7fc23234e700 1 --2- 172.21.15.153:0/491161434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc22c1593e0 0x7fc22c154180 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc22400cd30 tx=0x7fc224001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:31.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.917+0000 7fc221ffb700 1 -- 172.21.15.153:0/491161434 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22400ce90 con 0x7fc22c1593e0 2024-08-17T02:29:31.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.917+0000 7fc221ffb700 1 -- 172.21.15.153:0/491161434 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc224005df0 con 0x7fc22c1593e0 2024-08-17T02:29:31.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.917+0000 7fc232b4f700 1 -- 172.21.15.153:0/491161434 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc22c159900 con 0x7fc22c1593e0 2024-08-17T02:29:31.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.917+0000 7fc221ffb700 1 -- 172.21.15.153:0/491161434 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22400ab70 con 0x7fc22c1593e0 2024-08-17T02:29:31.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.917+0000 7fc232b4f700 1 -- 172.21.15.153:0/491161434 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc22c159ec0 con 0x7fc22c1593e0 2024-08-17T02:29:31.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.921+0000 7fc232b4f700 1 -- 172.21.15.153:0/491161434 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc22c0644b0 con 0x7fc22c1593e0 2024-08-17T02:29:31.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.921+0000 7fc221ffb700 1 -- 172.21.15.153:0/491161434 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc2240070f0 con 0x7fc22c1593e0 2024-08-17T02:29:31.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.921+0000 7fc221ffb700 1 --2- 172.21.15.153:0/491161434 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fc210060860 0x7fc210062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.921+0000 7fc221ffb700 1 -- 172.21.15.153:0/491161434 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fc22407ca70 con 0x7fc22c1593e0 2024-08-17T02:29:31.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.921+0000 7fc231b4d700 1 --2- 172.21.15.153:0/491161434 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fc210060860 0x7fc210062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.921+0000 7fc221ffb700 1 --2- 172.21.15.153:0/491161434 >> [v2:172.21.15.174:6808/24456,v1:172.21.15.174:6809/24456] conn(0x7fc2100665e0 0x7fc2100689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.921+0000 7fc221ffb700 1 -- 172.21.15.153:0/491161434 --> [v2:172.21.15.174:6808/24456,v1:172.21.15.174:6809/24456] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc2100690a0 con 0x7fc2100665e0 2024-08-17T02:29:31.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.921+0000 7fc221ffb700 1 -- 172.21.15.153:0/491161434 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc224081240 con 0x7fc22c1593e0 2024-08-17T02:29:31.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.921+0000 7fc23134c700 1 --2- 172.21.15.153:0/491161434 >> [v2:172.21.15.174:6808/24456,v1:172.21.15.174:6809/24456] conn(0x7fc2100665e0 0x7fc2100689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.921+0000 7fc231b4d700 1 --2- 172.21.15.153:0/491161434 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fc210060860 0x7fc210062d10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc21c003aa0 tx=0x7fc21c000bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:31.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.921+0000 7fc23134c700 1 --2- 172.21.15.153:0/491161434 >> [v2:172.21.15.174:6808/24456,v1:172.21.15.174:6809/24456] conn(0x7fc2100665e0 0x7fc2100689f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:31.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.925+0000 7fc221ffb700 1 -- 172.21.15.153:0/491161434 <== osd.4 v2:172.21.15.174:6808/24456 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fc2100690a0 con 0x7fc2100665e0 2024-08-17T02:29:31.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.941+0000 7fc232b4f700 1 -- 172.21.15.153:0/491161434 --> [v2:172.21.15.174:6808/24456,v1:172.21.15.174:6809/24456] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc22c067f10 con 0x7fc2100665e0 2024-08-17T02:29:31.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.941+0000 7fc221ffb700 1 -- 172.21.15.153:0/491161434 <== osd.4 v2:172.21.15.174:6808/24456 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc22c067f10 con 0x7fc2100665e0 2024-08-17T02:29:31.946 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-08-17T02:29:31.946 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:29:31.947 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-08-17T02:29:31.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.941+0000 7fc232b4f700 1 -- 172.21.15.153:0/491161434 >> [v2:172.21.15.174:6808/24456,v1:172.21.15.174:6809/24456] conn(0x7fc2100665e0 msgr2=0x7fc2100689f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.941+0000 7fc232b4f700 1 --2- 172.21.15.153:0/491161434 >> [v2:172.21.15.174:6808/24456,v1:172.21.15.174:6809/24456] conn(0x7fc2100665e0 0x7fc2100689f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.941+0000 7fc232b4f700 1 -- 172.21.15.153:0/491161434 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fc210060860 msgr2=0x7fc210062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.941+0000 7fc232b4f700 1 --2- 172.21.15.153:0/491161434 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fc210060860 0x7fc210062d10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc21c003aa0 tx=0x7fc21c000bc0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.941+0000 7fc232b4f700 1 -- 172.21.15.153:0/491161434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc22c1593e0 msgr2=0x7fc22c154180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.941+0000 7fc232b4f700 1 --2- 172.21.15.153:0/491161434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc22c1593e0 0x7fc22c154180 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc22400cd30 tx=0x7fc224001b10 comp rx=0 tx=0).stop 2024-08-17T02:29:31.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.941+0000 7fc23234e700 1 -- 172.21.15.153:0/491161434 reap_dead start 2024-08-17T02:29:31.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.941+0000 7fc232b4f700 1 -- 172.21.15.153:0/491161434 shutdown_connections 2024-08-17T02:29:31.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.941+0000 7fc232b4f700 1 -- 172.21.15.153:0/491161434 >> 172.21.15.153:0/491161434 conn(0x7fc22c099410 msgr2=0x7fc22c068bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:31.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.945+0000 7fc232b4f700 1 -- 172.21.15.153:0/491161434 shutdown_connections 2024-08-17T02:29:31.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:31.945+0000 7fc232b4f700 1 -- 172.21.15.153:0/491161434 wait complete. 2024-08-17T02:29:31.963 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-08-17T02:29:32.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.073+0000 7faca26e2700 1 Processor -- start 2024-08-17T02:29:32.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.073+0000 7faca26e2700 1 -- start start 2024-08-17T02:29:32.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.073+0000 7faca26e2700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fac9c0b14a0 0x7fac9c0cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.073+0000 7faca26e2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fac9c0cb390 0x7fac9c160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.073+0000 7faca26e2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac9c0cbaa0 con 0x7fac9c154900 2024-08-17T02:29:32.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.073+0000 7faca26e2700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac9c068790 con 0x7fac9c0b14a0 2024-08-17T02:29:32.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.073+0000 7faca26e2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac9c1583f0 con 0x7fac9c0cb390 2024-08-17T02:29:32.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.073+0000 7faca0edf700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fac9c0b14a0 0x7fac9c0cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.073+0000 7faca0edf700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fac9c0b14a0 0x7fac9c0cae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40866/0 (socket says 172.21.15.153:40866) 2024-08-17T02:29:32.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.073+0000 7faca0edf700 1 -- 172.21.15.153:0/1801623522 learned_addr learned my addr 172.21.15.153:0/1801623522 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:32.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.073+0000 7faca1ee1700 1 --2- 172.21.15.153:0/1801623522 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fac9c0cb390 0x7fac9c160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.073+0000 7faca0edf700 1 -- 172.21.15.153:0/1801623522 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fac9c0cb390 msgr2=0x7fac9c160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:32.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.073+0000 7faca0edf700 1 --2- 172.21.15.153:0/1801623522 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fac9c0cb390 0x7fac9c160ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.073+0000 7faca0edf700 1 -- 172.21.15.153:0/1801623522 >> v1:172.21.15.174:6789/0 conn(0x7fac9c154900 legacy=0x7fac9c0b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.073+0000 7faca0edf700 1 -- 172.21.15.153:0/1801623522 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9c0cb7d0 con 0x7fac9c0b14a0 2024-08-17T02:29:32.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.073+0000 7faca0edf700 1 --2- 172.21.15.153:0/1801623522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac9c0b14a0 0x7fac9c0cae50 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fac9c0688d0 tx=0x7fac98009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9477f605cd949392 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.073+0000 7fac93fff700 1 -- 172.21.15.153:0/1801623522 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9800e070 con 0x7fac9c0b14a0 2024-08-17T02:29:32.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.073+0000 7fac93fff700 1 -- 172.21.15.153:0/1801623522 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9800ba50 con 0x7fac9c0b14a0 2024-08-17T02:29:32.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.073+0000 7fac93fff700 1 -- 172.21.15.153:0/1801623522 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9800be10 con 0x7fac9c0b14a0 2024-08-17T02:29:32.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.077+0000 7faca26e2700 1 -- 172.21.15.153:0/1801623522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac9c0b14a0 msgr2=0x7fac9c0cae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.077+0000 7faca26e2700 1 --2- 172.21.15.153:0/1801623522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac9c0b14a0 0x7fac9c0cae50 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fac9c0688d0 tx=0x7fac98009840 comp rx=0 tx=0).stop 2024-08-17T02:29:32.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.077+0000 7faca26e2700 1 -- 172.21.15.153:0/1801623522 shutdown_connections 2024-08-17T02:29:32.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.077+0000 7faca26e2700 1 --2- 172.21.15.153:0/1801623522 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fac9c0cb390 0x7fac9c160ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.077+0000 7faca26e2700 1 --2- 172.21.15.153:0/1801623522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac9c0b14a0 0x7fac9c0cae50 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.077+0000 7faca26e2700 1 -- 172.21.15.153:0/1801623522 >> 172.21.15.153:0/1801623522 conn(0x7fac9c0678d0 msgr2=0x7fac9c067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:32.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.077+0000 7faca26e2700 1 -- 172.21.15.153:0/1801623522 shutdown_connections 2024-08-17T02:29:32.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.077+0000 7faca26e2700 1 -- 172.21.15.153:0/1801623522 wait complete. 2024-08-17T02:29:32.082 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.077+0000 7faca26e2700 1 Processor -- start 2024-08-17T02:29:32.082 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.077+0000 7faca26e2700 1 -- start start 2024-08-17T02:29:32.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.081+0000 7faca26e2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac9c0b14a0 0x7fac9c167cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.081+0000 7faca26e2700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac9c0cb390 0x7fac9c1423b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.081+0000 7faca26e2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fac9c154900 0x7fac9c166a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.081+0000 7faca26e2700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9c168230 con 0x7fac9c0b14a0 2024-08-17T02:29:32.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.081+0000 7faca26e2700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9c1689c0 con 0x7fac9c0cb390 2024-08-17T02:29:32.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.081+0000 7faca26e2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac9c168ca0 con 0x7fac9c154900 2024-08-17T02:29:32.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.081+0000 7faca16e0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac9c0b14a0 0x7fac9c167cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.081+0000 7faca16e0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac9c0b14a0 0x7fac9c167cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40878/0 (socket says 172.21.15.153:40878) 2024-08-17T02:29:32.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.081+0000 7faca16e0700 1 -- 172.21.15.153:0/2799781574 learned_addr learned my addr 172.21.15.153:0/2799781574 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:32.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.081+0000 7faca0edf700 1 --2- 172.21.15.153:0/2799781574 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac9c0cb390 0x7fac9c1423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.081+0000 7faca1ee1700 1 --2- 172.21.15.153:0/2799781574 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fac9c154900 0x7fac9c166a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.081+0000 7faca16e0700 1 -- 172.21.15.153:0/2799781574 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fac9c154900 msgr2=0x7fac9c166a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.081+0000 7faca16e0700 1 --2- 172.21.15.153:0/2799781574 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fac9c154900 0x7fac9c166a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.081+0000 7faca16e0700 1 -- 172.21.15.153:0/2799781574 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac9c0cb390 msgr2=0x7fac9c1423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.081+0000 7faca16e0700 1 --2- 172.21.15.153:0/2799781574 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac9c0cb390 0x7fac9c1423b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.081+0000 7faca16e0700 1 -- 172.21.15.153:0/2799781574 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac98009ae0 con 0x7fac9c0b14a0 2024-08-17T02:29:32.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.081+0000 7faca16e0700 1 --2- 172.21.15.153:0/2799781574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac9c0b14a0 0x7fac9c167cf0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fac8c00c790 tx=0x7fac8c007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.081+0000 7fac917fa700 1 -- 172.21.15.153:0/2799781574 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8c011590 con 0x7fac9c0b14a0 2024-08-17T02:29:32.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.081+0000 7fac917fa700 1 -- 172.21.15.153:0/2799781574 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac8c011710 con 0x7fac9c0b14a0 2024-08-17T02:29:32.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.081+0000 7fac917fa700 1 -- 172.21.15.153:0/2799781574 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8c011ad0 con 0x7fac9c0b14a0 2024-08-17T02:29:32.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.081+0000 7faca26e2700 1 -- 172.21.15.153:0/2799781574 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac9c168f80 con 0x7fac9c0b14a0 2024-08-17T02:29:32.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.081+0000 7faca26e2700 1 -- 172.21.15.153:0/2799781574 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac9c169540 con 0x7fac9c0b14a0 2024-08-17T02:29:32.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.081+0000 7faca26e2700 1 -- 172.21.15.153:0/2799781574 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac9c169760 con 0x7fac9c0b14a0 2024-08-17T02:29:32.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.085+0000 7fac917fa700 1 -- 172.21.15.153:0/2799781574 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fac8c01b3b0 con 0x7fac9c0b14a0 2024-08-17T02:29:32.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.085+0000 7fac917fa700 1 --2- 172.21.15.153:0/2799781574 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fac88060860 0x7fac88062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.085+0000 7fac917fa700 1 -- 172.21.15.153:0/2799781574 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fac8c07bcc0 con 0x7fac9c0b14a0 2024-08-17T02:29:32.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.085+0000 7faca0edf700 1 --2- 172.21.15.153:0/2799781574 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fac88060860 0x7fac88062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.085+0000 7faca0edf700 1 --2- 172.21.15.153:0/2799781574 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fac88060860 0x7fac88062d10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fac9c0b18a0 tx=0x7fac98017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.089+0000 7fac917fa700 1 -- 172.21.15.153:0/2799781574 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fac8c04c3b0 con 0x7fac9c0b14a0 2024-08-17T02:29:32.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.253+0000 7faca26e2700 1 -- 172.21.15.153:0/2799781574 --> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fac9c0643a0 con 0x7fac88060860 2024-08-17T02:29:32.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.253+0000 7fac917fa700 1 -- 172.21.15.153:0/2799781574 <== mgr.4104 v2:172.21.15.153:6832/24147 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fac9c0643a0 con 0x7fac88060860 2024-08-17T02:29:32.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.257+0000 7faca26e2700 1 -- 172.21.15.153:0/2799781574 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fac88060860 msgr2=0x7fac88062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.257+0000 7faca26e2700 1 --2- 172.21.15.153:0/2799781574 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fac88060860 0x7fac88062d10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fac9c0b18a0 tx=0x7fac98017000 comp rx=0 tx=0).stop 2024-08-17T02:29:32.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.257+0000 7faca26e2700 1 -- 172.21.15.153:0/2799781574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac9c0b14a0 msgr2=0x7fac9c167cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.257+0000 7faca26e2700 1 --2- 172.21.15.153:0/2799781574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac9c0b14a0 0x7fac9c167cf0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fac8c00c790 tx=0x7fac8c007f40 comp rx=0 tx=0).stop 2024-08-17T02:29:32.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.257+0000 7faca26e2700 1 -- 172.21.15.153:0/2799781574 shutdown_connections 2024-08-17T02:29:32.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.257+0000 7faca26e2700 1 --2- 172.21.15.153:0/2799781574 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fac88060860 0x7fac88062d10 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.257+0000 7faca26e2700 1 --2- 172.21.15.153:0/2799781574 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fac9c154900 0x7fac9c166a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.257+0000 7faca26e2700 1 --2- 172.21.15.153:0/2799781574 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac9c0cb390 0x7fac9c1423b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.257+0000 7faca26e2700 1 --2- 172.21.15.153:0/2799781574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac9c0b14a0 0x7fac9c167cf0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.257+0000 7faca26e2700 1 -- 172.21.15.153:0/2799781574 >> 172.21.15.153:0/2799781574 conn(0x7fac9c0678d0 msgr2=0x7fac9c063060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:32.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.257+0000 7faca26e2700 1 -- 172.21.15.153:0/2799781574 shutdown_connections 2024-08-17T02:29:32.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.257+0000 7faca26e2700 1 -- 172.21.15.153:0/2799781574 wait complete. 2024-08-17T02:29:32.261 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 4 to deep-scrub 2024-08-17T02:29:32.271 INFO:tasks.ceph:Scrubbing osd.5 2024-08-17T02:29:32.272 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:29:32.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.381+0000 7ff9fcb73700 1 Processor -- start 2024-08-17T02:29:32.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.385+0000 7ff9fcb73700 1 -- start start 2024-08-17T02:29:32.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.385+0000 7ff9fcb73700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff9f80b2e90 0x7ff9f80c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.385+0000 7ff9fcb73700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff9f80cded0 0x7ff9f80ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.385+0000 7ff9fcb73700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9f80c5b40 con 0x7ff9f80b26d0 2024-08-17T02:29:32.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.385+0000 7ff9fcb73700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9f80b3310 con 0x7ff9f80b2e90 2024-08-17T02:29:32.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.385+0000 7ff9fcb73700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f80b2aa0 con 0x7ff9f80cded0 2024-08-17T02:29:32.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.385+0000 7ff9f6ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff9f80b2e90 0x7ff9f80c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.385+0000 7ff9f6ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff9f80b2e90 0x7ff9f80c66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47752/0 (socket says 172.21.15.153:47752) 2024-08-17T02:29:32.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.385+0000 7ff9f6ffd700 1 -- 172.21.15.153:0/4197760756 learned_addr learned my addr 172.21.15.153:0/4197760756 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:32.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.385+0000 7ff9f77fe700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7ff9f80b26d0 0x7ff9f80c5fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.153:53546/0 (socket says 172.21.15.153:53546) 2024-08-17T02:29:32.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.385+0000 7ff9f7fff700 1 --2- 172.21.15.153:0/4197760756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff9f80cded0 0x7ff9f80ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.385+0000 7ff9f6ffd700 1 -- 172.21.15.153:0/4197760756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff9f80cded0 msgr2=0x7ff9f80ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:32.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.385+0000 7ff9f6ffd700 1 --2- 172.21.15.153:0/4197760756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff9f80cded0 0x7ff9f80ce350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.385+0000 7ff9f67fc700 1 -- 172.21.15.153:0/4197760756 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3262975122 0 0) 0x7ff9f80c5b40 con 0x7ff9f80b26d0 2024-08-17T02:29:32.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.385+0000 7ff9f6ffd700 1 -- 172.21.15.153:0/4197760756 >> v1:172.21.15.174:6789/0 conn(0x7ff9f80b26d0 legacy=0x7ff9f80c5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.385+0000 7ff9f6ffd700 1 -- 172.21.15.153:0/4197760756 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f8159820 con 0x7ff9f80b2e90 2024-08-17T02:29:32.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.385+0000 7ff9f6ffd700 1 --2- 172.21.15.153:0/4197760756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9f80b2e90 0x7ff9f80c66e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00099c0 tx=0x7ff9e0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a432129f195860 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.385+0000 7ff9f67fc700 1 -- 172.21.15.153:0/4197760756 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0005c10 con 0x7ff9f80b2e90 2024-08-17T02:29:32.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.385+0000 7ff9f67fc700 1 -- 172.21.15.153:0/4197760756 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e0005d70 con 0x7ff9f80b2e90 2024-08-17T02:29:32.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.385+0000 7ff9f67fc700 1 -- 172.21.15.153:0/4197760756 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e000b840 con 0x7ff9f80b2e90 2024-08-17T02:29:32.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.385+0000 7ff9fcb73700 1 -- 172.21.15.153:0/4197760756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9f80b2e90 msgr2=0x7ff9f80c66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.385+0000 7ff9fcb73700 1 --2- 172.21.15.153:0/4197760756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9f80b2e90 0x7ff9f80c66e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00099c0 tx=0x7ff9e0009220 comp rx=0 tx=0).stop 2024-08-17T02:29:32.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.385+0000 7ff9fcb73700 1 -- 172.21.15.153:0/4197760756 shutdown_connections 2024-08-17T02:29:32.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.385+0000 7ff9fcb73700 1 --2- 172.21.15.153:0/4197760756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff9f80cded0 0x7ff9f80ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.385+0000 7ff9fcb73700 1 --2- 172.21.15.153:0/4197760756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9f80b2e90 0x7ff9f80c66e0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.385+0000 7ff9fcb73700 1 -- 172.21.15.153:0/4197760756 >> 172.21.15.153:0/4197760756 conn(0x7ff9f8067590 msgr2=0x7ff9f80d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:32.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.385+0000 7ff9fcb73700 1 -- 172.21.15.153:0/4197760756 shutdown_connections 2024-08-17T02:29:32.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.385+0000 7ff9fcb73700 1 -- 172.21.15.153:0/4197760756 wait complete. 2024-08-17T02:29:32.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.389+0000 7ff9fcb73700 1 Processor -- start 2024-08-17T02:29:32.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.389+0000 7ff9fcb73700 1 -- start start 2024-08-17T02:29:32.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.389+0000 7ff9fcb73700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff9f80b26d0 0x7ff9f8162f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.389+0000 7ff9fcb73700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff9f80b2e90 0x7ff9f8151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.389+0000 7ff9fcb73700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9f80cded0 0x7ff9f816a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.389+0000 7ff9fcb73700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f816c710 con 0x7ff9f80cded0 2024-08-17T02:29:32.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.389+0000 7ff9fcb73700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f8169680 con 0x7ff9f80b2e90 2024-08-17T02:29:32.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.389+0000 7ff9fcb73700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f8169960 con 0x7ff9f80b26d0 2024-08-17T02:29:32.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.389+0000 7ff9f7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9f80cded0 0x7ff9f816a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.389+0000 7ff9f7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9f80cded0 0x7ff9f816a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47768/0 (socket says 172.21.15.153:47768) 2024-08-17T02:29:32.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.389+0000 7ff9f7fff700 1 -- 172.21.15.153:0/431572124 learned_addr learned my addr 172.21.15.153:0/431572124 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:32.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.389+0000 7ff9f77fe700 1 --2- 172.21.15.153:0/431572124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff9f80b26d0 0x7ff9f8162f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.389+0000 7ff9f6ffd700 1 --2- 172.21.15.153:0/431572124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff9f80b2e90 0x7ff9f8151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.389+0000 7ff9f7fff700 1 -- 172.21.15.153:0/431572124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff9f80b26d0 msgr2=0x7ff9f8162f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.389+0000 7ff9f7fff700 1 --2- 172.21.15.153:0/431572124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff9f80b26d0 0x7ff9f8162f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.389+0000 7ff9f7fff700 1 -- 172.21.15.153:0/431572124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff9f80b2e90 msgr2=0x7ff9f8151a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.389+0000 7ff9f7fff700 1 --2- 172.21.15.153:0/431572124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff9f80b2e90 0x7ff9f8151a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.389+0000 7ff9f7fff700 1 -- 172.21.15.153:0/431572124 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e0009480 con 0x7ff9f80cded0 2024-08-17T02:29:32.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.389+0000 7ff9f6ffd700 1 --2- 172.21.15.153:0/431572124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff9f80b2e90 0x7ff9f8151a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:32.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.389+0000 7ff9f7fff700 1 --2- 172.21.15.153:0/431572124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9f80cded0 0x7ff9f816a610 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8009e90 tx=0x7ff9e800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.389+0000 7ff9ef7fe700 1 -- 172.21.15.153:0/431572124 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e800cc20 con 0x7ff9f80cded0 2024-08-17T02:29:32.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.389+0000 7ff9fcb73700 1 -- 172.21.15.153:0/431572124 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9f8169c40 con 0x7ff9f80cded0 2024-08-17T02:29:32.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.389+0000 7ff9ef7fe700 1 -- 172.21.15.153:0/431572124 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e800f040 con 0x7ff9f80cded0 2024-08-17T02:29:32.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.389+0000 7ff9fcb73700 1 -- 172.21.15.153:0/431572124 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f8163440 con 0x7ff9f80cded0 2024-08-17T02:29:32.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.389+0000 7ff9ef7fe700 1 -- 172.21.15.153:0/431572124 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8014480 con 0x7ff9f80cded0 2024-08-17T02:29:32.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.393+0000 7ff9ef7fe700 1 -- 172.21.15.153:0/431572124 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff9e8014830 con 0x7ff9f80cded0 2024-08-17T02:29:32.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.393+0000 7ff9fcb73700 1 -- 172.21.15.153:0/431572124 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff9f80644b0 con 0x7ff9f80cded0 2024-08-17T02:29:32.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.393+0000 7ff9ef7fe700 1 --2- 172.21.15.153:0/431572124 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff9d8060860 0x7ff9d8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.393+0000 7ff9ef7fe700 1 -- 172.21.15.153:0/431572124 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7ff9e807d410 con 0x7ff9f80cded0 2024-08-17T02:29:32.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.393+0000 7ff9f77fe700 1 --2- 172.21.15.153:0/431572124 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff9d8060860 0x7ff9d8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.393+0000 7ff9ef7fe700 1 --2- 172.21.15.153:0/431572124 >> [v2:172.21.15.174:6824/24457,v1:172.21.15.174:6825/24457] conn(0x7ff9d8066750 0x7ff9d8068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.393+0000 7ff9ef7fe700 1 -- 172.21.15.153:0/431572124 --> [v2:172.21.15.174:6824/24457,v1:172.21.15.174:6825/24457] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff9d8069210 con 0x7ff9d8066750 2024-08-17T02:29:32.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.393+0000 7ff9ef7fe700 1 -- 172.21.15.153:0/431572124 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9e807fa50 con 0x7ff9f80cded0 2024-08-17T02:29:32.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.393+0000 7ff9f6ffd700 1 --2- 172.21.15.153:0/431572124 >> [v2:172.21.15.174:6824/24457,v1:172.21.15.174:6825/24457] conn(0x7ff9d8066750 0x7ff9d8068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.393+0000 7ff9f77fe700 1 --2- 172.21.15.153:0/431572124 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff9d8060860 0x7ff9d8062d10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff9f80b6090 tx=0x7ff9f0007ef0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.393+0000 7ff9f6ffd700 1 --2- 172.21.15.153:0/431572124 >> [v2:172.21.15.174:6824/24457,v1:172.21.15.174:6825/24457] conn(0x7ff9d8066750 0x7ff9d8068b60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.397+0000 7ff9ef7fe700 1 -- 172.21.15.153:0/431572124 <== osd.5 v2:172.21.15.174:6824/24457 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7ff9d8069210 con 0x7ff9d8066750 2024-08-17T02:29:32.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.413+0000 7ff9fcb73700 1 -- 172.21.15.153:0/431572124 --> [v2:172.21.15.174:6824/24457,v1:172.21.15.174:6825/24457] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff9f816a0c0 con 0x7ff9d8066750 2024-08-17T02:29:32.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.413+0000 7ff9ef7fe700 1 -- 172.21.15.153:0/431572124 <== osd.5 v2:172.21.15.174:6824/24457 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ff9e0000bc0 con 0x7ff9d8066750 2024-08-17T02:29:32.418 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-08-17T02:29:32.418 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:29:32.418 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-08-17T02:29:32.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.413+0000 7ff9fcb73700 1 -- 172.21.15.153:0/431572124 >> [v2:172.21.15.174:6824/24457,v1:172.21.15.174:6825/24457] conn(0x7ff9d8066750 msgr2=0x7ff9d8068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.413+0000 7ff9fcb73700 1 --2- 172.21.15.153:0/431572124 >> [v2:172.21.15.174:6824/24457,v1:172.21.15.174:6825/24457] conn(0x7ff9d8066750 0x7ff9d8068b60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.413+0000 7ff9fcb73700 1 -- 172.21.15.153:0/431572124 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff9d8060860 msgr2=0x7ff9d8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.413+0000 7ff9fcb73700 1 --2- 172.21.15.153:0/431572124 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7ff9d8060860 0x7ff9d8062d10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff9f80b6090 tx=0x7ff9f0007ef0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.413+0000 7ff9fcb73700 1 -- 172.21.15.153:0/431572124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9f80cded0 msgr2=0x7ff9f816a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.413+0000 7ff9fcb73700 1 --2- 172.21.15.153:0/431572124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9f80cded0 0x7ff9f816a610 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8009e90 tx=0x7ff9e800b040 comp rx=0 tx=0).stop 2024-08-17T02:29:32.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.413+0000 7ff9f7fff700 1 -- 172.21.15.153:0/431572124 reap_dead start 2024-08-17T02:29:32.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.413+0000 7ff9fcb73700 1 -- 172.21.15.153:0/431572124 shutdown_connections 2024-08-17T02:29:32.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.413+0000 7ff9fcb73700 1 -- 172.21.15.153:0/431572124 >> 172.21.15.153:0/431572124 conn(0x7ff9f8067590 msgr2=0x7ff9f8068a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:32.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.417+0000 7ff9fcb73700 1 -- 172.21.15.153:0/431572124 shutdown_connections 2024-08-17T02:29:32.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.417+0000 7ff9fcb73700 1 -- 172.21.15.153:0/431572124 wait complete. 2024-08-17T02:29:32.436 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-08-17T02:29:32.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.549+0000 7fd4b2155700 1 Processor -- start 2024-08-17T02:29:32.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.549+0000 7fd4b2155700 1 -- start start 2024-08-17T02:29:32.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.549+0000 7fd4b2155700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4ac0cd1b0 0x7fd4ac1536f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.549+0000 7fd4b2155700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4ac15a5f0 con 0x7fd4ac15a190 2024-08-17T02:29:32.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.549+0000 7fd4b2155700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4ac15dbd0 con 0x7fd4ac153320 2024-08-17T02:29:32.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.549+0000 7fd4b2155700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac0ce430 con 0x7fd4ac0cd1b0 2024-08-17T02:29:32.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.549+0000 7fd4b1954700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fd4ac15a190 0x7fd4ac0ce880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43828/0 (socket says 172.21.15.153:43828) 2024-08-17T02:29:32.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.549+0000 7fd4b1954700 1 -- 172.21.15.153:0/1537617140 learned_addr learned my addr 172.21.15.153:0/1537617140 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:29:32.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.549+0000 7fd4b0952700 1 --2- 172.21.15.153:0/1537617140 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4ac0cd1b0 0x7fd4ac1536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.549+0000 7fd4a3fff700 1 -- 172.21.15.153:0/1537617140 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3537343092 0 0) 0x7fd4ac15a5f0 con 0x7fd4ac15a190 2024-08-17T02:29:32.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.549+0000 7fd4a3fff700 1 -- 172.21.15.153:0/1537617140 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd494003570 con 0x7fd4ac15a190 2024-08-17T02:29:32.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.549+0000 7fd4a3fff700 1 -- 172.21.15.153:0/1537617140 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4131510922 0 0) 0x7fd4ac15dbd0 con 0x7fd4ac153320 2024-08-17T02:29:32.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.549+0000 7fd4a3fff700 1 -- 172.21.15.153:0/1537617140 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4ac15a5f0 con 0x7fd4ac153320 2024-08-17T02:29:32.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.549+0000 7fd4a3fff700 1 -- 172.21.15.153:0/1537617140 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 142105384 0 0) 0x7fd494003570 con 0x7fd4ac15a190 2024-08-17T02:29:32.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.549+0000 7fd4b0952700 1 -- 172.21.15.153:0/1537617140 >> v1:172.21.15.174:6789/0 conn(0x7fd4ac153320 legacy=0x7fd4ac0ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.549+0000 7fd4b0952700 1 -- 172.21.15.153:0/1537617140 >> v1:172.21.15.153:6789/0 conn(0x7fd4ac15a190 legacy=0x7fd4ac0ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.549+0000 7fd4b0952700 1 -- 172.21.15.153:0/1537617140 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ac15d370 con 0x7fd4ac0cd1b0 2024-08-17T02:29:32.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.553+0000 7fd4b0952700 1 --2- 172.21.15.153:0/1537617140 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4ac0cd1b0 0x7fd4ac1536f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8009910 tx=0x7fd4a80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6664e91a3c7560ca server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.553+0000 7fd4a3fff700 1 -- 172.21.15.153:0/1537617140 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a40017f0 con 0x7fd4ac0cd1b0 2024-08-17T02:29:32.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.553+0000 7fd4a3fff700 1 -- 172.21.15.153:0/1537617140 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a8011420 con 0x7fd4ac0cd1b0 2024-08-17T02:29:32.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.553+0000 7fd4a3fff700 1 -- 172.21.15.153:0/1537617140 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a80117a0 con 0x7fd4ac0cd1b0 2024-08-17T02:29:32.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.553+0000 7fd4b2155700 1 -- 172.21.15.153:0/1537617140 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4ac0cd1b0 msgr2=0x7fd4ac1536f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.553+0000 7fd4b2155700 1 --2- 172.21.15.153:0/1537617140 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4ac0cd1b0 0x7fd4ac1536f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8009910 tx=0x7fd4a80091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.553+0000 7fd4b2155700 1 -- 172.21.15.153:0/1537617140 shutdown_connections 2024-08-17T02:29:32.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.553+0000 7fd4b2155700 1 --2- 172.21.15.153:0/1537617140 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4ac0cd1b0 0x7fd4ac1536f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.553+0000 7fd4b2155700 1 -- 172.21.15.153:0/1537617140 >> 172.21.15.153:0/1537617140 conn(0x7fd4ac0d00a0 msgr2=0x7fd4ac0d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:32.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.553+0000 7fd4b2155700 1 -- 172.21.15.153:0/1537617140 shutdown_connections 2024-08-17T02:29:32.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.553+0000 7fd4b2155700 1 -- 172.21.15.153:0/1537617140 wait complete. 2024-08-17T02:29:32.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.553+0000 7fd4b2155700 1 Processor -- start 2024-08-17T02:29:32.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.553+0000 7fd4b2155700 1 -- start start 2024-08-17T02:29:32.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.557+0000 7fd4b2155700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4ac0cd1b0 0x7fd4ac140390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.557+0000 7fd4b2155700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4ac153320 0x7fd4ac0c98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.557+0000 7fd4b2155700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4ac15a190 0x7fd4ac16c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.557+0000 7fd4b2155700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac16a590 con 0x7fd4ac15a190 2024-08-17T02:29:32.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.557+0000 7fd4b2155700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac0affc0 con 0x7fd4ac0cd1b0 2024-08-17T02:29:32.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.557+0000 7fd4b2155700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac0c71f0 con 0x7fd4ac153320 2024-08-17T02:29:32.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.557+0000 7fd4b1954700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4ac15a190 0x7fd4ac16c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.557+0000 7fd4b1954700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4ac15a190 0x7fd4ac16c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47776/0 (socket says 172.21.15.153:47776) 2024-08-17T02:29:32.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.557+0000 7fd4b1954700 1 -- 172.21.15.153:0/3886657992 learned_addr learned my addr 172.21.15.153:0/3886657992 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:32.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.557+0000 7fd4b0952700 1 --2- 172.21.15.153:0/3886657992 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4ac153320 0x7fd4ac0c98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.557+0000 7fd4b1153700 1 --2- 172.21.15.153:0/3886657992 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4ac0cd1b0 0x7fd4ac140390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.557+0000 7fd4b1954700 1 -- 172.21.15.153:0/3886657992 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4ac153320 msgr2=0x7fd4ac0c98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.557+0000 7fd4b1954700 1 --2- 172.21.15.153:0/3886657992 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4ac153320 0x7fd4ac0c98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.557+0000 7fd4b1954700 1 -- 172.21.15.153:0/3886657992 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4ac0cd1b0 msgr2=0x7fd4ac140390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.557+0000 7fd4b1954700 1 --2- 172.21.15.153:0/3886657992 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4ac0cd1b0 0x7fd4ac140390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.557+0000 7fd4b1954700 1 -- 172.21.15.153:0/3886657992 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a8009420 con 0x7fd4ac15a190 2024-08-17T02:29:32.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.557+0000 7fd4b1954700 1 --2- 172.21.15.153:0/3886657992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4ac15a190 0x7fd4ac16c9c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd4a400cbf0 tx=0x7fd4a4007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.557+0000 7fd4a17fa700 1 -- 172.21.15.153:0/3886657992 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a4004e20 con 0x7fd4ac15a190 2024-08-17T02:29:32.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.557+0000 7fd4a17fa700 1 -- 172.21.15.153:0/3886657992 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a400a5d0 con 0x7fd4ac15a190 2024-08-17T02:29:32.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.557+0000 7fd4b2155700 1 -- 172.21.15.153:0/3886657992 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4ac0c74d0 con 0x7fd4ac15a190 2024-08-17T02:29:32.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.557+0000 7fd4a17fa700 1 -- 172.21.15.153:0/3886657992 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a400a990 con 0x7fd4ac15a190 2024-08-17T02:29:32.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.557+0000 7fd4b2155700 1 -- 172.21.15.153:0/3886657992 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4ac0afc50 con 0x7fd4ac15a190 2024-08-17T02:29:32.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.561+0000 7fd4b2155700 1 -- 172.21.15.153:0/3886657992 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4ac153760 con 0x7fd4ac15a190 2024-08-17T02:29:32.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.561+0000 7fd4a17fa700 1 -- 172.21.15.153:0/3886657992 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd4a400ad00 con 0x7fd4ac15a190 2024-08-17T02:29:32.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.561+0000 7fd4a17fa700 1 --2- 172.21.15.153:0/3886657992 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd498060860 0x7fd498062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.561+0000 7fd4a17fa700 1 -- 172.21.15.153:0/3886657992 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fd4a407c330 con 0x7fd4ac15a190 2024-08-17T02:29:32.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.561+0000 7fd4b1153700 1 --2- 172.21.15.153:0/3886657992 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd498060860 0x7fd498062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.561+0000 7fd4b1153700 1 --2- 172.21.15.153:0/3886657992 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd498060860 0x7fd498062d10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd49c007fd0 tx=0x7fd49c007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.573+0000 7fd4a17fa700 1 -- 172.21.15.153:0/3886657992 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd4ac153760 con 0x7fd4ac15a190 2024-08-17T02:29:32.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.737+0000 7fd4b2155700 1 -- 172.21.15.153:0/3886657992 --> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4ac153760 con 0x7fd498060860 2024-08-17T02:29:32.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.737+0000 7fd4a17fa700 1 -- 172.21.15.153:0/3886657992 <== mgr.4104 v2:172.21.15.153:6832/24147 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd4ac153760 con 0x7fd498060860 2024-08-17T02:29:32.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.741+0000 7fd4b2155700 1 -- 172.21.15.153:0/3886657992 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd498060860 msgr2=0x7fd498062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.741+0000 7fd4b2155700 1 --2- 172.21.15.153:0/3886657992 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd498060860 0x7fd498062d10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd49c007fd0 tx=0x7fd49c007d50 comp rx=0 tx=0).stop 2024-08-17T02:29:32.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.741+0000 7fd4b2155700 1 -- 172.21.15.153:0/3886657992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4ac15a190 msgr2=0x7fd4ac16c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.741+0000 7fd4b2155700 1 --2- 172.21.15.153:0/3886657992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4ac15a190 0x7fd4ac16c9c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd4a400cbf0 tx=0x7fd4a4007c70 comp rx=0 tx=0).stop 2024-08-17T02:29:32.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.741+0000 7fd4b2155700 1 -- 172.21.15.153:0/3886657992 shutdown_connections 2024-08-17T02:29:32.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.741+0000 7fd4b2155700 1 --2- 172.21.15.153:0/3886657992 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fd498060860 0x7fd498062d10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.741+0000 7fd4b2155700 1 --2- 172.21.15.153:0/3886657992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4ac15a190 0x7fd4ac16c9c0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.741+0000 7fd4b2155700 1 --2- 172.21.15.153:0/3886657992 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4ac153320 0x7fd4ac0c98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.741+0000 7fd4b2155700 1 --2- 172.21.15.153:0/3886657992 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4ac0cd1b0 0x7fd4ac140390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.741+0000 7fd4b2155700 1 -- 172.21.15.153:0/3886657992 >> 172.21.15.153:0/3886657992 conn(0x7fd4ac0d00a0 msgr2=0x7fd4ac0cf440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:32.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.741+0000 7fd4b2155700 1 -- 172.21.15.153:0/3886657992 shutdown_connections 2024-08-17T02:29:32.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.741+0000 7fd4b2155700 1 -- 172.21.15.153:0/3886657992 wait complete. 2024-08-17T02:29:32.745 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 5 to deep-scrub 2024-08-17T02:29:32.758 INFO:tasks.ceph:Scrubbing osd.6 2024-08-17T02:29:32.758 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:29:32.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.873+0000 7fe252b33700 1 Processor -- start 2024-08-17T02:29:32.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.873+0000 7fe252b33700 1 -- start start 2024-08-17T02:29:32.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.877+0000 7fe252b33700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe24c069600 0x7fe24c069a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.877+0000 7fe252b33700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe24c067fa0 0x7fe24c068420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.877+0000 7fe252b33700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe24c067b10 con 0x7fe24c159140 2024-08-17T02:29:32.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.877+0000 7fe252b33700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe24c0b1b30 con 0x7fe24c069600 2024-08-17T02:29:32.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.877+0000 7fe252b33700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c159510 con 0x7fe24c067fa0 2024-08-17T02:29:32.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.877+0000 7fe251330700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe24c069600 0x7fe24c069a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.877+0000 7fe251330700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe24c069600 0x7fe24c069a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47782/0 (socket says 172.21.15.153:47782) 2024-08-17T02:29:32.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.877+0000 7fe251b31700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fe24c159140 0x7fe24c0b0d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43832/0 (socket says 172.21.15.153:43832) 2024-08-17T02:29:32.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.877+0000 7fe251330700 1 -- 172.21.15.153:0/452983452 learned_addr learned my addr 172.21.15.153:0/452983452 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:32.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.877+0000 7fe252332700 1 --2- 172.21.15.153:0/452983452 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe24c067fa0 0x7fe24c068420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.877+0000 7fe251330700 1 -- 172.21.15.153:0/452983452 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe24c067fa0 msgr2=0x7fe24c068420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:32.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.877+0000 7fe251330700 1 --2- 172.21.15.153:0/452983452 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe24c067fa0 0x7fe24c068420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.877+0000 7fe251330700 1 -- 172.21.15.153:0/452983452 >> v1:172.21.15.153:6789/0 conn(0x7fe24c159140 legacy=0x7fe24c0b0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.877+0000 7fe251330700 1 -- 172.21.15.153:0/452983452 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe24c069f70 con 0x7fe24c069600 2024-08-17T02:29:32.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.877+0000 7fe251330700 1 --2- 172.21.15.153:0/452983452 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe24c069600 0x7fe24c069a30 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe2480099e0 tx=0x7fe248009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e66b0dd16689ff server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.877+0000 7fe250b2f700 1 -- 172.21.15.153:0/452983452 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24800b820 con 0x7fe24c069600 2024-08-17T02:29:32.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.877+0000 7fe250b2f700 1 -- 172.21.15.153:0/452983452 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24800b980 con 0x7fe24c069600 2024-08-17T02:29:32.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.877+0000 7fe250b2f700 1 -- 172.21.15.153:0/452983452 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24800bd20 con 0x7fe24c069600 2024-08-17T02:29:32.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.877+0000 7fe252b33700 1 -- 172.21.15.153:0/452983452 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe24c069600 msgr2=0x7fe24c069a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.877+0000 7fe252b33700 1 --2- 172.21.15.153:0/452983452 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe24c069600 0x7fe24c069a30 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe2480099e0 tx=0x7fe248009250 comp rx=0 tx=0).stop 2024-08-17T02:29:32.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.877+0000 7fe252b33700 1 -- 172.21.15.153:0/452983452 shutdown_connections 2024-08-17T02:29:32.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.877+0000 7fe252b33700 1 --2- 172.21.15.153:0/452983452 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe24c067fa0 0x7fe24c068420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.877+0000 7fe252b33700 1 --2- 172.21.15.153:0/452983452 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe24c069600 0x7fe24c069a30 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.877+0000 7fe252b33700 1 -- 172.21.15.153:0/452983452 >> 172.21.15.153:0/452983452 conn(0x7fe24c06a700 msgr2=0x7fe24c0aeb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:32.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.877+0000 7fe252b33700 1 -- 172.21.15.153:0/452983452 shutdown_connections 2024-08-17T02:29:32.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.877+0000 7fe252b33700 1 -- 172.21.15.153:0/452983452 wait complete. 2024-08-17T02:29:32.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.881+0000 7fe252b33700 1 Processor -- start 2024-08-17T02:29:32.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.881+0000 7fe252b33700 1 -- start start 2024-08-17T02:29:32.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.881+0000 7fe252b33700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe24c067fa0 0x7fe24c15a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.881+0000 7fe252b33700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe24c069600 0x7fe24c0adf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.881+0000 7fe252b33700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe24c159140 0x7fe24c169630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.881+0000 7fe252b33700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c0acef0 con 0x7fe24c069600 2024-08-17T02:29:32.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.881+0000 7fe252b33700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c0ad1d0 con 0x7fe24c067fa0 2024-08-17T02:29:32.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.881+0000 7fe252b33700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c0ad4b0 con 0x7fe24c159140 2024-08-17T02:29:32.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.881+0000 7fe251330700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe24c069600 0x7fe24c0adf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.881+0000 7fe251330700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe24c069600 0x7fe24c0adf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47784/0 (socket says 172.21.15.153:47784) 2024-08-17T02:29:32.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.881+0000 7fe251330700 1 -- 172.21.15.153:0/3476784325 learned_addr learned my addr 172.21.15.153:0/3476784325 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:32.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.881+0000 7fe251b31700 1 --2- 172.21.15.153:0/3476784325 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe24c067fa0 0x7fe24c15a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.881+0000 7fe252332700 1 --2- 172.21.15.153:0/3476784325 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe24c159140 0x7fe24c169630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.885+0000 7fe251330700 1 -- 172.21.15.153:0/3476784325 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe24c159140 msgr2=0x7fe24c169630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.885+0000 7fe251330700 1 --2- 172.21.15.153:0/3476784325 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe24c159140 0x7fe24c169630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.885+0000 7fe251330700 1 -- 172.21.15.153:0/3476784325 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe24c067fa0 msgr2=0x7fe24c15a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.885+0000 7fe251330700 1 --2- 172.21.15.153:0/3476784325 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe24c067fa0 0x7fe24c15a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.885+0000 7fe251330700 1 -- 172.21.15.153:0/3476784325 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2480094f0 con 0x7fe24c069600 2024-08-17T02:29:32.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.885+0000 7fe251330700 1 --2- 172.21.15.153:0/3476784325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe24c069600 0x7fe24c0adf90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe248009290 tx=0x7fe248017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.885+0000 7fe241ffb700 1 -- 172.21.15.153:0/3476784325 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe248011d10 con 0x7fe24c069600 2024-08-17T02:29:32.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.885+0000 7fe241ffb700 1 -- 172.21.15.153:0/3476784325 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe248011e90 con 0x7fe24c069600 2024-08-17T02:29:32.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.885+0000 7fe252b33700 1 -- 172.21.15.153:0/3476784325 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe24c0ad790 con 0x7fe24c069600 2024-08-17T02:29:32.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.885+0000 7fe241ffb700 1 -- 172.21.15.153:0/3476784325 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2480266a0 con 0x7fe24c069600 2024-08-17T02:29:32.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.885+0000 7fe252b33700 1 -- 172.21.15.153:0/3476784325 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe24c15a7f0 con 0x7fe24c069600 2024-08-17T02:29:32.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.885+0000 7fe252b33700 1 -- 172.21.15.153:0/3476784325 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe24c15a9e0 con 0x7fe24c069600 2024-08-17T02:29:32.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.885+0000 7fe241ffb700 1 -- 172.21.15.153:0/3476784325 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe24801a420 con 0x7fe24c069600 2024-08-17T02:29:32.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.889+0000 7fe241ffb700 1 --2- 172.21.15.153:0/3476784325 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fe230060860 0x7fe230062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.889+0000 7fe241ffb700 1 -- 172.21.15.153:0/3476784325 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fe24807e420 con 0x7fe24c069600 2024-08-17T02:29:32.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.889+0000 7fe251b31700 1 --2- 172.21.15.153:0/3476784325 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fe230060860 0x7fe230062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.889+0000 7fe241ffb700 1 --2- 172.21.15.153:0/3476784325 >> [v2:172.21.15.174:6800/24477,v1:172.21.15.174:6801/24477] conn(0x7fe230066750 0x7fe230068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.889+0000 7fe241ffb700 1 -- 172.21.15.153:0/3476784325 --> [v2:172.21.15.174:6800/24477,v1:172.21.15.174:6801/24477] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe230069210 con 0x7fe230066750 2024-08-17T02:29:32.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.889+0000 7fe241ffb700 1 -- 172.21.15.153:0/3476784325 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe248080a60 con 0x7fe24c069600 2024-08-17T02:29:32.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.889+0000 7fe252332700 1 --2- 172.21.15.153:0/3476784325 >> [v2:172.21.15.174:6800/24477,v1:172.21.15.174:6801/24477] conn(0x7fe230066750 0x7fe230068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.889+0000 7fe251b31700 1 --2- 172.21.15.153:0/3476784325 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fe230060860 0x7fe230062d10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe23c004fd0 tx=0x7fe23c007eb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.889+0000 7fe252332700 1 --2- 172.21.15.153:0/3476784325 >> [v2:172.21.15.174:6800/24477,v1:172.21.15.174:6801/24477] conn(0x7fe230066750 0x7fe230068b60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.889+0000 7fe241ffb700 1 -- 172.21.15.153:0/3476784325 <== osd.6 v2:172.21.15.174:6800/24477 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fe230069210 con 0x7fe230066750 2024-08-17T02:29:32.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.909+0000 7fe252b33700 1 -- 172.21.15.153:0/3476784325 --> [v2:172.21.15.174:6800/24477,v1:172.21.15.174:6801/24477] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe24c0644b0 con 0x7fe230066750 2024-08-17T02:29:32.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.909+0000 7fe241ffb700 1 -- 172.21.15.153:0/3476784325 <== osd.6 v2:172.21.15.174:6800/24477 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe24c0644b0 con 0x7fe230066750 2024-08-17T02:29:32.912 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-08-17T02:29:32.912 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:29:32.913 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-08-17T02:29:32.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.909+0000 7fe252b33700 1 -- 172.21.15.153:0/3476784325 >> [v2:172.21.15.174:6800/24477,v1:172.21.15.174:6801/24477] conn(0x7fe230066750 msgr2=0x7fe230068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.909+0000 7fe252b33700 1 --2- 172.21.15.153:0/3476784325 >> [v2:172.21.15.174:6800/24477,v1:172.21.15.174:6801/24477] conn(0x7fe230066750 0x7fe230068b60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.909+0000 7fe252b33700 1 -- 172.21.15.153:0/3476784325 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fe230060860 msgr2=0x7fe230062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.909+0000 7fe252b33700 1 --2- 172.21.15.153:0/3476784325 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fe230060860 0x7fe230062d10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe23c004fd0 tx=0x7fe23c007eb0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.909+0000 7fe252b33700 1 -- 172.21.15.153:0/3476784325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe24c069600 msgr2=0x7fe24c0adf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.909+0000 7fe252b33700 1 --2- 172.21.15.153:0/3476784325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe24c069600 0x7fe24c0adf90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe248009290 tx=0x7fe248017000 comp rx=0 tx=0).stop 2024-08-17T02:29:32.915 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.909+0000 7fe252332700 1 -- 172.21.15.153:0/3476784325 reap_dead start 2024-08-17T02:29:32.915 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.909+0000 7fe252b33700 1 -- 172.21.15.153:0/3476784325 shutdown_connections 2024-08-17T02:29:32.915 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.909+0000 7fe252b33700 1 -- 172.21.15.153:0/3476784325 >> 172.21.15.153:0/3476784325 conn(0x7fe24c06a700 msgr2=0x7fe24c1556a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:32.915 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.909+0000 7fe252b33700 1 -- 172.21.15.153:0/3476784325 shutdown_connections 2024-08-17T02:29:32.915 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:32.909+0000 7fe252b33700 1 -- 172.21.15.153:0/3476784325 wait complete. 2024-08-17T02:29:32.925 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-08-17T02:29:33.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.029+0000 7f21af0d9700 1 Processor -- start 2024-08-17T02:29:33.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.029+0000 7f21af0d9700 1 -- start start 2024-08-17T02:29:33.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.029+0000 7f21af0d9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f21a806e680 0x7f21a806ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.029+0000 7f21af0d9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f21a80ac490 0x7f21a8159940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.036 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.029+0000 7f21af0d9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21a815a8e0 con 0x7f21a8159e80 2024-08-17T02:29:33.036 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.029+0000 7f21af0d9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a815a600 con 0x7f21a80ac490 2024-08-17T02:29:33.036 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.029+0000 7f21af0d9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a80ab9b0 con 0x7f21a806e680 2024-08-17T02:29:33.036 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.029+0000 7f21a7fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f21a80ac490 0x7f21a8159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.036 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.029+0000 7f21ad676700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f21a8159e80 0x7f21a80ade10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43840/0 (socket says 172.21.15.153:43840) 2024-08-17T02:29:33.036 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.033+0000 7f21ad676700 1 -- 172.21.15.153:0/723189689 learned_addr learned my addr 172.21.15.153:0/723189689 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:29:33.036 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.033+0000 7f21ace75700 1 --2- 172.21.15.153:0/723189689 >> v2:172.21.15.174:3300/0 conn(0x7f21a806e680 0x7f21a806ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.033+0000 7f21a77fe700 1 -- 172.21.15.153:0/723189689 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1902317868 0 0) 0x7f21a815a8e0 con 0x7f21a8159e80 2024-08-17T02:29:33.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.033+0000 7f21a77fe700 1 -- 172.21.15.153:0/723189689 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2194003570 con 0x7f21a8159e80 2024-08-17T02:29:33.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.033+0000 7f21a7fff700 1 -- 172.21.15.153:0/723189689 >> v2:172.21.15.174:3300/0 conn(0x7f21a806e680 msgr2=0x7f21a806ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:33.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.033+0000 7f21a7fff700 1 --2- 172.21.15.153:0/723189689 >> v2:172.21.15.174:3300/0 conn(0x7f21a806e680 0x7f21a806ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.033+0000 7f21a7fff700 1 -- 172.21.15.153:0/723189689 >> v1:172.21.15.153:6789/0 conn(0x7f21a8159e80 legacy=0x7f21a80ade10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.033+0000 7f21a7fff700 1 -- 172.21.15.153:0/723189689 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a80abc90 con 0x7f21a80ac490 2024-08-17T02:29:33.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.033+0000 7f21ace75700 1 --2- 172.21.15.153:0/723189689 >> v2:172.21.15.174:3300/0 conn(0x7f21a806e680 0x7f21a806ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:33.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.033+0000 7f21a7fff700 1 --2- 172.21.15.153:0/723189689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21a80ac490 0x7f21a8159940 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f21a806fbc0 tx=0x7f2198009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbcc885cf2e9cfb5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:33.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.033+0000 7f21a77fe700 1 -- 172.21.15.153:0/723189689 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219800e070 con 0x7f21a80ac490 2024-08-17T02:29:33.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.033+0000 7f21a77fe700 1 -- 172.21.15.153:0/723189689 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219800bb60 con 0x7f21a80ac490 2024-08-17T02:29:33.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.033+0000 7f21a77fe700 1 -- 172.21.15.153:0/723189689 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2198012430 con 0x7f21a80ac490 2024-08-17T02:29:33.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.033+0000 7f21af0d9700 1 -- 172.21.15.153:0/723189689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21a80ac490 msgr2=0x7f21a8159940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.033+0000 7f21af0d9700 1 --2- 172.21.15.153:0/723189689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21a80ac490 0x7f21a8159940 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f21a806fbc0 tx=0x7f2198009780 comp rx=0 tx=0).stop 2024-08-17T02:29:33.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.033+0000 7f21af0d9700 1 -- 172.21.15.153:0/723189689 shutdown_connections 2024-08-17T02:29:33.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.033+0000 7f21af0d9700 1 --2- 172.21.15.153:0/723189689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21a80ac490 0x7f21a8159940 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.033+0000 7f21af0d9700 1 --2- 172.21.15.153:0/723189689 >> v2:172.21.15.174:3300/0 conn(0x7f21a806e680 0x7f21a806ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.033+0000 7f21af0d9700 1 -- 172.21.15.153:0/723189689 >> 172.21.15.153:0/723189689 conn(0x7f21a8067810 msgr2=0x7f21a8067c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:33.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.033+0000 7f21af0d9700 1 -- 172.21.15.153:0/723189689 shutdown_connections 2024-08-17T02:29:33.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.033+0000 7f21af0d9700 1 -- 172.21.15.153:0/723189689 wait complete. 2024-08-17T02:29:33.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.037+0000 7f21af0d9700 1 Processor -- start 2024-08-17T02:29:33.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.037+0000 7f21af0d9700 1 -- start start 2024-08-17T02:29:33.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.037+0000 7f21af0d9700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21a806e680 0x7f21a80b0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.037+0000 7f21af0d9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21a80ac490 0x7f21a814da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.037+0000 7f21af0d9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21a8159e80 0x7f21a815b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.037+0000 7f21af0d9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a80b15d0 con 0x7f21a80ac490 2024-08-17T02:29:33.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.037+0000 7f21af0d9700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a80b09c0 con 0x7f21a806e680 2024-08-17T02:29:33.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.037+0000 7f21af0d9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a80b0ca0 con 0x7f21a8159e80 2024-08-17T02:29:33.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.037+0000 7f21a7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21a80ac490 0x7f21a814da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.037+0000 7f21ace75700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21a806e680 0x7f21a80b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.037+0000 7f21a7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21a80ac490 0x7f21a814da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47800/0 (socket says 172.21.15.153:47800) 2024-08-17T02:29:33.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.037+0000 7f21a7fff700 1 -- 172.21.15.153:0/974442690 learned_addr learned my addr 172.21.15.153:0/974442690 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:33.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.037+0000 7f21ad676700 1 --2- 172.21.15.153:0/974442690 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21a8159e80 0x7f21a815b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.037+0000 7f21a7fff700 1 -- 172.21.15.153:0/974442690 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21a8159e80 msgr2=0x7f21a815b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.037+0000 7f21a7fff700 1 --2- 172.21.15.153:0/974442690 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21a8159e80 0x7f21a815b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.037+0000 7f21a7fff700 1 -- 172.21.15.153:0/974442690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21a806e680 msgr2=0x7f21a80b0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.037+0000 7f21a7fff700 1 --2- 172.21.15.153:0/974442690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21a806e680 0x7f21a80b0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.037+0000 7f21a7fff700 1 -- 172.21.15.153:0/974442690 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2198009a20 con 0x7f21a80ac490 2024-08-17T02:29:33.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.037+0000 7f21a7fff700 1 --2- 172.21.15.153:0/974442690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21a80ac490 0x7f21a814da00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f21980097c0 tx=0x7f2198019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:33.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.037+0000 7f21a4ff9700 1 -- 172.21.15.153:0/974442690 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2198012c50 con 0x7f21a80ac490 2024-08-17T02:29:33.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.037+0000 7f21a4ff9700 1 -- 172.21.15.153:0/974442690 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2198012df0 con 0x7f21a80ac490 2024-08-17T02:29:33.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.037+0000 7f21af0d9700 1 -- 172.21.15.153:0/974442690 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21a80b0f80 con 0x7f21a80ac490 2024-08-17T02:29:33.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.037+0000 7f21a4ff9700 1 -- 172.21.15.153:0/974442690 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21980276c0 con 0x7f21a80ac490 2024-08-17T02:29:33.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.037+0000 7f21af0d9700 1 -- 172.21.15.153:0/974442690 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21a80b06d0 con 0x7f21a80ac490 2024-08-17T02:29:33.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.041+0000 7f21af0d9700 1 -- 172.21.15.153:0/974442690 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21a80645c0 con 0x7f21a80ac490 2024-08-17T02:29:33.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.041+0000 7f21a4ff9700 1 -- 172.21.15.153:0/974442690 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2198024070 con 0x7f21a80ac490 2024-08-17T02:29:33.046 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.041+0000 7f21a4ff9700 1 --2- 172.21.15.153:0/974442690 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2188060860 0x7f2188062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.046 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.041+0000 7f21ace75700 1 --2- 172.21.15.153:0/974442690 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2188060860 0x7f2188062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.046 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.041+0000 7f21a4ff9700 1 -- 172.21.15.153:0/974442690 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f219807edd0 con 0x7f21a80ac490 2024-08-17T02:29:33.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.045+0000 7f21ace75700 1 --2- 172.21.15.153:0/974442690 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2188060860 0x7f2188062d10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2190006f00 tx=0x7f2190008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:33.054 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.049+0000 7f21a4ff9700 1 -- 172.21.15.153:0/974442690 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f219804f420 con 0x7f21a80ac490 2024-08-17T02:29:33.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.213+0000 7f21af0d9700 1 -- 172.21.15.153:0/974442690 --> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f21a80aae50 con 0x7f2188060860 2024-08-17T02:29:33.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.213+0000 7f21a4ff9700 1 -- 172.21.15.153:0/974442690 <== mgr.4104 v2:172.21.15.153:6832/24147 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f21a80aae50 con 0x7f2188060860 2024-08-17T02:29:33.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.217+0000 7f21af0d9700 1 -- 172.21.15.153:0/974442690 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2188060860 msgr2=0x7f2188062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.217+0000 7f21af0d9700 1 --2- 172.21.15.153:0/974442690 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2188060860 0x7f2188062d10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2190006f00 tx=0x7f2190008040 comp rx=0 tx=0).stop 2024-08-17T02:29:33.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.217+0000 7f21af0d9700 1 -- 172.21.15.153:0/974442690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21a80ac490 msgr2=0x7f21a814da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.217+0000 7f21af0d9700 1 --2- 172.21.15.153:0/974442690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21a80ac490 0x7f21a814da00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f21980097c0 tx=0x7f2198019000 comp rx=0 tx=0).stop 2024-08-17T02:29:33.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.217+0000 7f21af0d9700 1 -- 172.21.15.153:0/974442690 shutdown_connections 2024-08-17T02:29:33.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.217+0000 7f21af0d9700 1 --2- 172.21.15.153:0/974442690 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2188060860 0x7f2188062d10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.217+0000 7f21af0d9700 1 --2- 172.21.15.153:0/974442690 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21a8159e80 0x7f21a815b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.217+0000 7f21af0d9700 1 --2- 172.21.15.153:0/974442690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21a80ac490 0x7f21a814da00 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.217+0000 7f21af0d9700 1 --2- 172.21.15.153:0/974442690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21a806e680 0x7f21a80b0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.217+0000 7f21af0d9700 1 -- 172.21.15.153:0/974442690 >> 172.21.15.153:0/974442690 conn(0x7f21a8067810 msgr2=0x7f21a8158ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:33.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.217+0000 7f21af0d9700 1 -- 172.21.15.153:0/974442690 shutdown_connections 2024-08-17T02:29:33.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.217+0000 7f21af0d9700 1 -- 172.21.15.153:0/974442690 wait complete. 2024-08-17T02:29:33.223 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 6 to deep-scrub 2024-08-17T02:29:33.232 INFO:tasks.ceph:Scrubbing osd.7 2024-08-17T02:29:33.233 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:29:33.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.345+0000 7f2e26f26700 1 Processor -- start 2024-08-17T02:29:33.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.345+0000 7f2e26f26700 1 -- start start 2024-08-17T02:29:33.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.345+0000 7f2e26f26700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e200c6160 0x7f2e200caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.345+0000 7f2e26f26700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2e200cb3f0 0x7f2e200ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.345+0000 7f2e26f26700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e200cc480 con 0x7f2e200cd2b0 2024-08-17T02:29:33.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.345+0000 7f2e26f26700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e20159720 con 0x7f2e200cb3f0 2024-08-17T02:29:33.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.345+0000 7f2e26f26700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e200cb870 con 0x7f2e200c6160 2024-08-17T02:29:33.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.345+0000 7f2e24cc2700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f2e200cd2b0 0x7f2e200cd680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43852/0 (socket says 172.21.15.153:43852) 2024-08-17T02:29:33.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.345+0000 7f2e24cc2700 1 -- 172.21.15.153:0/2463759405 learned_addr learned my addr 172.21.15.153:0/2463759405 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:29:33.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.345+0000 7f2e254c3700 1 --2- 172.21.15.153:0/2463759405 >> v2:172.21.15.153:3300/0 conn(0x7f2e200cb3f0 0x7f2e200ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.345+0000 7f2e1ffff700 1 --2- 172.21.15.153:0/2463759405 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e200c6160 0x7f2e200caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.345+0000 7f2e1f7fe700 1 -- 172.21.15.153:0/2463759405 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1108130103 0 0) 0x7f2e200cc480 con 0x7f2e200cd2b0 2024-08-17T02:29:33.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.345+0000 7f2e1f7fe700 1 -- 172.21.15.153:0/2463759405 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e10003570 con 0x7f2e200cd2b0 2024-08-17T02:29:33.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.345+0000 7f2e254c3700 1 -- 172.21.15.153:0/2463759405 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e200c6160 msgr2=0x7f2e200caeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:33.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.345+0000 7f2e254c3700 1 --2- 172.21.15.153:0/2463759405 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e200c6160 0x7f2e200caeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.345+0000 7f2e254c3700 1 -- 172.21.15.153:0/2463759405 >> v1:172.21.15.153:6789/0 conn(0x7f2e200cd2b0 legacy=0x7f2e200cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.345+0000 7f2e254c3700 1 -- 172.21.15.153:0/2463759405 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e200cbb50 con 0x7f2e200cb3f0 2024-08-17T02:29:33.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.345+0000 7f2e254c3700 1 --2- 172.21.15.153:0/2463759405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e200cb3f0 0x7f2e200ce460 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f2e18009e60 tx=0x7f2e18009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca1315d42db32b0c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:33.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.345+0000 7f2e1f7fe700 1 -- 172.21.15.153:0/2463759405 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1800e070 con 0x7f2e200cb3f0 2024-08-17T02:29:33.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.345+0000 7f2e1f7fe700 1 -- 172.21.15.153:0/2463759405 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e1800bab0 con 0x7f2e200cb3f0 2024-08-17T02:29:33.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.345+0000 7f2e1f7fe700 1 -- 172.21.15.153:0/2463759405 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1800be70 con 0x7f2e200cb3f0 2024-08-17T02:29:33.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.349+0000 7f2e26f26700 1 -- 172.21.15.153:0/2463759405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e200cb3f0 msgr2=0x7f2e200ce460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.349+0000 7f2e26f26700 1 --2- 172.21.15.153:0/2463759405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e200cb3f0 0x7f2e200ce460 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f2e18009e60 tx=0x7f2e18009780 comp rx=0 tx=0).stop 2024-08-17T02:29:33.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.349+0000 7f2e26f26700 1 -- 172.21.15.153:0/2463759405 shutdown_connections 2024-08-17T02:29:33.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.349+0000 7f2e26f26700 1 --2- 172.21.15.153:0/2463759405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e200cb3f0 0x7f2e200ce460 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.349+0000 7f2e26f26700 1 --2- 172.21.15.153:0/2463759405 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e200c6160 0x7f2e200caeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.349+0000 7f2e26f26700 1 -- 172.21.15.153:0/2463759405 >> 172.21.15.153:0/2463759405 conn(0x7f2e20099550 msgr2=0x7f2e20067590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:33.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.349+0000 7f2e26f26700 1 -- 172.21.15.153:0/2463759405 shutdown_connections 2024-08-17T02:29:33.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.349+0000 7f2e26f26700 1 -- 172.21.15.153:0/2463759405 wait complete. 2024-08-17T02:29:33.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.349+0000 7f2e26f26700 1 Processor -- start 2024-08-17T02:29:33.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.349+0000 7f2e26f26700 1 -- start start 2024-08-17T02:29:33.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.349+0000 7f2e26f26700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e200c6160 0x7f2e200b05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.349+0000 7f2e26f26700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e200cd2b0 0x7f2e20068b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.349+0000 7f2e26f26700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e200690d0 0x7f2e201564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.349+0000 7f2e26f26700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e200b1b00 con 0x7f2e200690d0 2024-08-17T02:29:33.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.349+0000 7f2e26f26700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e200b0ef0 con 0x7f2e200cd2b0 2024-08-17T02:29:33.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.349+0000 7f2e26f26700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e200b11d0 con 0x7f2e200c6160 2024-08-17T02:29:33.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.349+0000 7f2e254c3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e200690d0 0x7f2e201564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.349+0000 7f2e254c3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e200690d0 0x7f2e201564f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47826/0 (socket says 172.21.15.153:47826) 2024-08-17T02:29:33.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.349+0000 7f2e254c3700 1 -- 172.21.15.153:0/1534183406 learned_addr learned my addr 172.21.15.153:0/1534183406 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:33.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.349+0000 7f2e24cc2700 1 --2- 172.21.15.153:0/1534183406 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e200c6160 0x7f2e200b05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.349+0000 7f2e1ffff700 1 --2- 172.21.15.153:0/1534183406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e200cd2b0 0x7f2e20068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.349+0000 7f2e254c3700 1 -- 172.21.15.153:0/1534183406 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e200c6160 msgr2=0x7f2e200b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.349+0000 7f2e254c3700 1 --2- 172.21.15.153:0/1534183406 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e200c6160 0x7f2e200b05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.349+0000 7f2e254c3700 1 -- 172.21.15.153:0/1534183406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e200cd2b0 msgr2=0x7f2e20068b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.349+0000 7f2e254c3700 1 --2- 172.21.15.153:0/1534183406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e200cd2b0 0x7f2e20068b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.349+0000 7f2e254c3700 1 -- 172.21.15.153:0/1534183406 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e18009a20 con 0x7f2e200690d0 2024-08-17T02:29:33.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.349+0000 7f2e254c3700 1 --2- 172.21.15.153:0/1534183406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e200690d0 0x7f2e201564f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f2e18013000 tx=0x7f2e18019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:33.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.349+0000 7f2e1cff9700 1 -- 172.21.15.153:0/1534183406 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e18012e10 con 0x7f2e200690d0 2024-08-17T02:29:33.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.349+0000 7f2e1cff9700 1 -- 172.21.15.153:0/1534183406 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e18027470 con 0x7f2e200690d0 2024-08-17T02:29:33.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.349+0000 7f2e26f26700 1 -- 172.21.15.153:0/1534183406 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e200b14b0 con 0x7f2e200690d0 2024-08-17T02:29:33.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.349+0000 7f2e1cff9700 1 -- 172.21.15.153:0/1534183406 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e18027830 con 0x7f2e200690d0 2024-08-17T02:29:33.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.349+0000 7f2e26f26700 1 -- 172.21.15.153:0/1534183406 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e200b0ae0 con 0x7f2e200690d0 2024-08-17T02:29:33.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.353+0000 7f2e26f26700 1 -- 172.21.15.153:0/1534183406 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2e200b3510 con 0x7f2e200690d0 2024-08-17T02:29:33.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.353+0000 7f2e1cff9700 1 -- 172.21.15.153:0/1534183406 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2e18024070 con 0x7f2e200690d0 2024-08-17T02:29:33.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.353+0000 7f2e1cff9700 1 --2- 172.21.15.153:0/1534183406 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2e04060860 0x7f2e04062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.353+0000 7f2e1cff9700 1 -- 172.21.15.153:0/1534183406 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f2e1807f340 con 0x7f2e200690d0 2024-08-17T02:29:33.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.353+0000 7f2e24cc2700 1 --2- 172.21.15.153:0/1534183406 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2e04060860 0x7f2e04062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.353+0000 7f2e1cff9700 1 --2- 172.21.15.153:0/1534183406 >> [v2:172.21.15.174:6816/24455,v1:172.21.15.174:6817/24455] conn(0x7f2e04066750 0x7f2e04068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.353+0000 7f2e1cff9700 1 -- 172.21.15.153:0/1534183406 --> [v2:172.21.15.174:6816/24455,v1:172.21.15.174:6817/24455] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2e04069210 con 0x7f2e04066750 2024-08-17T02:29:33.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.353+0000 7f2e1cff9700 1 -- 172.21.15.153:0/1534183406 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e180818a0 con 0x7f2e200690d0 2024-08-17T02:29:33.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.353+0000 7f2e24cc2700 1 --2- 172.21.15.153:0/1534183406 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2e04060860 0x7f2e04062d10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2e14007fd0 tx=0x7f2e14009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:33.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.353+0000 7f2e1ffff700 1 --2- 172.21.15.153:0/1534183406 >> [v2:172.21.15.174:6816/24455,v1:172.21.15.174:6817/24455] conn(0x7f2e04066750 0x7f2e04068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.357+0000 7f2e1ffff700 1 --2- 172.21.15.153:0/1534183406 >> [v2:172.21.15.174:6816/24455,v1:172.21.15.174:6817/24455] conn(0x7f2e04066750 0x7f2e04068b60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:33.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.357+0000 7f2e1cff9700 1 -- 172.21.15.153:0/1534183406 <== osd.7 v2:172.21.15.174:6816/24455 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f2e04069210 con 0x7f2e04066750 2024-08-17T02:29:33.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.373+0000 7f2e26f26700 1 -- 172.21.15.153:0/1534183406 --> [v2:172.21.15.174:6816/24455,v1:172.21.15.174:6817/24455] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2e200638f0 con 0x7f2e04066750 2024-08-17T02:29:33.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.373+0000 7f2e1cff9700 1 -- 172.21.15.153:0/1534183406 <== osd.7 v2:172.21.15.174:6816/24455 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f2e200638f0 con 0x7f2e04066750 2024-08-17T02:29:33.377 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-08-17T02:29:33.377 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:29:33.377 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-08-17T02:29:33.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.373+0000 7f2e26f26700 1 -- 172.21.15.153:0/1534183406 >> [v2:172.21.15.174:6816/24455,v1:172.21.15.174:6817/24455] conn(0x7f2e04066750 msgr2=0x7f2e04068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.373+0000 7f2e26f26700 1 --2- 172.21.15.153:0/1534183406 >> [v2:172.21.15.174:6816/24455,v1:172.21.15.174:6817/24455] conn(0x7f2e04066750 0x7f2e04068b60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.373+0000 7f2e26f26700 1 -- 172.21.15.153:0/1534183406 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2e04060860 msgr2=0x7f2e04062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.373+0000 7f2e26f26700 1 --2- 172.21.15.153:0/1534183406 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f2e04060860 0x7f2e04062d10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2e14007fd0 tx=0x7f2e14009040 comp rx=0 tx=0).stop 2024-08-17T02:29:33.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.373+0000 7f2e26f26700 1 -- 172.21.15.153:0/1534183406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e200690d0 msgr2=0x7f2e201564f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.373+0000 7f2e26f26700 1 --2- 172.21.15.153:0/1534183406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e200690d0 0x7f2e201564f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f2e18013000 tx=0x7f2e18019000 comp rx=0 tx=0).stop 2024-08-17T02:29:33.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.373+0000 7f2e254c3700 1 -- 172.21.15.153:0/1534183406 reap_dead start 2024-08-17T02:29:33.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.373+0000 7f2e26f26700 1 -- 172.21.15.153:0/1534183406 shutdown_connections 2024-08-17T02:29:33.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.373+0000 7f2e26f26700 1 -- 172.21.15.153:0/1534183406 >> 172.21.15.153:0/1534183406 conn(0x7f2e20099550 msgr2=0x7f2e200c6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:33.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.373+0000 7f2e26f26700 1 -- 172.21.15.153:0/1534183406 shutdown_connections 2024-08-17T02:29:33.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.373+0000 7f2e26f26700 1 -- 172.21.15.153:0/1534183406 wait complete. 2024-08-17T02:29:33.390 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-08-17T02:29:33.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.497+0000 7fb86de93700 1 Processor -- start 2024-08-17T02:29:33.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.497+0000 7fb86de93700 1 -- start start 2024-08-17T02:29:33.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.501+0000 7fb86de93700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb868068ca0 0x7fb868158af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.501+0000 7fb86de93700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8680aa300 con 0x7fb8680688d0 2024-08-17T02:29:33.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.501+0000 7fb86de93700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8680aa5e0 con 0x7fb868159030 2024-08-17T02:29:33.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.501+0000 7fb86de93700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8680aa8c0 con 0x7fb868068ca0 2024-08-17T02:29:33.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.501+0000 7fb86ce91700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb8680688d0 0x7fb8680a9860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43856/0 (socket says 172.21.15.153:43856) 2024-08-17T02:29:33.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.501+0000 7fb86ce91700 1 -- 172.21.15.153:0/3989816231 learned_addr learned my addr 172.21.15.153:0/3989816231 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:29:33.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.501+0000 7fb867fff700 1 --2- 172.21.15.153:0/3989816231 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb868068ca0 0x7fb868158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.501+0000 7fb8677fe700 1 -- 172.21.15.153:0/3989816231 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2847021228 0 0) 0x7fb8680aa300 con 0x7fb8680688d0 2024-08-17T02:29:33.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.501+0000 7fb867fff700 1 -- 172.21.15.153:0/3989816231 >> v1:172.21.15.174:6789/0 conn(0x7fb868159030 legacy=0x7fb8680ab3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.501+0000 7fb867fff700 1 -- 172.21.15.153:0/3989816231 >> v1:172.21.15.153:6789/0 conn(0x7fb8680688d0 legacy=0x7fb8680a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.501+0000 7fb867fff700 1 -- 172.21.15.153:0/3989816231 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8680aaba0 con 0x7fb868068ca0 2024-08-17T02:29:33.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.501+0000 7fb867fff700 1 --2- 172.21.15.153:0/3989816231 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb868068ca0 0x7fb868158af0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb850009e10 tx=0x7fb850009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac09c4ce3a8b0b34 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:33.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.501+0000 7fb8677fe700 1 -- 172.21.15.153:0/3989816231 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85000e070 con 0x7fb868068ca0 2024-08-17T02:29:33.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.501+0000 7fb8677fe700 1 -- 172.21.15.153:0/3989816231 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85000bbb0 con 0x7fb868068ca0 2024-08-17T02:29:33.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.501+0000 7fb8677fe700 1 -- 172.21.15.153:0/3989816231 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb850012430 con 0x7fb868068ca0 2024-08-17T02:29:33.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.501+0000 7fb86de93700 1 -- 172.21.15.153:0/3989816231 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb868068ca0 msgr2=0x7fb868158af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.501+0000 7fb86de93700 1 --2- 172.21.15.153:0/3989816231 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb868068ca0 0x7fb868158af0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb850009e10 tx=0x7fb850009780 comp rx=0 tx=0).stop 2024-08-17T02:29:33.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.501+0000 7fb86de93700 1 -- 172.21.15.153:0/3989816231 shutdown_connections 2024-08-17T02:29:33.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.501+0000 7fb86de93700 1 --2- 172.21.15.153:0/3989816231 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb868068ca0 0x7fb868158af0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.501+0000 7fb86de93700 1 -- 172.21.15.153:0/3989816231 >> 172.21.15.153:0/3989816231 conn(0x7fb86806d790 msgr2=0x7fb86806db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:33.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.501+0000 7fb86de93700 1 -- 172.21.15.153:0/3989816231 shutdown_connections 2024-08-17T02:29:33.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.501+0000 7fb86de93700 1 -- 172.21.15.153:0/3989816231 wait complete. 2024-08-17T02:29:33.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.505+0000 7fb86de93700 1 Processor -- start 2024-08-17T02:29:33.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.505+0000 7fb86de93700 1 -- start start 2024-08-17T02:29:33.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.505+0000 7fb86de93700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8680688d0 0x7fb86814fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.505+0000 7fb86de93700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb868068ca0 0x7fb86813e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.505+0000 7fb86de93700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb868159030 0x7fb86815a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.505+0000 7fb86de93700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8680af980 con 0x7fb868068ca0 2024-08-17T02:29:33.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.505+0000 7fb86de93700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8680b04c0 con 0x7fb8680688d0 2024-08-17T02:29:33.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.505+0000 7fb86de93700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8680afb90 con 0x7fb868159030 2024-08-17T02:29:33.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.505+0000 7fb867fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb868068ca0 0x7fb86813e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.505+0000 7fb867fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb868068ca0 0x7fb86813e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47838/0 (socket says 172.21.15.153:47838) 2024-08-17T02:29:33.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.505+0000 7fb867fff700 1 -- 172.21.15.153:0/884912685 learned_addr learned my addr 172.21.15.153:0/884912685 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:33.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.505+0000 7fb86d692700 1 --2- 172.21.15.153:0/884912685 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb868159030 0x7fb86815a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.505+0000 7fb86ce91700 1 --2- 172.21.15.153:0/884912685 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8680688d0 0x7fb86814fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.505+0000 7fb867fff700 1 -- 172.21.15.153:0/884912685 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb868159030 msgr2=0x7fb86815a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.505+0000 7fb867fff700 1 --2- 172.21.15.153:0/884912685 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb868159030 0x7fb86815a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.505+0000 7fb867fff700 1 -- 172.21.15.153:0/884912685 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8680688d0 msgr2=0x7fb86814fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.505+0000 7fb867fff700 1 --2- 172.21.15.153:0/884912685 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8680688d0 0x7fb86814fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.505+0000 7fb867fff700 1 -- 172.21.15.153:0/884912685 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb850009a20 con 0x7fb868068ca0 2024-08-17T02:29:33.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.505+0000 7fb867fff700 1 --2- 172.21.15.153:0/884912685 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb868068ca0 0x7fb86813e8a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb8500097c0 tx=0x7fb850018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:33.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.505+0000 7fb864ff9700 1 -- 172.21.15.153:0/884912685 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb850027470 con 0x7fb868068ca0 2024-08-17T02:29:33.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.505+0000 7fb864ff9700 1 -- 172.21.15.153:0/884912685 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8500275d0 con 0x7fb868068ca0 2024-08-17T02:29:33.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.505+0000 7fb86de93700 1 -- 172.21.15.153:0/884912685 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8680afe70 con 0x7fb868068ca0 2024-08-17T02:29:33.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.505+0000 7fb864ff9700 1 -- 172.21.15.153:0/884912685 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb850027990 con 0x7fb868068ca0 2024-08-17T02:29:33.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.505+0000 7fb86de93700 1 -- 172.21.15.153:0/884912685 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb86813ede0 con 0x7fb868068ca0 2024-08-17T02:29:33.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.505+0000 7fb86de93700 1 -- 172.21.15.153:0/884912685 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8680b0650 con 0x7fb868068ca0 2024-08-17T02:29:33.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.509+0000 7fb864ff9700 1 -- 172.21.15.153:0/884912685 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb850024070 con 0x7fb868068ca0 2024-08-17T02:29:33.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.509+0000 7fb864ff9700 1 --2- 172.21.15.153:0/884912685 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb848060860 0x7fb848062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.509+0000 7fb86ce91700 1 --2- 172.21.15.153:0/884912685 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb848060860 0x7fb848062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.509+0000 7fb864ff9700 1 -- 172.21.15.153:0/884912685 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fb85007f440 con 0x7fb868068ca0 2024-08-17T02:29:33.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.509+0000 7fb86ce91700 1 --2- 172.21.15.153:0/884912685 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb848060860 0x7fb848062d10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb86816d340 tx=0x7fb858009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:33.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.513+0000 7fb864ff9700 1 -- 172.21.15.153:0/884912685 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb85004fb30 con 0x7fb868068ca0 2024-08-17T02:29:33.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.677+0000 7fb86de93700 1 -- 172.21.15.153:0/884912685 --> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fb86813efd0 con 0x7fb848060860 2024-08-17T02:29:33.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.677+0000 7fb864ff9700 1 -- 172.21.15.153:0/884912685 <== mgr.4104 v2:172.21.15.153:6832/24147 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb858001460 con 0x7fb848060860 2024-08-17T02:29:33.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.677+0000 7fb86de93700 1 -- 172.21.15.153:0/884912685 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb848060860 msgr2=0x7fb848062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.677+0000 7fb86de93700 1 --2- 172.21.15.153:0/884912685 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb848060860 0x7fb848062d10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb86816d340 tx=0x7fb858009040 comp rx=0 tx=0).stop 2024-08-17T02:29:33.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.677+0000 7fb86de93700 1 -- 172.21.15.153:0/884912685 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb868068ca0 msgr2=0x7fb86813e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.677+0000 7fb86de93700 1 --2- 172.21.15.153:0/884912685 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb868068ca0 0x7fb86813e8a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb8500097c0 tx=0x7fb850018000 comp rx=0 tx=0).stop 2024-08-17T02:29:33.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.681+0000 7fb86de93700 1 -- 172.21.15.153:0/884912685 shutdown_connections 2024-08-17T02:29:33.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.681+0000 7fb86de93700 1 --2- 172.21.15.153:0/884912685 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fb848060860 0x7fb848062d10 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.681+0000 7fb86de93700 1 --2- 172.21.15.153:0/884912685 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb868159030 0x7fb86815a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.681+0000 7fb86de93700 1 --2- 172.21.15.153:0/884912685 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb868068ca0 0x7fb86813e8a0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.681+0000 7fb86de93700 1 --2- 172.21.15.153:0/884912685 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8680688d0 0x7fb86814fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.681+0000 7fb86de93700 1 -- 172.21.15.153:0/884912685 >> 172.21.15.153:0/884912685 conn(0x7fb86806d790 msgr2=0x7fb868063060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:33.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.681+0000 7fb86de93700 1 -- 172.21.15.153:0/884912685 shutdown_connections 2024-08-17T02:29:33.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.681+0000 7fb86de93700 1 -- 172.21.15.153:0/884912685 wait complete. 2024-08-17T02:29:33.685 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 7 to deep-scrub 2024-08-17T02:29:33.695 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:29:33.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.801+0000 7fa79b114700 1 Processor -- start 2024-08-17T02:29:33.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.801+0000 7fa79b114700 1 -- start start 2024-08-17T02:29:33.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.801+0000 7fa79b114700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa794154900 0x7fa7940b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.801+0000 7fa79b114700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7940b12d0 0x7fa7940cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.801+0000 7fa79b114700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7940cbaa0 con 0x7fa7940cb390 2024-08-17T02:29:33.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.801+0000 7fa79b114700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa794068790 con 0x7fa794154900 2024-08-17T02:29:33.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.801+0000 7fa79b114700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7941583f0 con 0x7fa7940b12d0 2024-08-17T02:29:33.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.801+0000 7fa799911700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7940b12d0 0x7fa7940cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.801+0000 7fa799911700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7940b12d0 0x7fa7940cae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.153:37154/0 (socket says 172.21.15.153:37154) 2024-08-17T02:29:33.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.801+0000 7fa799911700 1 -- 172.21.15.153:0/2537099423 learned_addr learned my addr 172.21.15.153:0/2537099423 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:33.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.801+0000 7fa79a112700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa794154900 0x7fa7940b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.801+0000 7fa79a913700 1 --1- 172.21.15.153:0/2537099423 >> v1:172.21.15.174:6789/0 conn(0x7fa7940cb390 0x7fa79406df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.153:53568/0 (socket says 172.21.15.153:53568) 2024-08-17T02:29:33.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.801+0000 7fa799911700 1 -- 172.21.15.153:0/2537099423 >> v2:172.21.15.174:3300/0 conn(0x7fa794154900 msgr2=0x7fa7940b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:33.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.801+0000 7fa799911700 1 --2- 172.21.15.153:0/2537099423 >> v2:172.21.15.174:3300/0 conn(0x7fa794154900 0x7fa7940b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.805+0000 7fa799911700 1 -- 172.21.15.153:0/2537099423 >> v1:172.21.15.174:6789/0 conn(0x7fa7940cb390 legacy=0x7fa79406df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.805+0000 7fa799911700 1 -- 172.21.15.153:0/2537099423 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7940b1700 con 0x7fa7940b12d0 2024-08-17T02:29:33.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.805+0000 7fa799911700 1 --2- 172.21.15.153:0/2537099423 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7940b12d0 0x7fa7940cae50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa7840099b0 tx=0x7fa784009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51979083a4c46acd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:33.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.805+0000 7fa799110700 1 -- 172.21.15.153:0/2537099423 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa784009ea0 con 0x7fa7940b12d0 2024-08-17T02:29:33.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.805+0000 7fa799110700 1 -- 172.21.15.153:0/2537099423 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78400b860 con 0x7fa7940b12d0 2024-08-17T02:29:33.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.805+0000 7fa799110700 1 -- 172.21.15.153:0/2537099423 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78400bc00 con 0x7fa7940b12d0 2024-08-17T02:29:33.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.805+0000 7fa79b114700 1 -- 172.21.15.153:0/2537099423 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7940b12d0 msgr2=0x7fa7940cae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.805+0000 7fa79b114700 1 --2- 172.21.15.153:0/2537099423 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7940b12d0 0x7fa7940cae50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa7840099b0 tx=0x7fa784009250 comp rx=0 tx=0).stop 2024-08-17T02:29:33.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.805+0000 7fa79b114700 1 -- 172.21.15.153:0/2537099423 shutdown_connections 2024-08-17T02:29:33.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.805+0000 7fa79b114700 1 --2- 172.21.15.153:0/2537099423 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7940b12d0 0x7fa7940cae50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.805+0000 7fa79b114700 1 --2- 172.21.15.153:0/2537099423 >> v2:172.21.15.174:3300/0 conn(0x7fa794154900 0x7fa7940b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.805+0000 7fa79b114700 1 -- 172.21.15.153:0/2537099423 >> 172.21.15.153:0/2537099423 conn(0x7fa7940678d0 msgr2=0x7fa794067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:33.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.805+0000 7fa79b114700 1 -- 172.21.15.153:0/2537099423 shutdown_connections 2024-08-17T02:29:33.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.805+0000 7fa79b114700 1 -- 172.21.15.153:0/2537099423 wait complete. 2024-08-17T02:29:33.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.805+0000 7fa79b114700 1 Processor -- start 2024-08-17T02:29:33.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.805+0000 7fa79b114700 1 -- start start 2024-08-17T02:29:33.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.809+0000 7fa79b114700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7940b12d0 0x7fa794142780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.809+0000 7fa79b114700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7940cb390 0x7fa7940a5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.809+0000 7fa79b114700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa794154900 0x7fa794155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.809+0000 7fa79b114700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa794142cc0 con 0x7fa794154900 2024-08-17T02:29:33.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.809+0000 7fa79b114700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7940a6a40 con 0x7fa7940cb390 2024-08-17T02:29:33.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.809+0000 7fa79b114700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7940a5e30 con 0x7fa7940b12d0 2024-08-17T02:29:33.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.809+0000 7fa79a913700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa794154900 0x7fa794155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.809+0000 7fa79a913700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa794154900 0x7fa794155ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47842/0 (socket says 172.21.15.153:47842) 2024-08-17T02:29:33.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.809+0000 7fa79a913700 1 -- 172.21.15.153:0/1385318844 learned_addr learned my addr 172.21.15.153:0/1385318844 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:33.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.809+0000 7fa799911700 1 --2- 172.21.15.153:0/1385318844 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7940cb390 0x7fa7940a5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.809+0000 7fa79a112700 1 --2- 172.21.15.153:0/1385318844 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7940b12d0 0x7fa794142780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.809+0000 7fa79a913700 1 -- 172.21.15.153:0/1385318844 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7940b12d0 msgr2=0x7fa794142780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.809+0000 7fa79a913700 1 --2- 172.21.15.153:0/1385318844 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7940b12d0 0x7fa794142780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.809+0000 7fa79a913700 1 -- 172.21.15.153:0/1385318844 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7940cb390 msgr2=0x7fa7940a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.809+0000 7fa79a913700 1 --2- 172.21.15.153:0/1385318844 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7940cb390 0x7fa7940a5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.809+0000 7fa79a913700 1 -- 172.21.15.153:0/1385318844 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7840094f0 con 0x7fa794154900 2024-08-17T02:29:33.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.809+0000 7fa79a913700 1 --2- 172.21.15.153:0/1385318844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa794154900 0x7fa794155ca0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa78c00cd30 tx=0x7fa78c001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:33.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.809+0000 7fa78a7fc700 1 -- 172.21.15.153:0/1385318844 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c00ce90 con 0x7fa794154900 2024-08-17T02:29:33.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.809+0000 7fa78a7fc700 1 -- 172.21.15.153:0/1385318844 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78c005df0 con 0x7fa794154900 2024-08-17T02:29:33.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.809+0000 7fa79b114700 1 -- 172.21.15.153:0/1385318844 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7940a6110 con 0x7fa794154900 2024-08-17T02:29:33.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.809+0000 7fa78a7fc700 1 -- 172.21.15.153:0/1385318844 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c00aac0 con 0x7fa794154900 2024-08-17T02:29:33.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.809+0000 7fa79b114700 1 -- 172.21.15.153:0/1385318844 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7940a66d0 con 0x7fa794154900 2024-08-17T02:29:33.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.813+0000 7fa79b114700 1 -- 172.21.15.153:0/1385318844 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7940643a0 con 0x7fa794154900 2024-08-17T02:29:33.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.813+0000 7fa78a7fc700 1 -- 172.21.15.153:0/1385318844 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa78c0070f0 con 0x7fa794154900 2024-08-17T02:29:33.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.813+0000 7fa78a7fc700 1 --2- 172.21.15.153:0/1385318844 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fa778060860 0x7fa778062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.813+0000 7fa79a112700 1 --2- 172.21.15.153:0/1385318844 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fa778060860 0x7fa778062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.813+0000 7fa78a7fc700 1 -- 172.21.15.153:0/1385318844 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fa78c07ca00 con 0x7fa794154900 2024-08-17T02:29:33.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.813+0000 7fa79a112700 1 --2- 172.21.15.153:0/1385318844 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fa778060860 0x7fa778062d10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa7940c8a20 tx=0x7fa7900091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:33.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.821+0000 7fa78a7fc700 1 -- 172.21.15.153:0/1385318844 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa78c04d0d0 con 0x7fa794154900 2024-08-17T02:29:33.986 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.981+0000 7fa79b114700 1 -- 172.21.15.153:0/1385318844 --> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa7940a6b80 con 0x7fa778060860 2024-08-17T02:29:33.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.985+0000 7fa78a7fc700 1 -- 172.21.15.153:0/1385318844 <== mgr.4104 v2:172.21.15.153:6832/24147 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49257 (secure 0 0 0) 0x7fa7940a6b80 con 0x7fa778060860 2024-08-17T02:29:33.990 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:29:33.991 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.989+0000 7fa79b114700 1 -- 172.21.15.153:0/1385318844 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fa778060860 msgr2=0x7fa778062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.991 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.989+0000 7fa79b114700 1 --2- 172.21.15.153:0/1385318844 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fa778060860 0x7fa778062d10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa7940c8a20 tx=0x7fa7900091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.991 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.989+0000 7fa79b114700 1 -- 172.21.15.153:0/1385318844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa794154900 msgr2=0x7fa794155ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.991 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.989+0000 7fa79b114700 1 --2- 172.21.15.153:0/1385318844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa794154900 0x7fa794155ca0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa78c00cd30 tx=0x7fa78c001b10 comp rx=0 tx=0).stop 2024-08-17T02:29:33.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.989+0000 7fa79b114700 1 -- 172.21.15.153:0/1385318844 shutdown_connections 2024-08-17T02:29:33.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.989+0000 7fa79b114700 1 --2- 172.21.15.153:0/1385318844 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fa778060860 0x7fa778062d10 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.989+0000 7fa79b114700 1 --2- 172.21.15.153:0/1385318844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa794154900 0x7fa794155ca0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.989+0000 7fa79b114700 1 --2- 172.21.15.153:0/1385318844 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7940cb390 0x7fa7940a5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.989+0000 7fa79b114700 1 --2- 172.21.15.153:0/1385318844 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7940b12d0 0x7fa794142780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.989+0000 7fa79b114700 1 -- 172.21.15.153:0/1385318844 >> 172.21.15.153:0/1385318844 conn(0x7fa7940678d0 msgr2=0x7fa794063060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:33.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.989+0000 7fa79b114700 1 -- 172.21.15.153:0/1385318844 shutdown_connections 2024-08-17T02:29:33.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:33.989+0000 7fa79b114700 1 -- 172.21.15.153:0/1385318844 wait complete. 2024-08-17T02:29:33.993 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-08-17T02:29:34.002 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2024-08-17T02:29:32.113758+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2392280,"kb_used_data":5096,"kb_used_omap":13,"kb_used_meta":2387058,"kb_avail":752582440,"statfs":{"total":773094113280,"available":770644418560,"internally_reserved":0,"allocated":5218304,"data_stored":2851320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2444348096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001973"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-08-17T02:29:24.542434+0000","last_change":"2024-08-17T02:26:00.033569+0000","last_active":"2024-08-17T02:29:24.542434+0000","last_peered":"2024-08-17T02:29:24.542434+0000","last_clean":"2024-08-17T02:29:24.542434+0000","last_became_active":"2024-08-17T02:26:00.031512+0000","last_became_peered":"2024-08-17T02:26:00.031512+0000","last_unstale":"2024-08-17T02:29:24.542434+0000","last_undegraded":"2024-08-17T02:29:24.542434+0000","last_fullsized":"2024-08-17T02:29:24.542434+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:58.643690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:58.643690+0000","last_clean_scrub_stamp":"2024-08-17T02:25:58.643690+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:47:24.121981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509486,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298432,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073408,"statfs":{"total":96636764160,"available":96331169792,"internally_reserved":0,"allocated":1097728,"data_stored":799191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:03 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.92500000000000004,"15min":0.94799999999999995},"min":{"1min":0.61299999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.052,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.83499999999999996,"15min":0.80900000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1599999999999999,"5min":1.165,"15min":1.165},"last":0.57999999999999996}]},{"osd":1,"last update":"Sat Aug 17 02:29:03 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.84499999999999997,"15min":0.83799999999999997},"min":{"1min":0.68600000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.012,"5min":1.268,"15min":1.268},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.90100000000000002,"15min":0.90500000000000003},"min":{"1min":0.64800000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.177,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.66900000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:29:03 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90100000000000002,"15min":0.90700000000000003},"min":{"1min":0.67900000000000005,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.103,"5min":1.357,"15min":1.357},"last":0.747},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.94999999999999996,"15min":0.93999999999999995},"min":{"1min":0.72699999999999998,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.70099999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:29:03 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.878,"15min":0.873},"min":{"1min":0.67900000000000005,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.129,"5min":1.409,"15min":1.409},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.026,"5min":1.0840000000000001,"15min":1.1120000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.2410000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.82599999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:29:03 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.93899999999999995,"15min":0.95899999999999996},"min":{"1min":0.63900000000000001,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.05,"15min":1.0509999999999999},"min":{"1min":0.94399999999999995,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.262,"5min":1.522,"15min":1.522},"last":1.0569999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:29:03 2024","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.1220000000000001,"15min":1.1479999999999999},"min":{"1min":0.70999999999999996,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.294,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.032},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1020000000000001,"15min":1.0980000000000001},"min":{"1min":0.95599999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.88700000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:29:03 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1299999999999999,"15min":1.1339999999999999},"min":{"1min":0.84599999999999997,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.534,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.999},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.149,"15min":1.151},"min":{"1min":0.95099999999999996,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.3340000000000001,"5min":1.609,"15min":1.609},"last":1.097}]}]},{"osd":6,"up_from":15,"seq":64424509486,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297848,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073992,"statfs":{"total":96636764160,"available":96331767808,"internally_reserved":0,"allocated":503808,"data_stored":208823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.877,"15min":0.86599999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.93600000000000005,"15min":0.92600000000000005},"min":{"1min":0.67800000000000005,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.25,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":1.044}]},{"osd":1,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.89700000000000002,"15min":0.88400000000000001},"min":{"1min":0.65600000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.91800000000000004,"15min":0.93000000000000005},"min":{"1min":0.69199999999999995,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.288,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.96699999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.86899999999999999,"15min":0.86199999999999999},"min":{"1min":0.65900000000000003,"5min":0.623,"15min":0.623},"max":{"1min":0.998,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.999,"5min":0.96999999999999997,"15min":0.97599999999999998},"min":{"1min":0.77000000000000002,"5min":0.627,"15min":0.627},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":1.107}]},{"osd":3,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.91300000000000003,"15min":0.90100000000000002},"min":{"1min":0.77200000000000002,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.97299999999999998,"15min":0.97999999999999998},"min":{"1min":0.79500000000000004,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.1890000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":1.133}]},{"osd":4,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.93400000000000005,"15min":0.93100000000000005},"min":{"1min":0.68200000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.3460000000000001,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.004,"5min":1.0680000000000001,"15min":1.0920000000000001},"min":{"1min":0.60099999999999998,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2749999999999999,"5min":1.472,"15min":1.472},"last":0.90600000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.99099999999999999,"15min":1.0069999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.159,"5min":1.1439999999999999,"15min":1.1419999999999999},"min":{"1min":0.91200000000000003,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.4399999999999999,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.1830000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.163,"15min":1.1759999999999999},"min":{"1min":0.94699999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.3879999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":1.236},{"interface":"front","average":{"1min":1.115,"5min":1.194,"15min":1.2250000000000001},"min":{"1min":0.91000000000000003,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.367,"5min":1.766,"15min":1.766},"last":1.2110000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509485,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297848,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073992,"statfs":{"total":96636764160,"available":96331767808,"internally_reserved":0,"allocated":503808,"data_stored":208823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.85599999999999998,"15min":0.86599999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.88400000000000001,"15min":0.86099999999999999},"min":{"1min":0.69199999999999995,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1830000000000001,"5min":1.335,"15min":1.335},"last":0.73299999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.94099999999999995,"15min":0.97099999999999997},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.133,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.111,"5min":1.268,"15min":1.268},"last":0.59499999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.91400000000000003,"15min":0.91600000000000004},"min":{"1min":0.624,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.224,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.96299999999999997,"15min":0.98899999999999999},"min":{"1min":0.72199999999999998,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.083,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.95699999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.86799999999999999,"15min":0.83599999999999997},"min":{"1min":0.69399999999999995,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.69299999999999995},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.018,"15min":1.008},"min":{"1min":0.78300000000000003,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.85099999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.92500000000000004,"15min":0.92700000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.131,"5min":1.335,"15min":1.335},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95299999999999996,"15min":0.95399999999999996},"min":{"1min":0.69499999999999995,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.252,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.82099999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.998,"15min":0.99199999999999999},"min":{"1min":0.80300000000000005,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.282,"5min":1.496,"15min":1.496},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1559999999999999,"15min":1.169},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.006}]},{"osd":7,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.0740000000000001,"15min":1.0780000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.4750000000000001,"5min":1.49,"15min":1.49},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":1.427,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.0289999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509487,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297852,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073988,"statfs":{"total":96636764160,"available":96331763712,"internally_reserved":0,"allocated":503808,"data_stored":208823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:04 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.83799999999999997,"15min":0.81599999999999995},"min":{"1min":0.60799999999999998,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.94599999999999995,"15min":0.93200000000000005},"min":{"1min":0.69199999999999995,"5min":0.625,"15min":0.625},"max":{"1min":1.1830000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.85399999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:29:04 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.94299999999999995,"15min":0.95599999999999996},"min":{"1min":0.68999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.876,"5min":0.89100000000000001,"15min":0.88500000000000001},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1299999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.0980000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:29:04 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.83199999999999996,"15min":0.81499999999999995},"min":{"1min":0.66200000000000003,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96399999999999997,"15min":0.95999999999999996},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":1.129}]},{"osd":3,"last update":"Sat Aug 17 02:29:04 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.94399999999999995,"15min":0.92800000000000005},"min":{"1min":0.72799999999999998,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.2350000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.018},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.002,"15min":0.99399999999999999},"min":{"1min":0.80700000000000005,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2649999999999999,"5min":1.516,"15min":1.516},"last":0.998}]},{"osd":5,"last update":"Sat Aug 17 02:29:04 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.016,"15min":1.0329999999999999},"min":{"1min":0.70199999999999996,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0740000000000001,"15min":1.0960000000000001},"min":{"1min":0.66100000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.292,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.80000000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:29:04 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93500000000000005,"15min":0.94099999999999995},"min":{"1min":0.73699999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.139,"5min":1.1639999999999999,"15min":1.171},"min":{"1min":1.01,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.4590000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.96999999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:29:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1379999999999999,"15min":1.149},"min":{"1min":0.79000000000000004,"5min":0.629,"15min":0.629},"max":{"1min":1.3,"5min":1.758,"15min":1.758},"last":1.173},{"interface":"front","average":{"1min":1.099,"5min":1.105,"15min":1.107},"min":{"1min":0.84899999999999998,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.2729999999999999,"5min":1.28,"15min":1.28},"last":1.048}]}]},{"osd":3,"up_from":15,"seq":64424509486,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302008,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069832,"statfs":{"total":96636764160,"available":96327507968,"internally_reserved":0,"allocated":503808,"data_stored":208823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.69599999999999995,"15min":0.71599999999999997},"min":{"1min":0.48499999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.097,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.63},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.69699999999999995,"15min":0.68200000000000005},"min":{"1min":0.52200000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.006,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.77100000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.73199999999999998,"15min":0.73799999999999999},"min":{"1min":0.52300000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89400000000000002,"5min":1.798,"15min":1.798},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.59099999999999997,"5min":0.439,"15min":0.439},"max":{"1min":1.0249999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.73999999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.93999999999999995,"15min":1.002},"min":{"1min":0.63300000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0469999999999999,"5min":7.0899999999999999,"15min":7.0899999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.89100000000000001,"15min":0.90700000000000003},"min":{"1min":0.68600000000000005,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.089,"5min":2.4409999999999998,"15min":2.4409999999999998},"last":0.95899999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.0369999999999999,"15min":1.0620000000000001},"min":{"1min":0.72999999999999998,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.2869999999999999,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.081,"5min":1.153,"15min":1.181},"min":{"1min":0.88400000000000001,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.3160000000000001,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.98299999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.044,"15min":1.0489999999999999},"min":{"1min":0.80600000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.171,"5min":1.929,"15min":1.929},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.087,"5min":1.101,"15min":1.107},"min":{"1min":0.76800000000000002,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.294,"5min":1.988,"15min":1.988},"last":0.89200000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0920000000000001,"15min":1.1240000000000001},"min":{"1min":0.83199999999999996,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.4259999999999999,"5min":2.04,"15min":2.04},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.083,"5min":1.1419999999999999,"15min":1.1639999999999999},"min":{"1min":0.90600000000000003,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.27,"5min":2.141,"15min":2.141},"last":1.032}]},{"osd":7,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.159,"15min":1.161},"min":{"1min":0.83599999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.52,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.141,"5min":1.145,"15min":1.1459999999999999},"min":{"1min":0.94399999999999995,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.48,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.05}]}]},{"osd":1,"up_from":15,"seq":64424509485,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302008,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069832,"statfs":{"total":96636764160,"available":96327507968,"internally_reserved":0,"allocated":503808,"data_stored":208823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.74099999999999999,"15min":0.77100000000000002},"min":{"1min":0.51400000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.94499999999999995,"5min":1.268,"15min":1.268},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.76200000000000001,"15min":0.76700000000000002},"min":{"1min":0.57199999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.98099999999999998,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.57999999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.73299999999999998,"15min":0.72499999999999998},"min":{"1min":0.57699999999999996,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.97399999999999998,"5min":1.01,"15min":1.01},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.82899999999999996,"15min":0.84099999999999997},"min":{"1min":0.60999999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.436}]},{"osd":3,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.86499999999999999,"15min":0.876},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.135,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.72299999999999998,"15min":0.70599999999999996},"min":{"1min":0.56799999999999995,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.64400000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":1.02,"15min":1.046},"min":{"1min":0.80000000000000004,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.1839999999999999,"5min":1.857,"15min":1.857},"last":0.71899999999999997},{"interface":"front","average":{"1min":1.044,"5min":1.125,"15min":1.157},"min":{"1min":0.875,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.325,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.77900000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.97999999999999998,"15min":1.0009999999999999},"min":{"1min":0.753,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.254,"5min":1.339,"15min":1.339},"last":0.59999999999999998},{"interface":"front","average":{"1min":1.105,"5min":1.1459999999999999,"15min":1.1759999999999999},"min":{"1min":0.88600000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.5449999999999999,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.81299999999999994}]},{"osd":6,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.2130000000000001,"15min":1.256},"min":{"1min":0.83499999999999996,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3959999999999999,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.05,"5min":1.0900000000000001,"15min":1.1060000000000001},"min":{"1min":0.93000000000000005,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":1.351,"5min":1.427,"15min":1.427},"last":0.73399999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.1459999999999999,"15min":1.1659999999999999},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.3009999999999999,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.202,"5min":1.222,"15min":1.244},"min":{"1min":0.996,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.6259999999999999,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.84399999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542190,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297852,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073988,"statfs":{"total":96636764160,"available":96331763712,"internally_reserved":0,"allocated":503808,"data_stored":208823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:07 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64000000000000001,"15min":0.63200000000000001},"min":{"1min":0.51600000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.71999999999999997,"15min":0.69599999999999995},"min":{"1min":0.57399999999999995,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.92700000000000005,"5min":1.129,"15min":1.129},"last":0.69299999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:29:12 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.71299999999999997,"15min":0.70499999999999996},"min":{"1min":0.51800000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.73799999999999999,"15min":0.70299999999999996},"min":{"1min":0.59899999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.171,"5min":1.21,"15min":1.21},"last":0.61099999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:29:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68000000000000005,"15min":0.65700000000000003},"min":{"1min":0.53400000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89900000000000002,"5min":1.25,"15min":1.25},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.86399999999999999,"15min":0.83999999999999997},"min":{"1min":0.63400000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.3120000000000001,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.92900000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:29:12 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.02,"15min":1.0149999999999999},"min":{"1min":0.75600000000000001,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.423,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.01},{"interface":"front","average":{"1min":0.96099999999999997,"5min":1.0129999999999999,"15min":1.02},"min":{"1min":0.73499999999999999,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.254,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.89800000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:29:12 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.004,"15min":1.0089999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.2769999999999999,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.294},{"interface":"front","average":{"1min":1.097,"5min":1.0880000000000001,"15min":1.0840000000000001},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.484,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.2629999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:29:12 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0880000000000001,"15min":1.1020000000000001},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.359,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.0840000000000001,"15min":1.0740000000000001},"min":{"1min":0.86099999999999999,"5min":0.749,"15min":0.749},"max":{"1min":1.377,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.2450000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:29:12 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.165,"15min":1.1739999999999999},"min":{"1min":0.86599999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.292,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.1559999999999999,"15min":1.1479999999999999},"min":{"1min":0.99199999999999999,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":1.177}]}]},{"osd":0,"up_from":14,"seq":60129542190,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298432,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073408,"statfs":{"total":96636764160,"available":96331169792,"internally_reserved":0,"allocated":1097728,"data_stored":799191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64600000000000002,"15min":0.64700000000000002},"min":{"1min":0.48399999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.74299999999999999,"15min":0.71499999999999997},"min":{"1min":0.65300000000000002,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.53200000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.65900000000000003,"15min":0.65200000000000002},"min":{"1min":0.504,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80000000000000004,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76400000000000001,"15min":0.75},"min":{"1min":0.56799999999999995,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.018,"5min":1.123,"15min":1.123},"last":0.628}]},{"osd":3,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.86099999999999999,"15min":0.82399999999999995},"min":{"1min":0.77900000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1819999999999999,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.79700000000000004,"15min":0.76700000000000002},"min":{"1min":0.60399999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.98499999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.96099999999999997,"15min":0.96699999999999997},"min":{"1min":0.69299999999999995,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0800000000000001,"5min":1.601,"15min":1.601},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.097,"15min":1.113},"min":{"1min":0.84099999999999997,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.4410000000000001,"5min":1.571,"15min":1.571},"last":1.0329999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.96299999999999997,"15min":0.97699999999999998},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.071,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.1040000000000001,"15min":1.117},"min":{"1min":0.76300000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.0529999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.0840000000000001,"15min":1.0740000000000001},"min":{"1min":0.89700000000000002,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.077,"15min":1.0880000000000001},"min":{"1min":0.82899999999999996,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.171,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.446}]},{"osd":7,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.1339999999999999,"15min":1.111},"min":{"1min":0.94999999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.103,"15min":1.0940000000000001},"min":{"1min":0.82999999999999996,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.2989999999999999,"5min":1.518,"15min":1.518},"last":1.3879999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:29:34.005 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-08-17T02:25:58.643690+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=17, tm_hour=2, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=230, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=17, tm_hour=2, tm_min=29, tm_sec=28, tm_wday=5, tm_yday=230, tm_isdst=0) 2024-08-17T02:29:34.005 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-08-17T02:29:54.006 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:29:54.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.121+0000 7f94d8e3a700 1 Processor -- start 2024-08-17T02:29:54.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.121+0000 7f94d8e3a700 1 -- start start 2024-08-17T02:29:54.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.121+0000 7f94d8e3a700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f94d4156f80 0x7f94d40ae3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.121+0000 7f94d8e3a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94d40ace80 0x7f94d4157350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.121+0000 7f94d8e3a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d40adf50 con 0x7f94d4157890 2024-08-17T02:29:54.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.121+0000 7f94d8e3a700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94d40ae920 con 0x7f94d4156f80 2024-08-17T02:29:54.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.121+0000 7f94d8e3a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d40ad340 con 0x7f94d40ace80 2024-08-17T02:29:54.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.121+0000 7f94d259c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f94d4156f80 0x7f94d40ae3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.121+0000 7f94d259c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f94d4156f80 0x7f94d40ae3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56928/0 (socket says 172.21.15.153:56928) 2024-08-17T02:29:54.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.121+0000 7f94d259c700 1 -- 172.21.15.153:0/3688510363 learned_addr learned my addr 172.21.15.153:0/3688510363 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:54.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.121+0000 7f94d1d9b700 1 --2- 172.21.15.153:0/3688510363 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94d40ace80 0x7f94d4157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.121+0000 7f94d259c700 1 -- 172.21.15.153:0/3688510363 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94d40ace80 msgr2=0x7f94d4157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:54.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.121+0000 7f94d259c700 1 --2- 172.21.15.153:0/3688510363 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94d40ace80 0x7f94d4157350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.121+0000 7f94d259c700 1 -- 172.21.15.153:0/3688510363 >> v1:172.21.15.174:6789/0 conn(0x7f94d4157890 legacy=0x7f94d40aab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.121+0000 7f94d259c700 1 -- 172.21.15.153:0/3688510363 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d40ad620 con 0x7f94d4156f80 2024-08-17T02:29:54.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.121+0000 7f94d259c700 1 --2- 172.21.15.153:0/3688510363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94d4156f80 0x7f94d40ae3e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f94c80099b0 tx=0x7f94c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca4bcd97c4215449 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:54.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.121+0000 7f94d159a700 1 -- 172.21.15.153:0/3688510363 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c8009ea0 con 0x7f94d4156f80 2024-08-17T02:29:54.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.121+0000 7f94d159a700 1 -- 172.21.15.153:0/3688510363 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c800b860 con 0x7f94d4156f80 2024-08-17T02:29:54.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.121+0000 7f94d159a700 1 -- 172.21.15.153:0/3688510363 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c800bc00 con 0x7f94d4156f80 2024-08-17T02:29:54.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.125+0000 7f94d8e3a700 1 -- 172.21.15.153:0/3688510363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94d4156f80 msgr2=0x7f94d40ae3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.125+0000 7f94d8e3a700 1 --2- 172.21.15.153:0/3688510363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94d4156f80 0x7f94d40ae3e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f94c80099b0 tx=0x7f94c8009250 comp rx=0 tx=0).stop 2024-08-17T02:29:54.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.125+0000 7f94d8e3a700 1 -- 172.21.15.153:0/3688510363 shutdown_connections 2024-08-17T02:29:54.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.125+0000 7f94d8e3a700 1 --2- 172.21.15.153:0/3688510363 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94d40ace80 0x7f94d4157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.125+0000 7f94d8e3a700 1 --2- 172.21.15.153:0/3688510363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94d4156f80 0x7f94d40ae3e0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.125+0000 7f94d8e3a700 1 -- 172.21.15.153:0/3688510363 >> 172.21.15.153:0/3688510363 conn(0x7f94d4066e00 msgr2=0x7f94d4067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:54.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.125+0000 7f94d8e3a700 1 -- 172.21.15.153:0/3688510363 shutdown_connections 2024-08-17T02:29:54.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.125+0000 7f94d8e3a700 1 -- 172.21.15.153:0/3688510363 wait complete. 2024-08-17T02:29:54.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.125+0000 7f94d8e3a700 1 Processor -- start 2024-08-17T02:29:54.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.125+0000 7f94d8e3a700 1 -- start start 2024-08-17T02:29:54.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.129+0000 7f94d8e3a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94d40ace80 0x7f94d413e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.129+0000 7f94d8e3a700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94d4156f80 0x7f94d40986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.129+0000 7f94d8e3a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94d4157890 0x7f94d4098c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.129+0000 7f94d8e3a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d4096b70 con 0x7f94d4157890 2024-08-17T02:29:54.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.129+0000 7f94d8e3a700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d4096e50 con 0x7f94d4156f80 2024-08-17T02:29:54.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.129+0000 7f94d8e3a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d4097130 con 0x7f94d40ace80 2024-08-17T02:29:54.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.129+0000 7f94d2d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94d4157890 0x7f94d4098c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.129+0000 7f94d1d9b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94d4156f80 0x7f94d40986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.129+0000 7f94d259c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94d40ace80 0x7f94d413e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.129+0000 7f94d259c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94d40ace80 0x7f94d413e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.153:45122/0 (socket says 172.21.15.153:45122) 2024-08-17T02:29:54.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.129+0000 7f94d1d9b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94d4156f80 0x7f94d40986d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.153:48986/0 (socket says 172.21.15.153:48986) 2024-08-17T02:29:54.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.129+0000 7f94d259c700 1 -- 172.21.15.153:0/3572050772 learned_addr learned my addr 172.21.15.153:0/3572050772 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:54.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.129+0000 7f94d2d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94d4157890 0x7f94d4098c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56930/0 (socket says 172.21.15.153:56930) 2024-08-17T02:29:54.135 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.129+0000 7f94d2d9d700 1 -- 172.21.15.153:0/3572050772 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94d40ace80 msgr2=0x7f94d413e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.135 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.129+0000 7f94d2d9d700 1 --2- 172.21.15.153:0/3572050772 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94d40ace80 0x7f94d413e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.129+0000 7f94d2d9d700 1 -- 172.21.15.153:0/3572050772 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94d4156f80 msgr2=0x7f94d40986d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.129+0000 7f94d2d9d700 1 --2- 172.21.15.153:0/3572050772 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94d4156f80 0x7f94d40986d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.129+0000 7f94d2d9d700 1 -- 172.21.15.153:0/3572050772 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c80094f0 con 0x7f94d4157890 2024-08-17T02:29:54.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.129+0000 7f94d2d9d700 1 --2- 172.21.15.153:0/3572050772 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94d4157890 0x7f94d4098c10 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f94d4157c80 tx=0x7f94cc0015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:54.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.129+0000 7f94c27fc700 1 -- 172.21.15.153:0/3572050772 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc011590 con 0x7f94d4157890 2024-08-17T02:29:54.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.129+0000 7f94c27fc700 1 -- 172.21.15.153:0/3572050772 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94cc011710 con 0x7f94d4157890 2024-08-17T02:29:54.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.129+0000 7f94d8e3a700 1 -- 172.21.15.153:0/3572050772 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d4097410 con 0x7f94d4157890 2024-08-17T02:29:54.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.129+0000 7f94c27fc700 1 -- 172.21.15.153:0/3572050772 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc011ad0 con 0x7f94d4157890 2024-08-17T02:29:54.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.129+0000 7f94d8e3a700 1 -- 172.21.15.153:0/3572050772 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d413ece0 con 0x7f94d4157890 2024-08-17T02:29:54.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.133+0000 7f94d8e3a700 1 -- 172.21.15.153:0/3572050772 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94d40645c0 con 0x7f94d4157890 2024-08-17T02:29:54.138 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.133+0000 7f94c27fc700 1 -- 172.21.15.153:0/3572050772 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f94cc012420 con 0x7f94d4157890 2024-08-17T02:29:54.138 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.133+0000 7f94c27fc700 1 --2- 172.21.15.153:0/3572050772 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f94b4060860 0x7f94b4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.138 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.133+0000 7f94d259c700 1 --2- 172.21.15.153:0/3572050772 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f94b4060860 0x7f94b4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.138 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.133+0000 7f94c27fc700 1 -- 172.21.15.153:0/3572050772 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f94cc07c640 con 0x7f94d4157890 2024-08-17T02:29:54.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.133+0000 7f94d259c700 1 --2- 172.21.15.153:0/3572050772 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f94b4060860 0x7f94b4062d10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f94c8009fd0 tx=0x7f94c8017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:54.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.141+0000 7f94c27fc700 1 -- 172.21.15.153:0/3572050772 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f94cc04cc90 con 0x7f94d4157890 2024-08-17T02:29:54.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.305+0000 7f94d8e3a700 1 -- 172.21.15.153:0/3572050772 --> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f94d415daa0 con 0x7f94b4060860 2024-08-17T02:29:54.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.313+0000 7f94c27fc700 1 -- 172.21.15.153:0/3572050772 <== mgr.4104 v2:172.21.15.153:6832/24147 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49141 (secure 0 0 0) 0x7f94d415daa0 con 0x7f94b4060860 2024-08-17T02:29:54.316 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:29:54.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.313+0000 7f94d8e3a700 1 -- 172.21.15.153:0/3572050772 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f94b4060860 msgr2=0x7f94b4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.313+0000 7f94d8e3a700 1 --2- 172.21.15.153:0/3572050772 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f94b4060860 0x7f94b4062d10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f94c8009fd0 tx=0x7f94c8017000 comp rx=0 tx=0).stop 2024-08-17T02:29:54.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.313+0000 7f94d8e3a700 1 -- 172.21.15.153:0/3572050772 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94d4157890 msgr2=0x7f94d4098c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.313+0000 7f94d8e3a700 1 --2- 172.21.15.153:0/3572050772 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94d4157890 0x7f94d4098c10 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f94d4157c80 tx=0x7f94cc0015f0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.313+0000 7f94d8e3a700 1 -- 172.21.15.153:0/3572050772 shutdown_connections 2024-08-17T02:29:54.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.313+0000 7f94d8e3a700 1 --2- 172.21.15.153:0/3572050772 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f94b4060860 0x7f94b4062d10 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.313+0000 7f94d8e3a700 1 --2- 172.21.15.153:0/3572050772 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94d4157890 0x7f94d4098c10 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.313+0000 7f94d8e3a700 1 --2- 172.21.15.153:0/3572050772 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94d4156f80 0x7f94d40986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.313+0000 7f94d8e3a700 1 --2- 172.21.15.153:0/3572050772 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94d40ace80 0x7f94d413e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.313+0000 7f94d8e3a700 1 -- 172.21.15.153:0/3572050772 >> 172.21.15.153:0/3572050772 conn(0x7f94d4066e00 msgr2=0x7f94d40680f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:54.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.313+0000 7f94d8e3a700 1 -- 172.21.15.153:0/3572050772 shutdown_connections 2024-08-17T02:29:54.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.313+0000 7f94d8e3a700 1 -- 172.21.15.153:0/3572050772 wait complete. 2024-08-17T02:29:54.319 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-08-17T02:29:54.331 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-08-17T02:29:54.119652+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2392264,"kb_used_data":5096,"kb_used_omap":13,"kb_used_meta":2387058,"kb_avail":752582456,"statfs":{"total":773094113280,"available":770644434944,"internally_reserved":0,"allocated":5218304,"data_stored":2851320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2444348096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003289"},"pg_stats":[{"pgid":"1.0","version":"43'119","reported_seq":196,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-17T02:29:35.958520+0000","last_change":"2024-08-17T02:29:35.958470+0000","last_active":"2024-08-17T02:29:35.958520+0000","last_peered":"2024-08-17T02:29:35.958520+0000","last_clean":"2024-08-17T02:29:35.958520+0000","last_became_active":"2024-08-17T02:26:00.031512+0000","last_became_peered":"2024-08-17T02:26:00.031512+0000","last_unstale":"2024-08-17T02:29:35.958520+0000","last_undegraded":"2024-08-17T02:29:35.958520+0000","last_fullsized":"2024-08-17T02:29:35.958520+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'119","last_scrub_stamp":"2024-08-17T02:29:35.958281+0000","last_deep_scrub":"43'119","last_deep_scrub_stamp":"2024-08-17T02:29:35.958281+0000","last_clean_scrub_stamp":"2024-08-17T02:29:35.958281+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:59:03.896949+0000","scrub_duration":0.010463401000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509491,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298424,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073416,"statfs":{"total":96636764160,"available":96331177984,"internally_reserved":0,"allocated":1097728,"data_stored":799191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:03 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.92500000000000004,"15min":0.94799999999999995},"min":{"1min":0.61299999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.052,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.88},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.83499999999999996,"15min":0.80900000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1599999999999999,"5min":1.165,"15min":1.165},"last":0.71899999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:29:03 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.84499999999999997,"15min":0.83799999999999997},"min":{"1min":0.68600000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.012,"5min":1.268,"15min":1.268},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.90100000000000002,"15min":0.90500000000000003},"min":{"1min":0.64800000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.177,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.78100000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:29:03 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90100000000000002,"15min":0.90700000000000003},"min":{"1min":0.67900000000000005,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.103,"5min":1.357,"15min":1.357},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.94999999999999996,"15min":0.93999999999999995},"min":{"1min":0.72699999999999998,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.95999999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:29:03 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.878,"15min":0.873},"min":{"1min":0.67900000000000005,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.129,"5min":1.409,"15min":1.409},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.026,"5min":1.0840000000000001,"15min":1.1120000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.2410000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.996}]},{"osd":4,"last update":"Sat Aug 17 02:29:03 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.93899999999999995,"15min":0.95899999999999996},"min":{"1min":0.63900000000000001,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.05,"15min":1.0509999999999999},"min":{"1min":0.94399999999999995,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.262,"5min":1.522,"15min":1.522},"last":1.052}]},{"osd":5,"last update":"Sat Aug 17 02:29:03 2024","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.1220000000000001,"15min":1.1479999999999999},"min":{"1min":0.70999999999999996,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.294,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.103},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1020000000000001,"15min":1.0980000000000001},"min":{"1min":0.95599999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":1.032}]},{"osd":6,"last update":"Sat Aug 17 02:29:03 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1299999999999999,"15min":1.1339999999999999},"min":{"1min":0.84599999999999997,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.534,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.129},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.149,"15min":1.151},"min":{"1min":0.95099999999999996,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.3340000000000001,"5min":1.609,"15min":1.609},"last":1.1619999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297848,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073992,"statfs":{"total":96636764160,"available":96331767808,"internally_reserved":0,"allocated":503808,"data_stored":208823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.877,"15min":0.86599999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.93600000000000005,"15min":0.92600000000000005},"min":{"1min":0.67800000000000005,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.25,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.79200000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.89700000000000002,"15min":0.88400000000000001},"min":{"1min":0.65600000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":1.2030000000000001},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.91800000000000004,"15min":0.93000000000000005},"min":{"1min":0.69199999999999995,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.288,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":1.0029999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.86899999999999999,"15min":0.86199999999999999},"min":{"1min":0.65900000000000003,"5min":0.623,"15min":0.623},"max":{"1min":0.998,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.999,"5min":0.96999999999999997,"15min":0.97599999999999998},"min":{"1min":0.77000000000000002,"5min":0.627,"15min":0.627},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.91400000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.91300000000000003,"15min":0.90100000000000002},"min":{"1min":0.77200000000000002,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.97299999999999998,"15min":0.97999999999999998},"min":{"1min":0.79500000000000004,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.1890000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.84099999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.93400000000000005,"15min":0.93100000000000005},"min":{"1min":0.68200000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.3460000000000001,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.004,"5min":1.0680000000000001,"15min":1.0920000000000001},"min":{"1min":0.60099999999999998,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2749999999999999,"5min":1.472,"15min":1.472},"last":0.89100000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.99099999999999999,"15min":1.0069999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.159,"5min":1.1439999999999999,"15min":1.1419999999999999},"min":{"1min":0.91200000000000003,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.4399999999999999,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.1240000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.163,"15min":1.1759999999999999},"min":{"1min":0.94699999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.3879999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.115,"5min":1.194,"15min":1.2250000000000001},"min":{"1min":0.91000000000000003,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.367,"5min":1.766,"15min":1.766},"last":1.1599999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297848,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073992,"statfs":{"total":96636764160,"available":96331767808,"internally_reserved":0,"allocated":503808,"data_stored":208823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.85599999999999998,"15min":0.86599999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.88400000000000001,"15min":0.86099999999999999},"min":{"1min":0.69199999999999995,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1830000000000001,"5min":1.335,"15min":1.335},"last":0.88700000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.94099999999999995,"15min":0.97099999999999997},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.133,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.111,"5min":1.268,"15min":1.268},"last":0.72599999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.91400000000000003,"15min":0.91600000000000004},"min":{"1min":0.624,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.224,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.96299999999999997,"15min":0.98899999999999999},"min":{"1min":0.72199999999999998,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.083,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.82999999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.86799999999999999,"15min":0.83599999999999997},"min":{"1min":0.69399999999999995,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.018,"15min":1.008},"min":{"1min":0.78300000000000003,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":1.0529999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.92500000000000004,"15min":0.92700000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.131,"5min":1.335,"15min":1.335},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95299999999999996,"15min":0.95399999999999996},"min":{"1min":0.69499999999999995,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.252,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.85399999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.998,"15min":0.99199999999999999},"min":{"1min":0.80300000000000005,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.282,"5min":1.496,"15min":1.496},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1559999999999999,"15min":1.169},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.01}]},{"osd":7,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.0740000000000001,"15min":1.0780000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.4750000000000001,"5min":1.49,"15min":1.49},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":1.427,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.135}]}]},{"osd":4,"up_from":15,"seq":64424509492,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297852,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073988,"statfs":{"total":96636764160,"available":96331763712,"internally_reserved":0,"allocated":503808,"data_stored":208823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:04 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.83799999999999997,"15min":0.81599999999999995},"min":{"1min":0.60799999999999998,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.94599999999999995,"15min":0.93200000000000005},"min":{"1min":0.69199999999999995,"5min":0.625,"15min":0.625},"max":{"1min":1.1830000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.78200000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:29:04 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.94299999999999995,"15min":0.95599999999999996},"min":{"1min":0.68999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":1.075},{"interface":"front","average":{"1min":0.876,"5min":0.89100000000000001,"15min":0.88500000000000001},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1299999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.68999999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:29:04 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.83199999999999996,"15min":0.81499999999999995},"min":{"1min":0.66200000000000003,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":1},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96399999999999997,"15min":0.95999999999999996},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.88800000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:29:04 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.94399999999999995,"15min":0.92800000000000005},"min":{"1min":0.72799999999999998,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.2350000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.002,"15min":0.99399999999999999},"min":{"1min":0.80700000000000005,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2649999999999999,"5min":1.516,"15min":1.516},"last":0.86099999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:29:04 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.016,"15min":1.0329999999999999},"min":{"1min":0.70199999999999996,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0740000000000001,"15min":1.0960000000000001},"min":{"1min":0.66100000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.292,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.81599999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:29:04 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93500000000000005,"15min":0.94099999999999995},"min":{"1min":0.73699999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.139,"5min":1.1639999999999999,"15min":1.171},"min":{"1min":1.01,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.4590000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.95899999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:29:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1379999999999999,"15min":1.149},"min":{"1min":0.79000000000000004,"5min":0.629,"15min":0.629},"max":{"1min":1.3,"5min":1.758,"15min":1.758},"last":1.125},{"interface":"front","average":{"1min":1.099,"5min":1.105,"15min":1.107},"min":{"1min":0.84899999999999998,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.2729999999999999,"5min":1.28,"15min":1.28},"last":1.1020000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302008,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069832,"statfs":{"total":96636764160,"available":96327507968,"internally_reserved":0,"allocated":503808,"data_stored":208823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.69599999999999995,"15min":0.71599999999999997},"min":{"1min":0.48499999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.097,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.69699999999999995,"15min":0.68200000000000005},"min":{"1min":0.52200000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.006,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.68799999999999994}]},{"osd":1,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.73199999999999998,"15min":0.73799999999999999},"min":{"1min":0.52300000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89400000000000002,"5min":1.798,"15min":1.798},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.59099999999999997,"5min":0.439,"15min":0.439},"max":{"1min":1.0249999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.874}]},{"osd":2,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.93999999999999995,"15min":1.002},"min":{"1min":0.63300000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0469999999999999,"5min":7.0899999999999999,"15min":7.0899999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.89100000000000001,"15min":0.90700000000000003},"min":{"1min":0.68600000000000005,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.089,"5min":2.4409999999999998,"15min":2.4409999999999998},"last":0.96899999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.0369999999999999,"15min":1.0620000000000001},"min":{"1min":0.72999999999999998,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.2869999999999999,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.081,"5min":1.153,"15min":1.181},"min":{"1min":0.88400000000000001,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.3160000000000001,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.024}]},{"osd":5,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.044,"15min":1.0489999999999999},"min":{"1min":0.80600000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.171,"5min":1.929,"15min":1.929},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.087,"5min":1.101,"15min":1.107},"min":{"1min":0.76800000000000002,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.294,"5min":1.988,"15min":1.988},"last":1.1020000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0920000000000001,"15min":1.1240000000000001},"min":{"1min":0.83199999999999996,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.4259999999999999,"5min":2.04,"15min":2.04},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.083,"5min":1.1419999999999999,"15min":1.1639999999999999},"min":{"1min":0.90600000000000003,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.27,"5min":2.141,"15min":2.141},"last":1.153}]},{"osd":7,"last update":"Sat Aug 17 02:29:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.159,"15min":1.161},"min":{"1min":0.83599999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.52,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.145,"15min":1.1459999999999999},"min":{"1min":0.94399999999999995,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.48,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.0029999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302008,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069832,"statfs":{"total":96636764160,"available":96327507968,"internally_reserved":0,"allocated":503808,"data_stored":208823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.74099999999999999,"15min":0.77100000000000002},"min":{"1min":0.51400000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.94499999999999995,"5min":1.268,"15min":1.268},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.76200000000000001,"15min":0.76700000000000002},"min":{"1min":0.57199999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.98099999999999998,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.83299999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.73299999999999998,"15min":0.72499999999999998},"min":{"1min":0.57699999999999996,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.97399999999999998,"5min":1.01,"15min":1.01},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.82899999999999996,"15min":0.84099999999999997},"min":{"1min":0.60999999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":1.0329999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.86499999999999999,"15min":0.876},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.135,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.72299999999999998,"15min":0.70599999999999996},"min":{"1min":0.56799999999999995,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.73499999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":1.02,"15min":1.046},"min":{"1min":0.80000000000000004,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.1839999999999999,"5min":1.857,"15min":1.857},"last":0.873},{"interface":"front","average":{"1min":1.044,"5min":1.125,"15min":1.157},"min":{"1min":0.875,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.325,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":1.117}]},{"osd":5,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.97999999999999998,"15min":1.0009999999999999},"min":{"1min":0.753,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.254,"5min":1.339,"15min":1.339},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.105,"5min":1.1459999999999999,"15min":1.1759999999999999},"min":{"1min":0.88600000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.5449999999999999,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.0529999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.2130000000000001,"15min":1.256},"min":{"1min":0.83499999999999996,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3959999999999999,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":1.177},{"interface":"front","average":{"1min":1.05,"5min":1.0900000000000001,"15min":1.1060000000000001},"min":{"1min":0.93000000000000005,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":1.351,"5min":1.427,"15min":1.427},"last":0.997}]},{"osd":7,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.1459999999999999,"15min":1.1659999999999999},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.3009999999999999,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.089},{"interface":"front","average":{"1min":1.202,"5min":1.222,"15min":1.244},"min":{"1min":0.996,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.6259999999999999,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.1519999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542195,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297852,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073988,"statfs":{"total":96636764160,"available":96331763712,"internally_reserved":0,"allocated":503808,"data_stored":208823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:07 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64000000000000001,"15min":0.63200000000000001},"min":{"1min":0.51600000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.71999999999999997,"15min":0.69599999999999995},"min":{"1min":0.57399999999999995,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.92700000000000005,"5min":1.129,"15min":1.129},"last":1.0720000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:29:12 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.71299999999999997,"15min":0.70499999999999996},"min":{"1min":0.51800000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.73799999999999999,"15min":0.70299999999999996},"min":{"1min":0.59899999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.171,"5min":1.21,"15min":1.21},"last":0.91700000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:29:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68000000000000005,"15min":0.65700000000000003},"min":{"1min":0.53400000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89900000000000002,"5min":1.25,"15min":1.25},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.86399999999999999,"15min":0.83999999999999997},"min":{"1min":0.63400000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.3120000000000001,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":1.004}]},{"osd":4,"last update":"Sat Aug 17 02:29:12 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.02,"15min":1.0149999999999999},"min":{"1min":0.75600000000000001,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.423,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.1200000000000001},{"interface":"front","average":{"1min":0.96099999999999997,"5min":1.0129999999999999,"15min":1.02},"min":{"1min":0.73499999999999999,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.254,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":1.5940000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:29:12 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.004,"15min":1.0089999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.2769999999999999,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.097,"5min":1.0880000000000001,"15min":1.0840000000000001},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.484,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.2210000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:29:12 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0880000000000001,"15min":1.1020000000000001},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.359,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":1.5409999999999999},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.0840000000000001,"15min":1.0740000000000001},"min":{"1min":0.86099999999999999,"5min":0.749,"15min":0.749},"max":{"1min":1.377,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.1759999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:29:12 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.165,"15min":1.1739999999999999},"min":{"1min":0.86599999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.292,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.472},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.1559999999999999,"15min":1.1479999999999999},"min":{"1min":0.99199999999999999,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":1.1000000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542195,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298424,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073416,"statfs":{"total":96636764160,"available":96331177984,"internally_reserved":0,"allocated":1097728,"data_stored":799191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64600000000000002,"15min":0.64700000000000002},"min":{"1min":0.48399999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.74299999999999999,"15min":0.71499999999999997},"min":{"1min":0.65300000000000002,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.78200000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.65900000000000003,"15min":0.65200000000000002},"min":{"1min":0.504,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80000000000000004,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76400000000000001,"15min":0.75},"min":{"1min":0.56799999999999995,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.018,"5min":1.123,"15min":1.123},"last":0.69999999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.86099999999999999,"15min":0.82399999999999995},"min":{"1min":0.77900000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1819999999999999,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.79700000000000004,"15min":0.76700000000000002},"min":{"1min":0.60399999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.90900000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.96099999999999997,"15min":0.96699999999999997},"min":{"1min":0.69299999999999995,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0800000000000001,"5min":1.601,"15min":1.601},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.097,"15min":1.113},"min":{"1min":0.84099999999999997,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.4410000000000001,"5min":1.571,"15min":1.571},"last":1.0209999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.96299999999999997,"15min":0.97699999999999998},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.071,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.1040000000000001,"15min":1.117},"min":{"1min":0.76300000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.123}]},{"osd":6,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.0840000000000001,"15min":1.0740000000000001},"min":{"1min":0.89700000000000002,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.077,"15min":1.0880000000000001},"min":{"1min":0.82899999999999996,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.171,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.88600000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.1339999999999999,"15min":1.111},"min":{"1min":0.94999999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.103,"15min":1.0940000000000001},"min":{"1min":0.82999999999999996,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.2989999999999999,"5min":1.518,"15min":1.518},"last":0.998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:29:54.333 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-08-17T02:29:54.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.437+0000 7fc06991b700 1 Processor -- start 2024-08-17T02:29:54.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.437+0000 7fc06991b700 1 -- start start 2024-08-17T02:29:54.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.437+0000 7fc06991b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc064159300 0x7fc0640b2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.437+0000 7fc06991b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc0641596d0 0x7fc064066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.437+0000 7fc06991b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0640cba90 con 0x7fc06415dbc0 2024-08-17T02:29:54.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.437+0000 7fc06991b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0640b2b60 con 0x7fc0641596d0 2024-08-17T02:29:54.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.437+0000 7fc06991b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0640cb160 con 0x7fc064159300 2024-08-17T02:29:54.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.441+0000 7fc0627fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc0641596d0 0x7fc064066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.441+0000 7fc0637fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc06415dbc0 0x7fc0640afe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44478/0 (socket says 172.21.15.153:44478) 2024-08-17T02:29:54.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.441+0000 7fc0637fe700 1 -- 172.21.15.153:0/3799184354 learned_addr learned my addr 172.21.15.153:0/3799184354 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:29:54.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.441+0000 7fc062ffd700 1 --2- 172.21.15.153:0/3799184354 >> v2:172.21.15.174:3300/0 conn(0x7fc064159300 0x7fc0640b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.441+0000 7fc0627fc700 1 -- 172.21.15.153:0/3799184354 >> v2:172.21.15.174:3300/0 conn(0x7fc064159300 msgr2=0x7fc0640b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:54.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.441+0000 7fc0627fc700 1 --2- 172.21.15.153:0/3799184354 >> v2:172.21.15.174:3300/0 conn(0x7fc064159300 0x7fc0640b2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.441+0000 7fc0627fc700 1 -- 172.21.15.153:0/3799184354 >> v1:172.21.15.153:6789/0 conn(0x7fc06415dbc0 legacy=0x7fc0640afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.441+0000 7fc0627fc700 1 -- 172.21.15.153:0/3799184354 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0640cb440 con 0x7fc0641596d0 2024-08-17T02:29:54.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.441+0000 7fc061ffb700 1 -- 172.21.15.153:0/3799184354 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 619754044 0 0) 0x7fc0640cba90 con 0x7fc06415dbc0 2024-08-17T02:29:54.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.441+0000 7fc0627fc700 1 --2- 172.21.15.153:0/3799184354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0641596d0 0x7fc064066e00 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc064089460 tx=0x7fc0540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=352f94ad38d67c82 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:54.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.441+0000 7fc061ffb700 1 -- 172.21.15.153:0/3799184354 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05400b6b0 con 0x7fc0641596d0 2024-08-17T02:29:54.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.441+0000 7fc061ffb700 1 -- 172.21.15.153:0/3799184354 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05400b810 con 0x7fc0641596d0 2024-08-17T02:29:54.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.441+0000 7fc061ffb700 1 -- 172.21.15.153:0/3799184354 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05400bbb0 con 0x7fc0641596d0 2024-08-17T02:29:54.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.441+0000 7fc06991b700 1 -- 172.21.15.153:0/3799184354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0641596d0 msgr2=0x7fc064066e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.441+0000 7fc06991b700 1 --2- 172.21.15.153:0/3799184354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0641596d0 0x7fc064066e00 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc064089460 tx=0x7fc0540091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.441+0000 7fc06991b700 1 -- 172.21.15.153:0/3799184354 shutdown_connections 2024-08-17T02:29:54.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.441+0000 7fc06991b700 1 --2- 172.21.15.153:0/3799184354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0641596d0 0x7fc064066e00 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.441+0000 7fc06991b700 1 --2- 172.21.15.153:0/3799184354 >> v2:172.21.15.174:3300/0 conn(0x7fc064159300 0x7fc0640b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.441+0000 7fc06991b700 1 -- 172.21.15.153:0/3799184354 >> 172.21.15.153:0/3799184354 conn(0x7fc0640682c0 msgr2=0x7fc0640686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:54.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.441+0000 7fc06991b700 1 -- 172.21.15.153:0/3799184354 shutdown_connections 2024-08-17T02:29:54.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.441+0000 7fc06991b700 1 -- 172.21.15.153:0/3799184354 wait complete. 2024-08-17T02:29:54.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.445+0000 7fc06991b700 1 Processor -- start 2024-08-17T02:29:54.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.445+0000 7fc06991b700 1 -- start start 2024-08-17T02:29:54.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.445+0000 7fc06991b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc064159300 0x7fc0640c2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.445+0000 7fc06991b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0641596d0 0x7fc0641694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.445+0000 7fc06991b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc06415dbc0 0x7fc0641699f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.445+0000 7fc06991b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0640c7840 con 0x7fc064159300 2024-08-17T02:29:54.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.445+0000 7fc06991b700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0640c7260 con 0x7fc06415dbc0 2024-08-17T02:29:54.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.445+0000 7fc06991b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc06416a020 con 0x7fc0641596d0 2024-08-17T02:29:54.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.445+0000 7fc062ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc064159300 0x7fc0640c2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.445+0000 7fc062ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc064159300 0x7fc0640c2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56942/0 (socket says 172.21.15.153:56942) 2024-08-17T02:29:54.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.445+0000 7fc062ffd700 1 -- 172.21.15.153:0/3421503921 learned_addr learned my addr 172.21.15.153:0/3421503921 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:54.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.445+0000 7fc0627fc700 1 --2- 172.21.15.153:0/3421503921 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0641596d0 0x7fc0641694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.445+0000 7fc0637fe700 1 --2- 172.21.15.153:0/3421503921 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc06415dbc0 0x7fc0641699f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.445+0000 7fc062ffd700 1 -- 172.21.15.153:0/3421503921 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0641596d0 msgr2=0x7fc0641694b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.445+0000 7fc062ffd700 1 --2- 172.21.15.153:0/3421503921 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0641596d0 0x7fc0641694b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.445+0000 7fc062ffd700 1 -- 172.21.15.153:0/3421503921 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc06415dbc0 msgr2=0x7fc0641699f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.445+0000 7fc062ffd700 1 --2- 172.21.15.153:0/3421503921 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc06415dbc0 0x7fc0641699f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.445+0000 7fc062ffd700 1 -- 172.21.15.153:0/3421503921 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc054009420 con 0x7fc064159300 2024-08-17T02:29:54.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.445+0000 7fc062ffd700 1 --2- 172.21.15.153:0/3421503921 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc064159300 0x7fc0640c2e90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc05800d890 tx=0x7fc058008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:54.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.445+0000 7fc04affd700 1 -- 172.21.15.153:0/3421503921 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0580125f0 con 0x7fc064159300 2024-08-17T02:29:54.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.445+0000 7fc04affd700 1 -- 172.21.15.153:0/3421503921 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc058012750 con 0x7fc064159300 2024-08-17T02:29:54.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.445+0000 7fc04affd700 1 -- 172.21.15.153:0/3421503921 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc058012b10 con 0x7fc064159300 2024-08-17T02:29:54.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.445+0000 7fc06991b700 1 -- 172.21.15.153:0/3421503921 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc06416a300 con 0x7fc064159300 2024-08-17T02:29:54.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.445+0000 7fc06991b700 1 -- 172.21.15.153:0/3421503921 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0640c3ee0 con 0x7fc064159300 2024-08-17T02:29:54.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.449+0000 7fc04affd700 1 -- 172.21.15.153:0/3421503921 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc05801e460 con 0x7fc064159300 2024-08-17T02:29:54.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.449+0000 7fc06991b700 1 -- 172.21.15.153:0/3421503921 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc06416a490 con 0x7fc064159300 2024-08-17T02:29:54.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.449+0000 7fc04affd700 1 --2- 172.21.15.153:0/3421503921 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fc050060860 0x7fc050062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.449+0000 7fc04affd700 1 -- 172.21.15.153:0/3421503921 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fc05807cf00 con 0x7fc064159300 2024-08-17T02:29:54.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.449+0000 7fc0627fc700 1 --2- 172.21.15.153:0/3421503921 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fc050060860 0x7fc050062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.449+0000 7fc0627fc700 1 --2- 172.21.15.153:0/3421503921 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fc050060860 0x7fc050062d10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc0540093f0 tx=0x7fc054017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:54.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.457+0000 7fc04affd700 1 -- 172.21.15.153:0/3421503921 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc058050fe0 con 0x7fc064159300 2024-08-17T02:29:54.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.633+0000 7fc06991b700 1 -- 172.21.15.153:0/3421503921 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fc0640645c0 con 0x7fc064159300 2024-08-17T02:29:54.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.641+0000 7fc04affd700 1 -- 172.21.15.153:0/3421503921 <== mon.0 v2:172.21.15.153:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc058050fe0 con 0x7fc064159300 2024-08-17T02:29:54.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.641+0000 7fc04affd700 1 -- 172.21.15.153:0/3421503921 <== mon.0 v2:172.21.15.153:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7fc058050b70 con 0x7fc064159300 2024-08-17T02:29:54.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.641+0000 7fc06991b700 1 -- 172.21.15.153:0/3421503921 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fc050060860 msgr2=0x7fc050062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.641+0000 7fc06991b700 1 --2- 172.21.15.153:0/3421503921 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fc050060860 0x7fc050062d10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc0540093f0 tx=0x7fc054017000 comp rx=0 tx=0).stop 2024-08-17T02:29:54.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.641+0000 7fc06991b700 1 -- 172.21.15.153:0/3421503921 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc064159300 msgr2=0x7fc0640c2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.641+0000 7fc06991b700 1 --2- 172.21.15.153:0/3421503921 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc064159300 0x7fc0640c2e90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc05800d890 tx=0x7fc058008040 comp rx=0 tx=0).stop 2024-08-17T02:29:54.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.641+0000 7fc06991b700 1 -- 172.21.15.153:0/3421503921 shutdown_connections 2024-08-17T02:29:54.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.641+0000 7fc06991b700 1 --2- 172.21.15.153:0/3421503921 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7fc050060860 0x7fc050062d10 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.641+0000 7fc06991b700 1 --2- 172.21.15.153:0/3421503921 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc06415dbc0 0x7fc0641699f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.641+0000 7fc06991b700 1 --2- 172.21.15.153:0/3421503921 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0641596d0 0x7fc0641694b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.641+0000 7fc06991b700 1 --2- 172.21.15.153:0/3421503921 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc064159300 0x7fc0640c2e90 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.641+0000 7fc06991b700 1 -- 172.21.15.153:0/3421503921 >> 172.21.15.153:0/3421503921 conn(0x7fc0640682c0 msgr2=0x7fc0641562e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:54.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.641+0000 7fc06991b700 1 -- 172.21.15.153:0/3421503921 shutdown_connections 2024-08-17T02:29:54.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.641+0000 7fc06991b700 1 -- 172.21.15.153:0/3421503921 wait complete. 2024-08-17T02:29:54.659 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:29:54.659 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:54.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.761+0000 7f429759e700 1 Processor -- start 2024-08-17T02:29:54.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.761+0000 7f429759e700 1 -- start start 2024-08-17T02:29:54.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.761+0000 7f429759e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4298159040 0x7f42980cf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.761+0000 7f429759e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42980d0010 0x7f42980d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.761+0000 7f429759e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42980cf190 con 0x7f429815cea0 2024-08-17T02:29:54.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.761+0000 7f429759e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42980d09a0 con 0x7f4298159040 2024-08-17T02:29:54.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.761+0000 7f429759e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42980ce5e0 con 0x7f42980d0010 2024-08-17T02:29:54.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.765+0000 7f428dd9b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42980d0010 0x7f42980d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.765+0000 7f429659c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4298159040 0x7f42980cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.765+0000 7f4296d9d700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f429815cea0 0x7f429815d320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.153:47380/0 (socket says 172.21.15.153:47380) 2024-08-17T02:29:54.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.765+0000 7f4296d9d700 1 -- 172.21.15.153:0/3821276877 learned_addr learned my addr 172.21.15.153:0/3821276877 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-08-17T02:29:54.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.765+0000 7f4295d9b700 1 -- 172.21.15.153:0/3821276877 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 599249624 0 0) 0x7f42980cf190 con 0x7f429815cea0 2024-08-17T02:29:54.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.765+0000 7f4295d9b700 1 -- 172.21.15.153:0/3821276877 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4284003570 con 0x7f429815cea0 2024-08-17T02:29:54.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.765+0000 7f428dd9b700 1 -- 172.21.15.153:0/3821276877 >> v2:172.21.15.174:3300/0 conn(0x7f4298159040 msgr2=0x7f42980cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:54.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.765+0000 7f428dd9b700 1 --2- 172.21.15.153:0/3821276877 >> v2:172.21.15.174:3300/0 conn(0x7f4298159040 0x7f42980cf620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.765+0000 7f428dd9b700 1 -- 172.21.15.153:0/3821276877 >> v1:172.21.15.174:6789/0 conn(0x7f429815cea0 legacy=0x7f429815d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.765+0000 7f428dd9b700 1 -- 172.21.15.153:0/3821276877 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42980ce860 con 0x7f42980d0010 2024-08-17T02:29:54.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.765+0000 7f428dd9b700 1 --2- 172.21.15.153:0/3821276877 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42980d0010 0x7f42980d0460 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f42800098e0 tx=0x7f42800091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d81903ad44241f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:54.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.765+0000 7f4295d9b700 1 -- 172.21.15.153:0/3821276877 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4280011630 con 0x7f42980d0010 2024-08-17T02:29:54.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.765+0000 7f4295d9b700 1 -- 172.21.15.153:0/3821276877 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4280011790 con 0x7f42980d0010 2024-08-17T02:29:54.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.765+0000 7f4295d9b700 1 -- 172.21.15.153:0/3821276877 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4280011b50 con 0x7f42980d0010 2024-08-17T02:29:54.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.765+0000 7f429759e700 1 -- 172.21.15.153:0/3821276877 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42980d0010 msgr2=0x7f42980d0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.765+0000 7f429759e700 1 --2- 172.21.15.153:0/3821276877 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42980d0010 0x7f42980d0460 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f42800098e0 tx=0x7f42800091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.765+0000 7f429759e700 1 -- 172.21.15.153:0/3821276877 shutdown_connections 2024-08-17T02:29:54.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.765+0000 7f429759e700 1 --2- 172.21.15.153:0/3821276877 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42980d0010 0x7f42980d0460 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.765+0000 7f429759e700 1 --2- 172.21.15.153:0/3821276877 >> v2:172.21.15.174:3300/0 conn(0x7f4298159040 0x7f42980cf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.765+0000 7f429759e700 1 -- 172.21.15.153:0/3821276877 >> 172.21.15.153:0/3821276877 conn(0x7f4298068250 msgr2=0x7f4298068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:54.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.765+0000 7f429759e700 1 -- 172.21.15.153:0/3821276877 shutdown_connections 2024-08-17T02:29:54.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.765+0000 7f429759e700 1 -- 172.21.15.153:0/3821276877 wait complete. 2024-08-17T02:29:54.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.769+0000 7f429759e700 1 Processor -- start 2024-08-17T02:29:54.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.769+0000 7f429759e700 1 -- start start 2024-08-17T02:29:54.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.769+0000 7f429759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42980d0010 0x7f42980b2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.769+0000 7f429759e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4298159040 0x7f42980c5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.769+0000 7f429759e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f429815cea0 0x7f429815c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.769+0000 7f429759e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42980b2890 con 0x7f42980d0010 2024-08-17T02:29:54.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.769+0000 7f429759e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42980b12b0 con 0x7f4298159040 2024-08-17T02:29:54.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.769+0000 7f429759e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42980b1590 con 0x7f429815cea0 2024-08-17T02:29:54.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.769+0000 7f429659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42980d0010 0x7f42980b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.769+0000 7f428dd9b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4298159040 0x7f42980c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.769+0000 7f4296d9d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f429815cea0 0x7f429815c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.769+0000 7f429659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42980d0010 0x7f42980b2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56952/0 (socket says 172.21.15.153:56952) 2024-08-17T02:29:54.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.769+0000 7f429659c700 1 -- 172.21.15.153:0/1138932590 learned_addr learned my addr 172.21.15.153:0/1138932590 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-17T02:29:54.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.769+0000 7f429659c700 1 -- 172.21.15.153:0/1138932590 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f429815cea0 msgr2=0x7f429815c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.769+0000 7f429659c700 1 --2- 172.21.15.153:0/1138932590 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f429815cea0 0x7f429815c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.769+0000 7f429659c700 1 -- 172.21.15.153:0/1138932590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4298159040 msgr2=0x7f42980c5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.769+0000 7f429659c700 1 --2- 172.21.15.153:0/1138932590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4298159040 0x7f42980c5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.769+0000 7f429659c700 1 -- 172.21.15.153:0/1138932590 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4280009420 con 0x7f42980d0010 2024-08-17T02:29:54.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.769+0000 7f428dd9b700 1 --2- 172.21.15.153:0/1138932590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4298159040 0x7f42980c5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:54.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.769+0000 7f429659c700 1 --2- 172.21.15.153:0/1138932590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42980d0010 0x7f42980b2350 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f428800ec80 tx=0x7f42880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:54.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.769+0000 7f428effd700 1 -- 172.21.15.153:0/1138932590 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428800c850 con 0x7f42980d0010 2024-08-17T02:29:54.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.769+0000 7f428effd700 1 -- 172.21.15.153:0/1138932590 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f428800c9b0 con 0x7f42980d0010 2024-08-17T02:29:54.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.769+0000 7f429759e700 1 -- 172.21.15.153:0/1138932590 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42980b1870 con 0x7f42980d0010 2024-08-17T02:29:54.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.769+0000 7f428effd700 1 -- 172.21.15.153:0/1138932590 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428800cd70 con 0x7f42980d0010 2024-08-17T02:29:54.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.769+0000 7f429759e700 1 -- 172.21.15.153:0/1138932590 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42980b1e30 con 0x7f42980d0010 2024-08-17T02:29:54.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.773+0000 7f429759e700 1 -- 172.21.15.153:0/1138932590 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42980c5620 con 0x7f42980d0010 2024-08-17T02:29:54.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.773+0000 7f428effd700 1 -- 172.21.15.153:0/1138932590 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4288013680 con 0x7f42980d0010 2024-08-17T02:29:54.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.773+0000 7f428effd700 1 --2- 172.21.15.153:0/1138932590 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4278060860 0x7f4278062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.773+0000 7f428effd700 1 -- 172.21.15.153:0/1138932590 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f428807cb50 con 0x7f42980d0010 2024-08-17T02:29:54.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.773+0000 7f428dd9b700 1 --2- 172.21.15.153:0/1138932590 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4278060860 0x7f4278062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.777+0000 7f428dd9b700 1 --2- 172.21.15.153:0/1138932590 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4278060860 0x7f4278062d10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f429816cf80 tx=0x7f42800091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:54.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.785+0000 7f428effd700 1 -- 172.21.15.153:0/1138932590 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f428804d2c0 con 0x7f42980d0010 2024-08-17T02:29:54.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.985+0000 7f429759e700 1 -- 172.21.15.153:0/1138932590 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42980643a0 con 0x7f42980d0010 2024-08-17T02:29:54.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.985+0000 7f428effd700 1 -- 172.21.15.153:0/1138932590 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+3537 (secure 0 0 0) 0x7f4288021df0 con 0x7f42980d0010 2024-08-17T02:29:54.991 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-17T02:29:54.991 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":22,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4885,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/747297575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":747297575},{"type":"v1","addr":"172.21.15.174:6833","nonce":747297575}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4891,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1080524090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1080524090},{"type":"v1","addr":"172.21.15.174:6835","nonce":1080524090}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5379,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/1564937222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1564937222},{"type":"v1","addr":"172.21.15.153:6837","nonce":1564937222}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5475,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2812106654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2812106654},{"type":"v1","addr":"172.21.15.153:6835","nonce":2812106654}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[]} 2024-08-17T02:29:54.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.989+0000 7f429759e700 1 -- 172.21.15.153:0/1138932590 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4278060860 msgr2=0x7f4278062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.989+0000 7f429759e700 1 --2- 172.21.15.153:0/1138932590 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4278060860 0x7f4278062d10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f429816cf80 tx=0x7f42800091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.989+0000 7f429759e700 1 -- 172.21.15.153:0/1138932590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42980d0010 msgr2=0x7f42980b2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.989+0000 7f429759e700 1 --2- 172.21.15.153:0/1138932590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42980d0010 0x7f42980b2350 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f428800ec80 tx=0x7f42880091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.989+0000 7f429759e700 1 -- 172.21.15.153:0/1138932590 shutdown_connections 2024-08-17T02:29:54.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.989+0000 7f429759e700 1 --2- 172.21.15.153:0/1138932590 >> [v2:172.21.15.153:6832/24147,v1:172.21.15.153:6833/24147] conn(0x7f4278060860 0x7f4278062d10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.989+0000 7f429759e700 1 --2- 172.21.15.153:0/1138932590 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f429815cea0 0x7f429815c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.989+0000 7f429759e700 1 --2- 172.21.15.153:0/1138932590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4298159040 0x7f42980c5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.989+0000 7f429759e700 1 --2- 172.21.15.153:0/1138932590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42980d0010 0x7f42980b2350 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.996 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.989+0000 7f429759e700 1 -- 172.21.15.153:0/1138932590 >> 172.21.15.153:0/1138932590 conn(0x7f4298068250 msgr2=0x7f4298152c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:54.996 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.989+0000 7f429759e700 1 -- 172.21.15.153:0/1138932590 shutdown_connections 2024-08-17T02:29:54.996 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-17T02:29:54.989+0000 7f429759e700 1 -- 172.21.15.153:0/1138932590 wait complete. 2024-08-17T02:29:54.996 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 22 2024-08-17T02:29:55.010 DEBUG:tasks.cephfs.filesystem:already dead... 2024-08-17T02:29:55.010 INFO:teuthology.misc:Shutting down mds daemons... 2024-08-17T02:29:55.011 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:29:55.011 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:55.024 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:29:55.024 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:29:55.024 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:55.033 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:29:55.034 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:29:55.034 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:55.050 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:29:55.051 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:29:55.051 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:55.063 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:29:55.063 INFO:teuthology.misc:Shutting down osd daemons... 2024-08-17T02:29:55.063 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-08-17T02:29:55.063 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:55.150 INFO:tasks.ceph.osd.0:Stopped 2024-08-17T02:29:55.151 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-08-17T02:29:55.151 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:55.232 INFO:tasks.ceph.osd.1:Stopped 2024-08-17T02:29:55.233 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-08-17T02:29:55.233 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:55.307 INFO:tasks.ceph.osd.2:Stopped 2024-08-17T02:29:55.307 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-08-17T02:29:55.307 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:55.379 INFO:tasks.ceph.osd.3:Stopped 2024-08-17T02:29:55.379 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-08-17T02:29:55.379 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:55.456 INFO:tasks.ceph.osd.4:Stopped 2024-08-17T02:29:55.457 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-08-17T02:29:55.457 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:55.538 INFO:tasks.ceph.osd.5:Stopped 2024-08-17T02:29:55.538 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-08-17T02:29:55.539 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:55.618 INFO:tasks.ceph.osd.6:Stopped 2024-08-17T02:29:55.619 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-08-17T02:29:55.619 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:55.701 INFO:tasks.ceph.osd.7:Stopped 2024-08-17T02:29:55.701 INFO:teuthology.misc:Shutting down mgr daemons... 2024-08-17T02:29:55.701 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-08-17T02:29:55.701 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:55.727 INFO:tasks.ceph.mgr.y:Stopped 2024-08-17T02:29:55.727 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-08-17T02:29:55.728 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:55.757 INFO:tasks.ceph.mgr.x:Stopped 2024-08-17T02:29:55.757 INFO:teuthology.misc:Shutting down mon daemons... 2024-08-17T02:29:55.757 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-17T02:29:55.757 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:55.789 INFO:tasks.ceph.mon.a:Stopped 2024-08-17T02:29:55.789 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-17T02:29:55.789 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:55.806 INFO:tasks.ceph.mon.b:Stopped 2024-08-17T02:29:55.807 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-17T02:29:55.807 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:55.868 INFO:tasks.ceph.mon.c:Stopped 2024-08-17T02:29:55.868 INFO:tasks.ceph:Checking cluster log for badness... 2024-08-17T02:29:55.868 DEBUG:teuthology.orchestra.run.smithi153:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-08-17T02:29:55.890 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi153.front.sepia.ceph.com 2024-08-17T02:29:55.891 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-08-17T02:29:56.210 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi153.front.sepia.ceph.com 2024-08-17T02:29:56.210 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-08-17T02:29:56.443 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi153.front.sepia.ceph.com 2024-08-17T02:29:56.444 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-08-17T02:29:56.641 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi153.front.sepia.ceph.com 2024-08-17T02:29:56.641 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-08-17T02:29:56.867 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi174.front.sepia.ceph.com 2024-08-17T02:29:56.868 DEBUG:teuthology.orchestra.run.smithi174:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-08-17T02:29:57.103 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi174.front.sepia.ceph.com 2024-08-17T02:29:57.103 DEBUG:teuthology.orchestra.run.smithi174:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-08-17T02:29:57.301 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi174.front.sepia.ceph.com 2024-08-17T02:29:57.302 DEBUG:teuthology.orchestra.run.smithi174:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-08-17T02:29:57.511 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi174.front.sepia.ceph.com 2024-08-17T02:29:57.511 DEBUG:teuthology.orchestra.run.smithi174:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-08-17T02:29:57.685 INFO:tasks.ceph:Archiving mon data... 2024-08-17T02:29:57.687 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858245/data/mon.a.tgz 2024-08-17T02:29:57.687 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2024-08-17T02:29:57.694 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.WH4gIQxRZF 2024-08-17T02:29:57.694 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.WH4gIQxRZF 2024-08-17T02:29:57.776 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.WH4gIQxRZF 2024-08-17T02:29:57.803 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.WH4gIQxRZF is 307KB 2024-08-17T02:29:57.865 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.WH4gIQxRZF 2024-08-17T02:29:57.872 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858245/data/mon.b.tgz 2024-08-17T02:29:57.872 DEBUG:teuthology.orchestra.run.smithi174:> mktemp 2024-08-17T02:29:57.879 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.MTVjaXaT6a 2024-08-17T02:29:57.879 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.MTVjaXaT6a 2024-08-17T02:29:57.984 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.MTVjaXaT6a 2024-08-17T02:29:58.051 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.MTVjaXaT6a is 407KB 2024-08-17T02:29:58.072 DEBUG:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.MTVjaXaT6a 2024-08-17T02:29:58.078 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858245/data/mon.c.tgz 2024-08-17T02:29:58.078 DEBUG:teuthology.orchestra.run.smithi174:> mktemp 2024-08-17T02:29:58.084 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.mdFcxsd6TK 2024-08-17T02:29:58.085 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.mdFcxsd6TK 2024-08-17T02:29:58.231 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.mdFcxsd6TK 2024-08-17T02:29:58.254 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.mdFcxsd6TK is 407KB 2024-08-17T02:29:58.314 DEBUG:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.mdFcxsd6TK 2024-08-17T02:29:58.321 INFO:tasks.ceph:Cleaning ceph cluster... 2024-08-17T02:29:58.321 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:29:58.324 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:29:58.339 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-08-17T02:29:58.339 DEBUG:teuthology.orchestra.run.smithi153:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:29:58.380 DEBUG:teuthology.orchestra.run.smithi174:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:29:58.404 INFO:teuthology.orchestra.run.smithi174.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:29:58.415 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:29:58.421 INFO:tasks.ceph:Archiving crash dumps... 2024-08-17T02:29:58.423 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858245/remote/smithi153/crash 2024-08-17T02:29:58.424 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:29:58.440 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858245/remote/smithi174/crash 2024-08-17T02:29:58.440 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:29:58.466 INFO:tasks.ceph:Shutting down logrotate 2024-08-17T02:29:58.466 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:58.484 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:58.560 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:58.576 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:58.593 INFO:tasks.ceph:Compressing logs... 2024-08-17T02:29:58.593 DEBUG:teuthology.orchestra.run.smithi153:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:29:58.620 DEBUG:teuthology.orchestra.run.smithi174:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:29:58.644 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33296.log 2024-08-17T02:29:58.645 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29504.log 2024-08-17T02:29:58.646 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.33296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24376.log 2024-08-17T02:29:58.647 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33720.log 2024-08-17T02:29:58.647 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.29504.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33296.log.gz 2024-08-17T02:29:58.647 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34050.log 2024-08-17T02:29:58.648 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.24376.log: /var/log/ceph/ceph-client.admin.33720.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.29504.log.gz 2024-08-17T02:29:58.648 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33086.log 2024-08-17T02:29:58.648 INFO:teuthology.orchestra.run.smithi153.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.24376.log.gz 2024-08-17T02:29:58.648 INFO:teuthology.orchestra.run.smithi153.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33720.log.gz 2024-08-17T02:29:58.648 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 /var/log/ceph/ceph-client.admin.34050.log: --verbose -- /var/log/ceph/ceph-client.admin.29423.log 2024-08-17T02:29:58.650 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-08-17T02:29:58.650 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.33086.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34050.log.gz 2024-08-17T02:29:58.650 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.29423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29994.log 2024-08-17T02:29:58.650 INFO:teuthology.orchestra.run.smithi153.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33086.log.gz 2024-08-17T02:29:58.650 INFO:teuthology.orchestra.run.smithi153.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.29423.log.gz 2024-08-17T02:29:58.650 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33828.log 2024-08-17T02:29:58.652 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32277.log 2024-08-17T02:29:58.652 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.29994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31542.log 2024-08-17T02:29:58.652 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.33828.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.29994.log.gz 2024-08-17T02:29:58.652 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32086.log 2024-08-17T02:29:58.652 INFO:teuthology.orchestra.run.smithi153.stderr: 89.5%/var/log/ceph/ceph-client.admin.32277.log: -- replaced with /var/log/ceph/ceph-client.admin.33828.log.gz 2024-08-17T02:29:58.653 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.31542.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32277.log.gz 2024-08-17T02:29:58.653 INFO:teuthology.orchestra.run.smithi153.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.31542.log.gz 2024-08-17T02:29:58.653 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33522.log 2024-08-17T02:29:58.654 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32086.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.32086.log.gz 2024-08-17T02:29:58.654 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32563.log 2024-08-17T02:29:58.655 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30006.log 2024-08-17T02:29:58.656 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.33522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31961.log 2024-08-17T02:29:58.656 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32563.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33522.log.gz 2024-08-17T02:29:58.656 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33558.log 2024-08-17T02:29:58.657 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.30006.log: gzip /var/log/ceph/ceph-client.admin.31961.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.30314.log 2024-08-17T02:29:58.657 INFO:teuthology.orchestra.run.smithi153.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32563.log.gz 2024-08-17T02:29:58.657 INFO:teuthology.orchestra.run.smithi153.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.30006.log.gz 2024-08-17T02:29:58.657 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28947.log 2024-08-17T02:29:58.657 INFO:teuthology.orchestra.run.smithi153.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31961.log.gz 2024-08-17T02:29:58.658 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.33558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31515.log 2024-08-17T02:29:58.659 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.30314.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33558.log.gz 2024-08-17T02:29:58.659 INFO:teuthology.orchestra.run.smithi153.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.30314.log.gz 2024-08-17T02:29:58.659 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.28947.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.28947.log.gz 2024-08-17T02:29:58.659 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-08-17T02:29:58.663 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32331.log 2024-08-17T02:29:58.663 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.31515.log: /var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33323.log 2024-08-17T02:29:58.663 INFO:teuthology.orchestra.run.smithi153.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31515.log.gz 2024-08-17T02:29:58.663 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32451.log 2024-08-17T02:29:58.663 INFO:teuthology.orchestra.run.smithi153.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.32331.log.gz 2024-08-17T02:29:58.663 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-08-17T02:29:58.663 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.33323.log: /var/log/ceph/ceph-client.admin.32451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33161.log 2024-08-17T02:29:58.664 INFO:teuthology.orchestra.run.smithi153.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33323.log.gz 2024-08-17T02:29:58.664 INFO:teuthology.orchestra.run.smithi153.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.32451.log.gz 2024-08-17T02:29:58.664 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30016.log 2024-08-17T02:29:58.664 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.33161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32416.log 2024-08-17T02:29:58.664 INFO:teuthology.orchestra.run.smithi153.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33161.log.gz 2024-08-17T02:29:58.664 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33115.log 2024-08-17T02:29:58.664 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.30016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31637.log 2024-08-17T02:29:58.664 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32416.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30016.log.gz 2024-08-17T02:29:58.664 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.33115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33612.log 2024-08-17T02:29:58.665 INFO:teuthology.orchestra.run.smithi153.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32416.log.gz 2024-08-17T02:29:58.665 INFO:teuthology.orchestra.run.smithi153.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.33115.log.gz 2024-08-17T02:29:58.665 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32671.log 2024-08-17T02:29:58.665 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.31637.log: /var/log/ceph/ceph-client.admin.33612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29581.log 2024-08-17T02:29:58.665 INFO:teuthology.orchestra.run.smithi153.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.31637.log.gz 2024-08-17T02:29:58.679 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-08-17T02:29:58.679 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24258.log 2024-08-17T02:29:58.679 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-08-17T02:29:58.679 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24391.log 2024-08-17T02:29:58.679 INFO:teuthology.orchestra.run.smithi174.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-08-17T02:29:58.679 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.24258.log: /var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24363.log 2024-08-17T02:29:58.680 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24309.log 2024-08-17T02:29:58.680 INFO:teuthology.orchestra.run.smithi174.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.24258.log.gz 2024-08-17T02:29:58.680 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.24391.log: /var/log/ceph/ceph-client.admin.24363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24283.log 2024-08-17T02:29:58.680 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.24309.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.24363.log.gz 2024-08-17T02:29:58.680 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 88.0% 2024-08-17T02:29:58.680 INFO:teuthology.orchestra.run.smithi174.stderr: -- replaced with /var/log/ceph/ceph-client.admin.24391.log.gz 2024-08-17T02:29:58.680 INFO:teuthology.orchestra.run.smithi174.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.24309.log.gz 2024-08-17T02:29:58.680 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-08-17T02:29:58.680 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.24283.log: /var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-08-17T02:29:58.681 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-mgr.x.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.24283.log.gz 2024-08-17T02:29:58.681 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.30396.log 2024-08-17T02:29:58.681 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:29:58.681 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24233.log 2024-08-17T02:29:58.681 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.1.30396.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-08-17T02:29:58.681 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.24233.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.24233.log.gz 2024-08-17T02:29:58.681 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24419.log 2024-08-17T02:29:58.681 INFO:teuthology.orchestra.run.smithi174.stderr: 93.2%/var/log/ceph/ceph-osd.6.log: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:29:58.682 INFO:teuthology.orchestra.run.smithi174.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-08-17T02:29:58.682 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.30231.log 2024-08-17T02:29:58.682 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-08-17T02:29:58.682 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.24419.log: /var/log/ceph/ceph-client.3.30231.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.24419.log.gz 2024-08-17T02:29:58.682 INFO:teuthology.orchestra.run.smithi174.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.3.30231.log.gz 2024-08-17T02:29:58.682 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.30118.log 2024-08-17T02:29:58.682 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-17T02:29:58.682 INFO:teuthology.orchestra.run.smithi174.stderr: 95.4% -- replaced with /var/log/ceph/ceph-client.1.30396.log.gz 2024-08-17T02:29:58.683 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-mds.b.log: /var/log/ceph/ceph-client.1.30118.log: 89.3% -- replaced with /var/log/ceph/ceph-client.1.30118.log.gz 2024-08-17T02:29:58.683 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24336.log 2024-08-17T02:29:58.683 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-08-17T02:29:58.683 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.24336.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.24336.log.gz 2024-08-17T02:29:58.683 INFO:teuthology.orchestra.run.smithi174.stderr: 91.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-17T02:29:58.683 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-08-17T02:29:58.693 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29799.log 2024-08-17T02:29:58.693 INFO:teuthology.orchestra.run.smithi153.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33612.log.gz 2024-08-17T02:29:58.693 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33666.log 2024-08-17T02:29:58.693 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.29581.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32671.log.gz 2024-08-17T02:29:58.693 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.29799.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.29581.log.gz 2024-08-17T02:29:58.693 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31245.log 2024-08-17T02:29:58.693 INFO:teuthology.orchestra.run.smithi153.stderr:gzip 87.7%-5 -- replaced with /var/log/ceph/ceph-client.admin.29799.log.gz--verbose 2024-08-17T02:29:58.693 INFO:teuthology.orchestra.run.smithi153.stderr:-- /var/log/ceph/ceph-client.admin.34513.log 2024-08-17T02:29:58.694 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.33666.log: /var/log/ceph/ceph-client.admin.31245.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33666.log.gz 2024-08-17T02:29:58.694 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30341.log 2024-08-17T02:29:58.694 INFO:teuthology.orchestra.run.smithi153.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31245.log.gz 2024-08-17T02:29:58.694 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.34513.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34513.log.gz 2024-08-17T02:29:58.694 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29040.log 2024-08-17T02:29:58.694 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.30341.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.30341.log.gz 2024-08-17T02:29:58.694 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30368.log 2024-08-17T02:29:58.694 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.29040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32113.log 2024-08-17T02:29:58.695 INFO:teuthology.orchestra.run.smithi153.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.29040.log.gz 2024-08-17T02:29:58.695 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 /var/log/ceph/ceph-client.admin.30368.log: --verbose -- /var/log/ceph/ceph-client.admin.33639.log 2024-08-17T02:29:58.695 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31799.log 2024-08-17T02:29:58.695 INFO:teuthology.orchestra.run.smithi153.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.30368.log.gz 2024-08-17T02:29:58.695 INFO:teuthology.orchestra.run.smithi153.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32113.log.gz 2024-08-17T02:29:58.695 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32966.log 2024-08-17T02:29:58.695 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.33639.log: /var/log/ceph/ceph-client.admin.31799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32304.log 2024-08-17T02:29:58.695 INFO:teuthology.orchestra.run.smithi153.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33639.log.gz 2024-08-17T02:29:58.696 INFO:teuthology.orchestra.run.smithi153.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31799.log.gz 2024-08-17T02:29:58.696 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31907.log 2024-08-17T02:29:58.696 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32966.log: /var/log/ceph/ceph-client.admin.32304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32021.log 2024-08-17T02:29:58.696 INFO:teuthology.orchestra.run.smithi153.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32966.log.gz 2024-08-17T02:29:58.696 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33059.log 2024-08-17T02:29:58.696 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.31907.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32304.log.gz 2024-08-17T02:29:58.696 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31164.log 2024-08-17T02:29:58.696 INFO:teuthology.orchestra.run.smithi153.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31907.log.gz 2024-08-17T02:29:58.696 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29450.log 2024-08-17T02:29:58.697 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.33059.log: /var/log/ceph/ceph-client.admin.31164.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32021.log.gz 2024-08-17T02:29:58.697 INFO:teuthology.orchestra.run.smithi153.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33059.log.gz 2024-08-17T02:29:58.697 INFO:teuthology.orchestra.run.smithi153.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31164.log.gz 2024-08-17T02:29:58.697 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31853.log 2024-08-17T02:29:58.697 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.29450.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-08-17T02:29:58.697 INFO:teuthology.orchestra.run.smithi153.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.29450.log.gz 2024-08-17T02:29:58.697 INFO:teuthology.orchestra.run.smithi153.stderr:gzip /var/log/ceph/ceph-client.admin.31853.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.34648.log 2024-08-17T02:29:58.697 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30826.log 2024-08-17T02:29:58.698 INFO:teuthology.orchestra.run.smithi153.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31853.log.gz 2024-08-17T02:29:58.698 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24231.log 2024-08-17T02:29:58.698 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.34648.log: /var/log/ceph/ceph-client.admin.30826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34009.log 2024-08-17T02:29:58.698 INFO:teuthology.orchestra.run.smithi153.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34648.log.gz 2024-08-17T02:29:58.698 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32505.log 2024-08-17T02:29:58.698 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.24231.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.30826.log.gz 2024-08-17T02:29:58.698 INFO:teuthology.orchestra.run.smithi153.stderr: 87.2%/var/log/ceph/ceph-client.admin.34009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29531.log 2024-08-17T02:29:58.698 INFO:teuthology.orchestra.run.smithi153.stderr: -- replaced with /var/log/ceph/ceph-client.admin.24231.log.gz 2024-08-17T02:29:58.699 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32505.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34009.log.gz 2024-08-17T02:29:58.699 INFO:teuthology.orchestra.run.smithi153.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32505.log.gz 2024-08-17T02:29:58.699 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.19237.log 2024-08-17T02:29:58.699 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.29531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30530.log 2024-08-17T02:29:58.699 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph.tmp-client.admin.19237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33377.log 2024-08-17T02:29:58.699 INFO:teuthology.orchestra.run.smithi153.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.29531.log.gz 2024-08-17T02:29:58.699 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.19237.log.gz 2024-08-17T02:29:58.699 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.30530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34459.log 2024-08-17T02:29:58.700 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34270.log 2024-08-17T02:29:58.700 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.33377.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.30530.log.gz 2024-08-17T02:29:58.700 INFO:teuthology.orchestra.run.smithi153.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-08-17T02:29:58.700 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.34459.log: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.33377.log.gz-5 2024-08-17T02:29:58.700 INFO:teuthology.orchestra.run.smithi153.stderr:--verbose -- /var/log/ceph/ceph-client.admin.29798.log 2024-08-17T02:29:58.700 INFO:teuthology.orchestra.run.smithi153.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34459.log.gz 2024-08-17T02:29:58.700 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.34270.log: -- /var/log/ceph/ceph-client.admin.29342.log 2024-08-17T02:29:58.700 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32534.log 2024-08-17T02:29:58.700 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.29798.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34270.log.gz 2024-08-17T02:29:58.701 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30206.log 2024-08-17T02:29:58.701 INFO:teuthology.orchestra.run.smithi153.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.29798.log.gz 2024-08-17T02:29:58.701 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.29342.log: /var/log/ceph/ceph-client.admin.32534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30287.log 2024-08-17T02:29:58.701 INFO:teuthology.orchestra.run.smithi153.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.29342.log.gz 2024-08-17T02:29:58.701 INFO:teuthology.orchestra.run.smithi153.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32534.log.gz 2024-08-17T02:29:58.701 INFO:teuthology.orchestra.run.smithi153.stderr:gzip /var/log/ceph/ceph-client.admin.30206.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.34540.log 2024-08-17T02:29:58.701 INFO:teuthology.orchestra.run.smithi153.stderr:gzip /var/log/ceph/ceph-client.admin.30287.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.32223.log 2024-08-17T02:29:58.701 INFO:teuthology.orchestra.run.smithi153.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.30206.log.gz 2024-08-17T02:29:58.701 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:29:58.702 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.34540.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.30287.log.gz 2024-08-17T02:29:58.702 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33982.log 2024-08-17T02:29:58.702 INFO:teuthology.orchestra.run.smithi153.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34540.log.gz 2024-08-17T02:29:58.702 INFO:teuthology.orchestra.run.smithi153.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32223.log.gz 2024-08-17T02:29:58.702 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33801.log 2024-08-17T02:29:58.702 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31191.log /var/log/ceph/ceph-client.admin.33982.log: 2024-08-17T02:29:58.702 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 /var/log/ceph/ceph-client.admin.33801.log: --verbose -- /var/log/ceph/ceph-client.admin.29579.log 2024-08-17T02:29:58.702 INFO:teuthology.orchestra.run.smithi153.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.33982.log.gz 2024-08-17T02:29:58.703 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.31191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32698.log 2024-08-17T02:29:58.703 INFO:teuthology.orchestra.run.smithi153.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33801.log.gz 2024-08-17T02:29:58.703 INFO:teuthology.orchestra.run.smithi153.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31191.log.gz 2024-08-17T02:29:58.703 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34243.log 2024-08-17T02:29:58.703 INFO:teuthology.orchestra.run.smithi153.stderr: 88.2%/var/log/ceph/ceph-client.admin.29579.log: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:29:58.703 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29068.log 2024-08-17T02:29:58.703 INFO:teuthology.orchestra.run.smithi153.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.29579.log.gz 2024-08-17T02:29:58.703 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30233.log 2024-08-17T02:29:58.703 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.34243.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32698.log.gz 2024-08-17T02:29:58.704 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33458.log 2024-08-17T02:29:58.704 INFO:teuthology.orchestra.run.smithi153.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34243.log.gz 2024-08-17T02:29:58.704 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.29068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34594.log 2024-08-17T02:29:58.704 INFO:teuthology.orchestra.run.smithi153.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.29068.log.gz 2024-08-17T02:29:58.704 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.30233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31380.log 2024-08-17T02:29:58.704 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.33458.log: 88.3%gzip /var/log/ceph/ceph-client.admin.34594.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.29149.log 2024-08-17T02:29:58.704 INFO:teuthology.orchestra.run.smithi153.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33458.log.gz 2024-08-17T02:29:58.704 INFO:teuthology.orchestra.run.smithi153.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30233.log.gz 2024-08-17T02:29:58.705 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30260.log 2024-08-17T02:29:58.705 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.31380.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34594.log.gz 2024-08-17T02:29:58.705 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.29149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33693.log 2024-08-17T02:29:58.705 INFO:teuthology.orchestra.run.smithi153.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31380.log.gz 2024-08-17T02:29:58.705 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.30260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33485.log 2024-08-17T02:29:58.705 INFO:teuthology.orchestra.run.smithi153.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.29149.log.gz 2024-08-17T02:29:58.705 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31299.log 2024-08-17T02:29:58.705 INFO:teuthology.orchestra.run.smithi153.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.30260.log.gz 2024-08-17T02:29:58.706 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.33693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30584.log 2024-08-17T02:29:58.706 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.33485.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33693.log.gz 2024-08-17T02:29:58.706 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32617.log 2024-08-17T02:29:58.706 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.31299.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33485.log.gz 2024-08-17T02:29:58.706 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29261.log 2024-08-17T02:29:58.706 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.30584.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31299.log.gz 2024-08-17T02:29:58.706 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32617.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.30584.log.gz 2024-08-17T02:29:58.706 INFO:teuthology.orchestra.run.smithi153.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32617.log.gz 2024-08-17T02:29:58.707 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-osd.7.log: 91.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-08-17T02:29:58.730 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29582.log 2024-08-17T02:29:58.730 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33032.log 2024-08-17T02:29:58.731 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.29261.log: /var/log/ceph/ceph-client.admin.29582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33855.log 2024-08-17T02:29:58.731 INFO:teuthology.orchestra.run.smithi153.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.29261.log.gz 2024-08-17T02:29:58.731 INFO:teuthology.orchestra.run.smithi153.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.29582.log.gz 2024-08-17T02:29:58.731 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.33032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29578.log 2024-08-17T02:29:58.731 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30776.log 2024-08-17T02:29:58.731 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.33855.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33032.log.gz 2024-08-17T02:29:58.731 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31596.log 2024-08-17T02:29:58.731 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.29578.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33855.log.gz 2024-08-17T02:29:58.732 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.30776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30395.log 2024-08-17T02:29:58.732 INFO:teuthology.orchestra.run.smithi153.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.29578.log.gz 2024-08-17T02:29:58.732 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.31596.log: 90.8% -- replaced with /var/log/ceph/ceph-client.0.30776.log.gz 2024-08-17T02:29:58.732 INFO:teuthology.orchestra.run.smithi153.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31596.log.gz 2024-08-17T02:29:58.732 INFO:teuthology.orchestra.run.smithi153.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-08-17T02:29:58.732 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30667.log 2024-08-17T02:29:58.732 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.30395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31569.log 2024-08-17T02:29:58.732 INFO:teuthology.orchestra.run.smithi153.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30395.log.gz 2024-08-17T02:29:58.733 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31461.log 2024-08-17T02:29:58.733 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.30667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30422.log 2024-08-17T02:29:58.733 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.31569.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.30667.log.gz 2024-08-17T02:29:58.733 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30503.log 2024-08-17T02:29:58.733 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.31461.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31569.log.gz 2024-08-17T02:29:58.733 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.30422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33242.log 2024-08-17T02:29:58.733 INFO:teuthology.orchestra.run.smithi153.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.31461.log.gz 2024-08-17T02:29:58.733 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29794.log 2024-08-17T02:29:58.733 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.30503.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.30422.log.gz 2024-08-17T02:29:58.734 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30611.log 2024-08-17T02:29:58.734 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.33242.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.30503.log.gz 2024-08-17T02:29:58.734 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.29794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29583.log 2024-08-17T02:29:58.734 INFO:teuthology.orchestra.run.smithi153.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.29794.log.gz 2024-08-17T02:29:58.734 INFO:teuthology.orchestra.run.smithi153.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33242.log.gz 2024-08-17T02:29:58.734 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29288.log 2024-08-17T02:29:58.734 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.30611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34297.log 2024-08-17T02:29:58.734 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.29583.log: /var/log/ceph/ceph-client.admin.29288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34378.log 2024-08-17T02:29:58.735 INFO:teuthology.orchestra.run.smithi153.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.29583.log.gz 2024-08-17T02:29:58.735 INFO:teuthology.orchestra.run.smithi153.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.29288.log.gz 2024-08-17T02:29:58.735 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33955.log 2024-08-17T02:29:58.735 INFO:teuthology.orchestra.run.smithi153.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.30611.log.gz 2024-08-17T02:29:58.735 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.34297.log: /var/log/ceph/ceph-client.admin.34378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31434.log 2024-08-17T02:29:58.735 INFO:teuthology.orchestra.run.smithi153.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34378.log.gz 2024-08-17T02:29:58.735 INFO:teuthology.orchestra.run.smithi153.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34297.log.gz 2024-08-17T02:29:58.735 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.33955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32250.log 2024-08-17T02:29:58.736 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34133.log /var/log/ceph/ceph-client.admin.31434.log: 2024-08-17T02:29:58.736 INFO:teuthology.orchestra.run.smithi153.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33955.log.gz 2024-08-17T02:29:58.736 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30996.log 2024-08-17T02:29:58.736 INFO:teuthology.orchestra.run.smithi153.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31434.log.gz 2024-08-17T02:29:58.736 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-08-17T02:29:58.736 INFO:teuthology.orchestra.run.smithi153.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32250.log.gz 2024-08-17T02:29:58.736 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.34133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31691.log 2024-08-17T02:29:58.736 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.30996.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34133.log.gz 2024-08-17T02:29:58.736 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29369.log 2024-08-17T02:29:58.737 INFO:teuthology.orchestra.run.smithi153.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30996.log.gz 2024-08-17T02:29:58.737 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31272.log 2024-08-17T02:29:58.737 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.31691.log: /var/log/ceph/ceph-client.admin.29369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29396.log 2024-08-17T02:29:58.737 INFO:teuthology.orchestra.run.smithi153.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.29369.log.gz 2024-08-17T02:29:58.737 INFO:teuthology.orchestra.run.smithi153.stderr: 89.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31272.log: /var/log/ceph/ceph-client.admin.29584.log 2024-08-17T02:29:58.737 INFO:teuthology.orchestra.run.smithi153.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31691.log.gz 2024-08-17T02:29:58.737 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.29396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34567.log 2024-08-17T02:29:58.737 INFO:teuthology.orchestra.run.smithi153.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31272.log.gz 2024-08-17T02:29:58.738 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.29584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31718.log 2024-08-17T02:29:58.738 INFO:teuthology.orchestra.run.smithi153.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.29396.log.gz 2024-08-17T02:29:58.738 INFO:teuthology.orchestra.run.smithi153.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.29584.log.gz 2024-08-17T02:29:58.738 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31826.log 2024-08-17T02:29:58.738 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.34567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31137.log /var/log/ceph/ceph-client.admin.31718.log: 2024-08-17T02:29:58.738 INFO:teuthology.orchestra.run.smithi153.stderr: 88.0%/var/log/ceph/ceph-client.admin.31826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34324.log 2024-08-17T02:29:58.738 INFO:teuthology.orchestra.run.smithi153.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34567.log.gz 2024-08-17T02:29:58.738 INFO:teuthology.orchestra.run.smithi153.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31718.log.gz 2024-08-17T02:29:58.739 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32912.log 2024-08-17T02:29:58.739 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.31137.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31826.log.gz 2024-08-17T02:29:58.739 INFO:teuthology.orchestra.run.smithi153.stderr:gzip /var/log/ceph/ceph-client.admin.34324.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.32196.log 2024-08-17T02:29:58.739 INFO:teuthology.orchestra.run.smithi153.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31137.log.gz 2024-08-17T02:29:58.739 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30557.log 2024-08-17T02:29:58.739 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32912.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34324.log.gz 2024-08-17T02:29:58.739 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32387.log 2024-08-17T02:29:58.740 INFO:teuthology.orchestra.run.smithi153.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.32912.log.gz 2024-08-17T02:29:58.740 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32939.log 2024-08-17T02:29:58.740 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.30557.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32196.log.gz 2024-08-17T02:29:58.740 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32387.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.30557.log.gz 2024-08-17T02:29:58.740 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30015.log 2024-08-17T02:29:58.740 INFO:teuthology.orchestra.run.smithi153.stderr: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.32387.log.gz 2024-08-17T02:29:58.740 INFO:teuthology.orchestra.run.smithi153.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.29176.log 2024-08-17T02:29:58.740 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32939.log: /var/log/ceph/ceph-client.admin.30015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29122.log 2024-08-17T02:29:58.740 INFO:teuthology.orchestra.run.smithi153.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32939.log.gz 88.4%gzip /var/log/ceph/ceph-client.admin.29176.log: 2024-08-17T02:29:58.741 INFO:teuthology.orchestra.run.smithi153.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.33882.log 2024-08-17T02:29:58.741 INFO:teuthology.orchestra.run.smithi153.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30015.log.gz 2024-08-17T02:29:58.741 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.29122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31110.log 2024-08-17T02:29:58.741 INFO:teuthology.orchestra.run.smithi153.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.29176.log.gz 2024-08-17T02:29:58.741 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29234.log 2024-08-17T02:29:58.741 INFO:teuthology.orchestra.run.smithi153.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.29122.log.gz 2024-08-17T02:29:58.741 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.33882.log: /var/log/ceph/ceph-client.admin.31110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34673.log 2024-08-17T02:29:58.741 INFO:teuthology.orchestra.run.smithi153.stderr: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32725.log /var/log/ceph/ceph-client.admin.29234.log: 2024-08-17T02:29:58.741 INFO:teuthology.orchestra.run.smithi153.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33882.log.gz 2024-08-17T02:29:58.742 INFO:teuthology.orchestra.run.smithi153.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31110.log.gz 2024-08-17T02:29:58.742 INFO:teuthology.orchestra.run.smithi153.stderr:gzip /var/log/ceph/ceph-client.admin.34673.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.29992.log 2024-08-17T02:29:58.742 INFO:teuthology.orchestra.run.smithi153.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.29234.log.gz 2024-08-17T02:29:58.742 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32140.log 2024-08-17T02:29:58.742 INFO:teuthology.orchestra.run.smithi153.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34673.log.gz 2024-08-17T02:29:58.742 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31988.log 2024-08-17T02:29:58.742 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.29992.log: gzip /var/log/ceph/ceph-client.admin.32140.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.31880.log 2024-08-17T02:29:58.743 INFO:teuthology.orchestra.run.smithi153.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.29992.log.gz 2024-08-17T02:29:58.743 INFO:teuthology.orchestra.run.smithi153.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.32725.log.gz 2024-08-17T02:29:58.743 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.31988.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32140.log.gz 2024-08-17T02:29:58.743 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31488.log 2024-08-17T02:29:58.743 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.31880.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31988.log.gz 2024-08-17T02:29:58.743 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31407.log 2024-08-17T02:29:58.743 INFO:teuthology.orchestra.run.smithi153.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31880.log.gz 2024-08-17T02:29:58.743 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.31488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32885.log 2024-08-17T02:29:58.743 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30017.log 2024-08-17T02:29:58.744 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.31407.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31488.log.gz 2024-08-17T02:29:58.744 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33747.log 2024-08-17T02:29:58.744 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32885.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31407.log.gz 2024-08-17T02:29:58.744 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.30017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34160.log 2024-08-17T02:29:58.744 INFO:teuthology.orchestra.run.smithi153.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32885.log.gz 2024-08-17T02:29:58.744 INFO:teuthology.orchestra.run.smithi153.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.30017.log.gz 2024-08-17T02:29:58.744 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.33747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33404.log 2024-08-17T02:29:58.744 INFO:teuthology.orchestra.run.smithi153.stderr:gzip /var/log/ceph/ceph-client.admin.34160.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.29315.log 2024-08-17T02:29:58.745 INFO:teuthology.orchestra.run.smithi153.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33747.log.gz 2024-08-17T02:29:58.745 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33774.log 2024-08-17T02:29:58.745 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.33404.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34160.log.gz 2024-08-17T02:29:58.745 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.29315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34432.log 2024-08-17T02:29:58.745 INFO:teuthology.orchestra.run.smithi153.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33404.log.gz 2024-08-17T02:29:58.745 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.33774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33269.log 2024-08-17T02:29:58.745 INFO:teuthology.orchestra.run.smithi153.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.29315.log.gz 2024-08-17T02:29:58.745 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.34432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33215.log 2024-08-17T02:29:58.746 INFO:teuthology.orchestra.run.smithi153.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33774.log.gz 2024-08-17T02:29:58.746 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34405.log 2024-08-17T02:29:58.746 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.33269.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34432.log.gz 2024-08-17T02:29:58.746 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.33215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29013.log 2024-08-17T02:29:58.746 INFO:teuthology.orchestra.run.smithi153.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33269.log.gz 2024-08-17T02:29:58.746 INFO:teuthology.orchestra.run.smithi153.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33215.log.gz 2024-08-17T02:29:58.746 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.34405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31218.log 2024-08-17T02:29:58.746 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33188.log /var/log/ceph/ceph-client.admin.29013.log: 2024-08-17T02:29:58.746 INFO:teuthology.orchestra.run.smithi153.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34405.log.gz 2024-08-17T02:29:58.747 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34621.log 2024-08-17T02:29:58.747 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.31218.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.29013.log.gz 2024-08-17T02:29:58.747 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.33188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31326.log 2024-08-17T02:29:58.747 INFO:teuthology.orchestra.run.smithi153.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31218.log.gz 2024-08-17T02:29:58.747 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33350.log 2024-08-17T02:29:58.747 INFO:teuthology.orchestra.run.smithi153.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33188.log.gz 2024-08-17T02:29:58.747 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.34621.log: /var/log/ceph/ceph-client.admin.31326.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-17T02:29:58.747 INFO:teuthology.orchestra.run.smithi153.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34621.log.gz 2024-08-17T02:29:58.748 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29477.log 2024-08-17T02:29:58.748 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.33350.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31326.log.gz 2024-08-17T02:29:58.748 INFO:teuthology.orchestra.run.smithi153.stderr: 87.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.33350.log.gz-5 2024-08-17T02:29:58.748 INFO:teuthology.orchestra.run.smithi153.stderr:--verbose /var/log/ceph/ceph.log: -- /var/log/ceph/ceph-client.admin.31353.log 2024-08-17T02:29:58.748 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34079.log 2024-08-17T02:29:58.748 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.29477.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-08-17T02:29:58.748 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.31353.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.29477.log.gz/var/log/ceph/ceph-client.admin.34079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31029.log 2024-08-17T02:29:58.748 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-08-17T02:29:58.749 INFO:teuthology.orchestra.run.smithi153.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31353.log.gz 2024-08-17T02:29:58.749 INFO:teuthology.orchestra.run.smithi153.stderr: 84.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-17T02:29:58.749 INFO:teuthology.orchestra.run.smithi153.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34079.log.gz 2024-08-17T02:29:58.749 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28913.log 2024-08-17T02:29:58.749 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31934.log 2024-08-17T02:29:58.749 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.31029.log: /var/log/ceph/ceph-client.admin.28913.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31029.log.gz 2024-08-17T02:29:58.749 INFO:teuthology.orchestra.run.smithi153.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.28913.log.gz 2024-08-17T02:29:58.749 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29205.log 2024-08-17T02:29:58.749 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30969.log 2024-08-17T02:29:58.750 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.31934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34189.log 2024-08-17T02:29:58.750 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.29205.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31934.log.gz 2024-08-17T02:29:58.750 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.30969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31056.log 2024-08-17T02:29:58.750 INFO:teuthology.orchestra.run.smithi153.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.29205.log.gz 2024-08-17T02:29:58.750 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32644.log 2024-08-17T02:29:58.750 INFO:teuthology.orchestra.run.smithi153.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.30969.log.gz 2024-08-17T02:29:58.750 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.34189.log: /var/log/ceph/ceph-client.admin.31056.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34189.log.gz 2024-08-17T02:29:58.750 INFO:teuthology.orchestra.run.smithi153.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31056.log.gz 2024-08-17T02:29:58.761 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29585.log 2024-08-17T02:29:58.761 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31083.log 2024-08-17T02:29:58.761 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.29585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32833.log 2024-08-17T02:29:58.761 INFO:teuthology.orchestra.run.smithi153.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.32644.log.gz 2024-08-17T02:29:58.762 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.31083.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.29585.log.gz 2024-08-17T02:29:58.762 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31745.log 2024-08-17T02:29:58.762 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28843.log 2024-08-17T02:29:58.762 INFO:teuthology.orchestra.run.smithi153.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31083.log.gz 2024-08-17T02:29:58.762 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.32833.log: /var/log/ceph/ceph-client.admin.31745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34486.log 2024-08-17T02:29:58.762 INFO:teuthology.orchestra.run.smithi153.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31745.log.gz 2024-08-17T02:29:58.762 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.28843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32169.log 2024-08-17T02:29:58.763 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24108.log 2024-08-17T02:29:58.763 INFO:teuthology.orchestra.run.smithi153.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.28843.log.gz 2024-08-17T02:29:58.763 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.34486.log: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-08-17T02:29:58.763 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32169.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32478.log 2024-08-17T02:29:58.763 INFO:teuthology.orchestra.run.smithi153.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34486.log.gz 2024-08-17T02:29:58.763 INFO:teuthology.orchestra.run.smithi153.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32169.log.gz 2024-08-17T02:29:58.763 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.24108.log: 95.3% -- replaced with /var/log/ceph/ceph-client.0.32833.log.gz 2024-08-17T02:29:58.764 INFO:teuthology.orchestra.run.smithi153.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.24108.log.gz 2024-08-17T02:29:58.764 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32993.log 2024-08-17T02:29:58.764 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30449.log 2024-08-17T02:29:58.764 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32478.log: /var/log/ceph/ceph-client.admin.32993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32358.log 2024-08-17T02:29:58.764 INFO:teuthology.orchestra.run.smithi153.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32478.log.gz 2024-08-17T02:29:58.764 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.30449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29586.log 2024-08-17T02:29:58.764 INFO:teuthology.orchestra.run.smithi153.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.32993.log.gz 2024-08-17T02:29:58.764 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29795.log 2024-08-17T02:29:58.765 INFO:teuthology.orchestra.run.smithi153.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.30449.log.gz 2024-08-17T02:29:58.765 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32358.log: /var/log/ceph/ceph-client.admin.29586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33585.log 2024-08-17T02:29:58.765 INFO:teuthology.orchestra.run.smithi153.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32358.log.gz 2024-08-17T02:29:58.765 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31664.log 2024-08-17T02:29:58.765 INFO:teuthology.orchestra.run.smithi153.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.29586.log.gz 2024-08-17T02:29:58.765 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.29795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32590.log 2024-08-17T02:29:58.765 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.33585.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.29795.log.gz 2024-08-17T02:29:58.765 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.31664.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-08-17T02:29:58.766 INFO:teuthology.orchestra.run.smithi153.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33585.log.gz 2024-08-17T02:29:58.766 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34106.log 2024-08-17T02:29:58.766 INFO:teuthology.orchestra.run.smithi153.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31664.log.gz 2024-08-17T02:29:58.766 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33928.log 2024-08-17T02:29:58.766 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.3.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32590.log.gz 2024-08-17T02:29:58.766 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29800.log 2024-08-17T02:29:58.766 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.34106.log: /var/log/ceph/ceph-client.admin.33928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.30919.log 2024-08-17T02:29:58.767 INFO:teuthology.orchestra.run.smithi153.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34106.log.gz 2024-08-17T02:29:58.767 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29095.log 2024-08-17T02:29:58.767 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.29800.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33928.log.gz 2024-08-17T02:29:58.767 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.2.30919.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.29800.log.gz 2024-08-17T02:29:58.767 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34216.log 2024-08-17T02:29:58.767 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30476.log 2024-08-17T02:29:58.767 INFO:teuthology.orchestra.run.smithi153.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.2.30919.log.gz 2024-08-17T02:29:58.767 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.29095.log: /var/log/ceph/ceph-client.admin.34216.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.29095.log.gz 2024-08-17T02:29:58.767 INFO:teuthology.orchestra.run.smithi153.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34216.log.gz 2024-08-17T02:29:58.768 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32776.log 2024-08-17T02:29:58.768 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34351.log 2024-08-17T02:29:58.768 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.30476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29797.log 2024-08-17T02:29:58.768 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32776.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.30476.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30009.log 2024-08-17T02:29:58.768 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.34351.log: 2024-08-17T02:29:58.768 INFO:teuthology.orchestra.run.smithi153.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32776.log.gz 2024-08-17T02:29:58.768 INFO:teuthology.orchestra.run.smithi153.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34351.log.gz 2024-08-17T02:29:58.768 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.29797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31772.log 2024-08-17T02:29:58.769 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34700.log 2024-08-17T02:29:58.769 INFO:teuthology.orchestra.run.smithi153.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.29797.log.gz 2024-08-17T02:29:58.769 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.30009.log: /var/log/ceph/ceph-client.admin.31772.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.31772.log.gz 2024-08-17T02:29:58.769 INFO:teuthology.orchestra.run.smithi153.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.30009.log.gz 2024-08-17T02:29:58.769 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29802.log 2024-08-17T02:29:58.769 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33431.log 2024-08-17T02:29:58.769 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.34700.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-08-17T02:29:58.769 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.29802.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34700.log.gz 2024-08-17T02:29:58.770 INFO:teuthology.orchestra.run.smithi153.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.29802.log.gz 2024-08-17T02:29:58.770 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29801.log 2024-08-17T02:29:58.770 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.33431.log: /var/log/ceph/ceph-osd.2.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33431.log.gz 2024-08-17T02:29:58.770 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30018.log 2024-08-17T02:29:58.770 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.29801.log: /var/log/ceph/ceph-client.admin.30018.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.29801.log.gz 2024-08-17T02:29:58.770 INFO:teuthology.orchestra.run.smithi153.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.30018.log.gz 2024-08-17T02:29:58.804 INFO:teuthology.orchestra.run.smithi174.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-08-17T02:29:58.811 INFO:teuthology.orchestra.run.smithi174.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-08-17T02:29:58.811 INFO:teuthology.orchestra.run.smithi174.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-08-17T02:29:58.851 INFO:teuthology.orchestra.run.smithi174.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-08-17T02:29:58.855 INFO:teuthology.orchestra.run.smithi153.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-08-17T02:29:58.857 INFO:teuthology.orchestra.run.smithi174.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-08-17T02:29:58.864 INFO:teuthology.orchestra.run.smithi153.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-08-17T02:29:58.865 INFO:teuthology.orchestra.run.smithi174.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-08-17T02:29:58.866 INFO:teuthology.orchestra.run.smithi174.stderr: 2024-08-17T02:29:58.866 INFO:teuthology.orchestra.run.smithi174.stderr:real 0m0.225s 2024-08-17T02:29:58.867 INFO:teuthology.orchestra.run.smithi174.stderr:user 0m1.004s 2024-08-17T02:29:58.867 INFO:teuthology.orchestra.run.smithi174.stderr:sys 0m0.062s 2024-08-17T02:29:58.881 INFO:teuthology.orchestra.run.smithi153.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-08-17T02:29:58.899 INFO:teuthology.orchestra.run.smithi153.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-08-17T02:29:58.963 INFO:teuthology.orchestra.run.smithi153.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-08-17T02:29:58.964 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-08-17T02:29:58.964 INFO:teuthology.orchestra.run.smithi153.stderr:real 0m0.341s 2024-08-17T02:29:58.964 INFO:teuthology.orchestra.run.smithi153.stderr:user 0m1.218s 2024-08-17T02:29:58.964 INFO:teuthology.orchestra.run.smithi153.stderr:sys 0m0.090s 2024-08-17T02:29:58.965 INFO:tasks.ceph:Archiving logs... 2024-08-17T02:29:58.965 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858245/remote/smithi153/log 2024-08-17T02:29:58.966 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:29:59.275 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858245/remote/smithi174/log 2024-08-17T02:29:59.276 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:29:59.409 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-17T02:29:59.434 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-17T02:29:59.434 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:29:59.436 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:29:59.503 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-17T02:29:59.511 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-17T02:29:59.512 DEBUG:teuthology.orchestra.run.smithi153:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:29:59.514 DEBUG:teuthology.orchestra.run.smithi174:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:29:59.537 INFO:teuthology.orchestra.run.smithi174.stdout: remote refid st t when poll reach delay offset jitter 2024-08-17T02:29:59.538 INFO:teuthology.orchestra.run.smithi174.stdout:============================================================================== 2024-08-17T02:29:59.538 INFO:teuthology.orchestra.run.smithi174.stdout:+hv01.front.sepi 67.205.162.81 3 u 1 64 377 0.096 0.835 0.452 2024-08-17T02:29:59.538 INFO:teuthology.orchestra.run.smithi174.stdout:*hv02.front.sepi 63.231.80.2 3 u 11 64 377 0.103 0.933 0.643 2024-08-17T02:29:59.538 INFO:teuthology.orchestra.run.smithi174.stdout:+hv03.front.sepi 74.6.168.72 3 u 7 64 377 0.082 0.648 0.545 2024-08-17T02:29:59.538 INFO:teuthology.orchestra.run.smithi174.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:29:59.538 INFO:teuthology.orchestra.run.smithi153.stdout: remote refid st t when poll reach delay offset jitter 2024-08-17T02:29:59.538 INFO:teuthology.orchestra.run.smithi153.stdout:============================================================================== 2024-08-17T02:29:59.539 INFO:teuthology.orchestra.run.smithi153.stdout:+hv01.front.sepi 67.205.162.81 3 u 11 64 377 0.077 0.624 0.315 2024-08-17T02:29:59.539 INFO:teuthology.orchestra.run.smithi153.stdout:*hv02.front.sepi 63.231.80.2 3 u 13 64 377 0.061 1.111 0.613 2024-08-17T02:29:59.539 INFO:teuthology.orchestra.run.smithi153.stdout:+hv03.front.sepi 74.6.168.72 3 u 8 64 377 0.073 0.439 0.345 2024-08-17T02:29:59.539 INFO:teuthology.orchestra.run.smithi153.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:29:59.540 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-17T02:29:59.548 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-17T02:29:59.548 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-17T02:29:59.562 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-17T02:29:59.574 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-17T02:29:59.589 INFO:teuthology.task.internal:Duration was 818.293703 seconds 2024-08-17T02:29:59.589 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-17T02:29:59.603 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-17T02:29:59.603 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:29:59.605 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:29:59.654 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-17T02:29:59.655 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi153.front.sepia.ceph.com 2024-08-17T02:29:59.655 DEBUG:teuthology.orchestra.run.smithi153:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:29:59.667 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi174.front.sepia.ceph.com 2024-08-17T02:29:59.667 DEBUG:teuthology.orchestra.run.smithi174:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:29:59.679 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-17T02:29:59.679 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:29:59.681 DEBUG:teuthology.orchestra.run.smithi174:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:29:59.760 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-17T02:29:59.760 DEBUG:teuthology.orchestra.run.smithi153:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:29:59.764 DEBUG:teuthology.orchestra.run.smithi174:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:29:59.839 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-17T02:29:59.848 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-17T02:29:59.849 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:29:59.864 DEBUG:teuthology.orchestra.run.smithi174:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:29:59.877 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-17T02:29:59.885 DEBUG:teuthology.orchestra.run.smithi153:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:29:59.888 DEBUG:teuthology.orchestra.run.smithi174:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:29:59.900 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = core 2024-08-17T02:29:59.935 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern = core 2024-08-17T02:29:59.951 DEBUG:teuthology.orchestra.run.smithi153:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:29:59.963 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:29:59.964 DEBUG:teuthology.orchestra.run.smithi174:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:29:59.969 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:29:59.969 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-17T02:29:59.978 INFO:teuthology.task.internal:Transferring archived files... 2024-08-17T02:29:59.979 DEBUG:teuthology.misc:Transferring archived files from smithi153:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858245/remote/smithi153 2024-08-17T02:29:59.979 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:30:00.004 DEBUG:teuthology.misc:Transferring archived files from smithi174:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858245/remote/smithi174 2024-08-17T02:30:00.004 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:30:00.027 INFO:teuthology.task.internal:Removing archive directory... 2024-08-17T02:30:00.028 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:30:00.030 DEBUG:teuthology.orchestra.run.smithi174:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:30:00.074 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-17T02:30:00.085 INFO:teuthology.task.internal:Not uploading archives. 2024-08-17T02:30:00.086 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-17T02:30:00.096 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-17T02:30:00.096 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:30:00.098 DEBUG:teuthology.orchestra.run.smithi174:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:30:00.103 INFO:teuthology.orchestra.run.smithi153.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:30 /home/ubuntu/cephtest 2024-08-17T02:30:00.105 INFO:teuthology.orchestra.run.smithi174.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:30 /home/ubuntu/cephtest 2024-08-17T02:30:00.108 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-17T02:30:00.117 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-17T02:30:00.140 INFO:teuthology.run:Summary data: description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} duration: 818.293702840805 failure_reason: 'Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes)' flavor: default owner: scheduled_mchangir@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=df6291ccf6e647f9b94ff813f8fe93cb status: fail success: false 2024-08-17T02:30:00.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:30:00.212 INFO:teuthology.run:FAIL